Create data lineage across different data technologies

GDPR, data lineage, impact assessment, and security scans are only a few situations where proper metadata handling can turn a month-long project into a simple query.

The talk is about the hidden gold stored in metadata: starting by defining use cases, we'll then focus on point solutions making metadata accessible for a precise technology. But companies' data efforts are rarely limited to a single tech, therefore we'll discuss how to design a system that collects, merges, and makes available metadata coming from different tools. Finally, we'll show an Open Source tool, the Aiven metadata parser, that can help harvest and query the metadata from a variety of different Open Source technologies.

If you want to programmatically keep control over your dynamic data assets, this session is for you!

Related resources

Youtube thumbnail
Francesco Tisiot
Francesco Tisiot

Staff Developer Advocate, Aiven

Francesco comes from Verona, Italy and works as a Staff Developer Advocate at Aiven. With his many years of experience as a data engineer, he has stories to tell and advice for data-wranglers everywhere. Francesco loves sharing knowledge with others as a speaker and writer, and is on a mission to defend the world from bad Italian food!