Skip to main content

View data lineage in DataHub

Data lineage is a map of how each of your data assets moves across your systems. Lineage can help you:

  • Understand your data flows at a glance, even in complex architectures.
  • See which downstream systems would be affected before you change a dataset.
  • Trace data-quality problems or failures back to their source.
  • Build trust by showing stakeholders and auditors where data came from.

When you connect Aiven services to your Aiven for DataHub service, DataHub automatically builds this map of your data assets and syncs them on a schedule. In DataHub, data assets are called datasets.

Note

External services that you connect to DataHub are not shown in the data lineage.

DataHub UI permissions:Reader, Editor, or Admin
View the DataHub access control policies documentation

View lineage for a dataset​

  1. In the Aiven Console, go to your DataHub service.
  2. Log in to DataHub.
  3. Search for and open a dataset.
  4. Click Lineage.

Refresh lineage​

You can manually trigger a re-emission of lineage data between connected services. This is useful when you make changes to service integrations or schemas.

To manually refresh lineage:

  1. In the Aiven Console, go to your DataHub service.
  2. Click Connectors .
  3. For the connector to refresh, click Actions > Refresh lineage.