Create Apache Flink® data service integrations

With Aiven for Apache Flink®, you can create streaming data pipelines to connect various services.

Aiven for Apache Flink® enables integration with internal and external services, such as Aiven managed services, Google BigQuery®, and external Apache Kafka and PostgreSQL instances. This flexibility allows you to build data processing pipelines using a wide range of data sources and sinks.

Create data service integration

Create Aiven for Apache Flink® data service integrations using the Aiven Console. Follow these steps to integrate either internal and external services.

Integrate Aiven services

1. Log in to Aiven Console and access your Aiven for Apache Flink service.
2. If this is your first integration for the selected Aiven for Apache Flink service, on the Overview page, scroll to Data pipeline.
3. Click Add data source to initiate the integration setup.
4. On the Data service integrations page, under Create service integration tab, choose the Aiven service to integrate: Aiven for Apache Kafka®, Aiven for PostgreSQL®, or Aiven for OpenSearch®.
5. Click Integrate.
6. To include additional integrations, click Plus in the Data pipeline section.

Integrate external services

1. On the Data service integrations page, click the Create external integration endpoint tab.
2. Select the type of external service to integrate: Google BigQuery®, External Apache Kafka, or External PostgreSQL.
3. If no external endpoints are available, go back to the Projects page.
4. Click Integration endpoints to add and configure external integration points.
5. Once the integration endpoint is added, return to your Aiven for Apache Flink service and the Data pipeline section.
6. Click Add data source.
7. On the Data service integrations page, under Create external integration endpoint tab, select the checkbox next to the external data service type and choose the integration endpoint just created.
8. To include additional integrations, click Plus in the Data pipeline section.