This quickstart section provides you with the information you need to get started with Aiven for Apache Flink and build data pipelines to stream to analyze your data. Learn how to set up and configure Aiven for Flink, connect to your desired data sources, and start processing and analyzing your data in real-time.
Create an Aiven for Apache Flink® service
Log in to the Aiven web console.
Follow these instructions to create a new Aiven for Apache Flink service.
Once the service is ready, the status changes to Running. Depending on your selected cloud provider and region, this generally takes a couple of minutes.
Create data service integration
Aiven for Apache Flink® allows you to build data pipelines that stream across different services. It currently supports integration with Aiven for Apache Kafka®, Aiven for PostgreSQL®, and Aiven for OpenSearch® as sources and targets for Flink applications.
To create your first data service integration:
- Open your Aiven for Apache Flink.
- In the service Overview screen, select Get Started.
- Choose the service you wish to integrate: Aiven for Apache Kafka®, Aiven for PostgreSQL®, or Aiven for OpenSearch®.
- Select Integrate to complete the integration process.
For detailed steps, see Create Apache Flink® data service integrations.
Create Aiven for Apache Flink® application
An Aiven for Apache Flink® application is an abstraction layer on top of Apache Flink SQL that includes all the elements related to a Flink job to help build your data processing pipeline.
Applications are the starting point for running an Apache Flink job within the Aiven managed service and contains the definition of source and sink tables, data processing logic, deployment parameters, and other necessary metadata.