Skip to main content

Get started with Aiven for Apache Flink®

Begin your experience with Aiven for Apache Flink® by setting up a service, configuring data integrations, and building streaming applications.

Prerequisites​

  1. From your project, in the Services page, click Create service.

  2. From the Select service page, click Apache Flink®.

  3. Select the cloud provider and region to host your service on.

    note

    The pricing for the same service can vary between different providers and regions. The service summary shows you the pricing for your selected options.

  4. Select a service plan.

    note

    This determines the number of servers and the memory, CPU, and disk resources allocated to your service. See Plans & Pricing.

  5. Optional: Add disk storage.

  6. Enter a name for your service.

    important

    You cannot change the name after you create the service.

  7. Optional: Add tags.

  8. Click Create service.

The Overview page of the service opens. It shows the connection parameters for your service, its current status, and the configuration options.

The status of the service is Rebuilding during its creation. When the status becomes Running, you can start using the service. This typically takes couple of minutes and can vary between cloud providers and regions.

Configure data service integrations​

Aiven for Apache Flink® streamlines data processing by enabling integration with various services. Currently, it supports integration with:

  • Aiven for Apache Kafka® and external Apache Kafka clusters
  • Aiven for PostgreSQL®
  • Aiven for OpenSearch®
  • Google BigQuery®

Integration steps​

  1. Log in to Aiven Console and access your Aiven for Apache Flink service.
  2. On the Overview page, scroll to Data pipeline.
  3. Click Add data source.
  4. Choose the service you wish to integrate.
  5. Click Integrate.
tip

For detailed integration steps with specific services, see the Integrate service.

An Aiven for Apache Flink® application act as containers that encapsulate all aspects of a Flink job. This includes data source and sink connections, as well as the data processing logic.

Application types​

  • SQL applications: These applications are ideal for executing SQL queries. The Aiven Console guides you through selecting source and sink tables, and setting up the SQL queries to process your data. To learn how to create SQL applications, see Create an SQL application.
  • JAR applications:These applications allow you to deploy custom functionalities. The Aiven Console enables you to upload and manage your JAR files and execute custom Flink jobs that go beyond the standard SQL capabilities. To learn how to create JAR applications, see Create a JAR application.

Next steps​