Get started with Aiven for Apache Kafka® Connect

Get started with Aiven for Apache Kafka® Connect and integrate it with your Apache Kafka® service.

Prerequisites

Ensure that you have at least one Aiven for Apache Kafka® service in your project. If your project does not have an Aiven for Apache Kafka service, create one.

Console

• Access to the Aiven Console

Terraform

• Terraform installed
• A personal token

Create a dedicated Aiven for Apache Kafka® Connect service

Console

1. Log into Aiven Console and select the Aiven for Apache Kafka service where to create a dedicated Aiven for Apache Kafka Connect service.

2. Select Connectors from left sidebar and select Integrate standalone service.

3. Enter a name for your service. A random name is provided by default, but you can enter a more recognizable name to distinguish it from other services.

4. Select the cloud provider and region where to run your service.

   note

   The pricing for the same service may vary between different providers and regions. The service summary on the right side of the console shows you the pricing for your selected options.

5. Select a service plan. This defines how many servers and what kind of memory, CPU, and disk resources are allocated to your service.

6. Select Create and enable under the summary in the console.

At the top of the screen, you will notice the Apache Kafka Connect integration. Selecting the service name will take you to the Service Overview page to monitor the service status. Before using it, it's important to wait until the service status changes from REBUILDING to RUNNING.

Terraform

The following example files are also available in the Aiven Terraform Provider repository on GitHub.

1. Create a file named provider.tf and add the following:

   Loading...

2. Create a file named service.tf and add the following:

   Loading...

3. Create a file named variables.tf and add the following:

   Loading...

4. Create the terraform.tfvars file and add the values for your token and project name.

To apply your Terraform configuration:

1. Initialize Terraform by running:

   terraform init

   The output is similar to the following:

   
   Initializing the backend...
   
   Initializing provider plugins...
   - Finding aiven/aiven versions matching ">= 4.0.0, < 5.0.0"...
   - Installing aiven/aiven v4.9.2...
   - Installed aiven/aiven v4.9.2
   ...
   Terraform has been successfully initialized!
   ...

2. To create an execution plan and preview the changes, run:

   terraform plan

3. To deploy your changes, run:

   terraform apply --auto-approve

Next steps

• Check our examples project to find code samples to get your application connected.
• Try our sample data generator project to give you some data to get started with.