Create an Apache Kafka® service with bring your own cloud (BYOC)

Create an Aiven for Apache Kafka® service in your own cloud account with Bring Your Own Cloud (BYOC). The service runs in your cloud account while Aiven manages the Kafka infrastructure and operations.

BYOC uses Classic Kafka with fixed plans. Classic topics are available by default. You can optionally enable diskless topics on supported custom clouds.

To create a Kafka service on Aiven Cloud, see Create an Aiven for Apache Kafka® Professional tier service.

Prerequisites

• Access to the Aiven Console
• An Aiven project where you can create Kafka services

Create a Kafka service with BYOC

BYOC Kafka services are available on the Professional service tier.

Console

1. In the Aiven Console, open the project and click Services.

2. Click Create service.

3. Click Apache Kafka®.

4. In Service tier, click Professional.

5. In Deployment mode, click Bring your own cloud (BYOC).

   If No custom clouds available appears, request BYOC access.

   If Set up your custom cloud first appears, set up a custom cloud.

6. Optional: Click Enable diskless topics.

   If Diskless topics with BYOC aren't enabled for your account yet appears, request diskless topics for a custom cloud.

7. In Cloud, click a cloud provider and a custom cloud.

8. In Plan, click a plan.

9. Optional: If Additional disk storage is available, adjust the disk size.

10. Optional: If Enable tiered storage appears, click it to enable tiered storage.

    note

    Enabling diskless topics also enables tiered storage for classic topics on the service.

11. In Service basics, enter:

    • Name: Enter a name for the service. You cannot change the name after you create the service.
    • Version: Click a Kafka version. The default version is preselected.
    • Tags: Optional. Add resource tags to organize your services.

12. Review the Service summary, then click Create service.

13. Wait until the service status is Running.

CLI

Create a BYOC Kafka service using the Aiven CLI:

avn service create SERVICE_NAME \
  --project PROJECT_NAME \
  --service-type kafka \
  --cloud CUSTOM_CLOUD_REGION \
  --plan PLAN_NAME

Replace the following:

• SERVICE_NAME: name of the Kafka service
• PROJECT_NAME: Aiven project name
• CUSTOM_CLOUD_REGION: custom cloud region, such as custom-aws-eu-central-1
• PLAN_NAME: Kafka plan available in the custom cloud, such as business-4

Optional: Enable diskless topics when you create the service. Use a Business or Premium -inkless plan and a custom cloud that supports diskless topics:

avn service create SERVICE_NAME \
  --project PROJECT_NAME \
  --service-type kafka \
  --cloud CUSTOM_CLOUD_REGION \
  --plan INKLESS_PLAN_NAME \
  -c kafka_version=4.1 \
  -c tiered_storage.enabled=true \
  -c kafka_diskless.enabled=true

Replace INKLESS_PLAN_NAME with a plan such as business-8-inkless.

For more information about diskless topics, see Diskless topics for Apache Kafka®.

Request BYOC access

If No custom clouds available appears after you click Bring your own cloud (BYOC):

• Click Request access.

Aiven reviews the request and contacts you about enabling BYOC for your organization. After BYOC is enabled, set up a custom cloud and return to create the service.

For eligibility and the organization-admin process, see Enable BYOC.

Set up a custom cloud

If Set up your custom cloud first appears:

1. Click Go to Admin.
2. Create a custom cloud and assign it to the project. For more information, see Create a custom cloud.
3. Return to create the service after the custom cloud is ready.

Request diskless topics for a custom cloud

If Diskless topics with BYOC aren't enabled for your account yet appears after you click Enable diskless topics:

1. Click Request access.
2. In Select a cloud to enable diskless topics, click one or more custom clouds.
3. Click Send request.

Aiven reviews the request and contacts you with the next steps.

After diskless topics are enabled for those custom clouds, return to create the service and click Enable diskless topics.

Related pages

• Create an Aiven for Apache Kafka® Professional tier service
• Bring your own cloud (BYOC)
• Enable BYOC
• Create a custom cloud
• Diskless topics for Apache Kafka®
• Create a Kafka topic