Aiven Blog

Mar 14, 2018

Introducing improved Aiven Kafka topic management

From options for creating topics automatically to a new ACL permission level, Aiven Kafka users now have greater control over topic management; learn more.

heikki-nousiainen

Heikki Nousiainen

|RSS Feed

Chief Technology Officer at Aiven

We're happy to announce Kafka topic management updates for Aiven Kafka that have been frequently requested from our customers.

These updates will improve the interoperability between Aiven Kafka service instances and the Kafka ecosystem applications and tooling. Let's jump into the details!

Topic management over the Kafka protocol

Aiven Kafka now supports creating, modifying and deleting topics over the Kafka protocol. The initial CreateTopic API call was introduced in Kafka 0.10.1.0, and support has been gradually extending ever since. The APIs have matured with Kafka 1.0 and the Kafka ecosystem tooling is increasingly starting to utilize these APIs.

With the API supported, utilizing Kafka Connect, Kafka Streams, KSQL and other tooling is now much easier than before.

We've also added a new ACL permission level, admin, allowing you to provide specific users permission to create, update, and delete topics through the Kafka protocol.

Automatic topic creation

In addition to the explicit API calls, we're adding an option to enable automatic topic creation. This feature can be enabled with the Aiven Command Line Client:

avn service update \ --project project-name \ example-kafka-service \ -c kafka.auto_create_topics_enable=true

Admin ACL permission is required for the topic creation to be successful.

Wrapping up

Both can be introduced to existing Kafka services by triggering a maintenance update from within the Aiven console. Additionally, all new Aiven Kafka deployments will automatically include these modifications.


Related resources

  • Aiven for PostgreSQL® major version in-place upgrade illustration

    Feb 3, 2023

    Major version updates for your PostgreSQL in seconds? Yes, Aiven can do it! Come and find out more.

  • Hi, would you have time to discuss the product updates from Aiven from this quarter?

    Oct 31, 2022

    The team at Aiven has been busy last quarter with new releases across several of our services. Starting from the announcement of our ClickHouse Beta being available, we have lots of good stuff here. Read on for details about what’s been going on last quarter!

  • Announcing Aiven for OpenSearch® illustration

    Sep 27, 2021

    Aiven is happy to announce the newest arrival on the OpenSearch scene! Read more about Aiven for OpenSearch® and how to upgrade from Elasticsearch.