Introducing improved Aiven Kafka topic management

From options for creating topics automatically to a new ACL permission level, Aiven Kafka users now have greater control over topic management; learn more.

14 March 2018
Heikki Nousiainen
Heikki Nousiainen RSS Feed
Chief Technology Officer at Aiven

We're happy to announce Kafka topic management updates for Aiven Kafka that have been frequently requested from our customers.

These updates will improve the interoperability between Aiven Kafka service instances and the Kafka ecosystem applications and tooling. Let's jump into the details!

Topic management over the Kafka protocol

Aiven Kafka now supports creating, modifying and deleting topics over the Kafka protocol. The initial CreateTopic API call was introduced in Kafka 0.10.1.0, and support has been gradually extending ever since. The APIs have matured with Kafka 1.0 and the Kafka ecosystem tooling is increasingly starting to utilize these APIs.

With the API supported, utilizing Kafka Connect, Kafka Streams, KSQL and other tooling is now much easier than before.

We've also added a new ACL permission level, admin, allowing you to provide specific users permission to create, update, and delete topics through the Kafka protocol.

Automatic topic creation

In addition to the explicit API calls, we're adding an option to enable automatic topic creation. This feature can be enabled with the Aiven Command Line Client:

    avn service update \
        --project project-name \
        example-kafka-service \
        -c kafka.auto_create_topics_enable=true

Admin ACL permission is required for the topic creation to be successful.

Wrapping up

Both can be introduced to existing Kafka services by triggering a maintenance update from within the Aiven console. Additionally, all new Aiven Kafka deployments will automatically include these modifications.

announcementsfeatureskafka
orange decoration
yellow decoration

Start your free 30 day trial!

Build your platform, and throw in any data you want for 30 days, with no ifs, ands, or buts.

orange decoration
yellow decoration

Start your free 30 day trial!

Build your platform, and throw in any data you want for 30 days, with no ifs, ands, or buts.

Products

Aiven for Apache Kafka®Aiven for Apache Kafka Connect®Aiven for Apache Kafka MirrorMaker 2®Aiven for Apache Flink® BetaAiven for M3Aiven for M3 AggregatorAiven for Apache Cassandra®Aiven for OpenSearchAiven for PostgreSQLAiven for MySQLAiven for RedisAiven for InfluxDBAiven for Grafana

Let‘s connect

Apache Kafka, Apache Kafka Connect, Apache Kafka MirrorMaker 2, Apache Flink and Apache Cassandra are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. ClickHouse, M3, M3 Aggregator, OpenSearch, PostgreSQL, MySQL, Redis, InfluxDB, Grafana are trademarks and property of their respective owners. All product and service names used in this website are for identification purposes only and do not imply endorsement.