It's been a long two months, but Aiven has now implemented support for Apache Kafka version 3.0.
As this is a new major version, it comes with a number of enhancements across the board, as well as with some deprecations and API changes.
Group multiple consumer group offset requests
OffsetFetch API allows grouping multiple consumer group offset requests into a single fetch. This reduces request overhead and simplifies client code.
Strongest delivery guarantee by default
[KIP-679: Producer will enable strongest delivery guarantee by default](https://cwiki.apache.org/confluence/display/KAFKA/KIP-679%3A+Producer+will+enable+the+strongest+delivery+guarantee+by+default)
Producer config defaults are modified to make record delivery guarantees stronger by default. This ensures ordering, avoids duplicates and increases durability. As the modification could cause compatibility issues for some users, it is advised you go through the migration plan outlined in KIP-679.
Identify the liveliness of a topic/partition
AdminClient.listOffsets API is extended with the capability to return the offset and timestamp of the record with the highest timestamp in a topic/partition. This allows easy identification if a topic/ partition is alive - being written to - or the health of it.
More granular restarting of connectors
Connect API is enhanced with added granularity to support restarting of only the failed connector and its tasks with a single call.
Karapace schema registry for Aiven for Apache Kafka 3.0
The open-source version of Confluent Schema Registry is no longer supported in Apache Kafka 3.0. As a replacement, Aiven provides a lightweight, fast and truly open source tool, Karapace. More information on migrating to Karapace is provided in the Help article End of support for Confluent Schema Registry on Aiven.
The following functionalities are deprecated in Apache Kafka 3.0:
- MirrorMaker v1 is deprecated and will no longer be supported in Apache Kafka v4.0
- Java 8 and Scala 2.12 programming language versions are deprecated and will be removed in v4.0.
- Message formats v0 and v1 are deprecated and will be removed in Apache Kafka 4.0. Start upgrading your client applications to get the best performance.
- IDEMPOTENT_WRITE is deprecated and will be removed in a future release. Update your application to use WRITE instead.
How to get started with Aiven for Apache Kafka 3.0
You can either launch a brand new cluster in the Aiven Console or conduct a no-downtime upgrade to the latest version.
Not using Aiven services yet? Sign up now for your free trial at https://console.aiven.io/signup!
Nov 14, 2022
All in for Apache Kafka® and OSS collaboration
Aiven contributes back to the Apache Kafka® community with a dedicated full-time team. Find out more about our work!
Feb 10, 2021
Create your own data stream for Apache Kafka® with Python and Faker
How can you test an empty data pipeline? Well, you can't, really. Read on and let's walk you through creating pretend streaming data using Python and Faker.
Jun 10, 2021
Apache Kafka® and the great database debate
Is Apache Kafka® a database? Can I throw out my Postgres and use Kafka instead? Is Kafka the new Swiss Army Knife of data? Find out what the debate is about.
Subscribe to the Aiven newsletter
All things open source, plus our product updates and news in a monthly newsletter.