Guides to powerful and flexible tools for real-time data processing, analysis, and visualisation. Simplify your workflows and visit the Aiven Developer Center
How can you test an empty data pipeline? Read on to discover how to create pretend streaming data using Python and Faker.
Use an HTTP sink connector to feed data into Apache Kafka® and deploy it using Terraform. A part of Aiven's Terraform Cookbook.
Deploy an Aiven for Apache Kafka® node and integrate it as a data source with Aiven for ClickHouse® using Terraform. A part of Aiven's Terraform Cookbook.
Use Debezium as a source connector to integrate PostgreSQL® and Apache Kafka® and use Terraform to deploy. A part of Aiven's Terraform Cookbook.
Replicate data from one Apache Kafka® cluster to another using MirrorMaker 2. Useful when migrating Apache Kafka® services. A part of Aiven's Terraform Cookbook.
Learn how to use Apache Kafka® as a source and sink to process streaming data, and how to deploy that with Terraform. A part of Aiven's Terraform Cookbook.
Use Terraform to connect Apache Kafka® to OpenSearch®. A part of Aiven's Terraform Cookbook series.
Mastodon → Apache Kafka® → OpenSearch® → knowledge
Find out how Apache Kafka® and Apache Flink® allow you to move from batch processing to streaming, but keep using SQL in the data pipeline.
Learn how to produce and consume records with Apache Kafka Java client library
If you want to analyze Mastodon posts, getting them into Apache Kafka® is a sensible first step. Read on to find out how to do this with Typescript and NodeJS.
When it comes to making a performant Apache Kafka® cluster, partitioning is crucial. Read this article to learn which tools you can use to partition your data.
We all know we shouldn't use naughty words. Learn how to remove them from your streaming data using DataCater.
Learn how to perform analytics with fast response time over huge volumes of data without the need to downsample data.
Find out how to use Apache Kafka® to migrate across database technologies while keeping the target continually in sync with the source.
Learn the basics of Apache Kafka® Producers and Consumers through building an interactive notebook in Python.
Find out how to use Apache Kafka® Connect to update an old app-to-db design to use up-to-date tech tools without disrupting the original solution.