Learn Apache Kafka with Python

What's in the Workshop Recipe?

Apache Kafka is the industry de-facto standard for data streaming. An open-source, scalable, highly available and reliable solution to move data across companies' departments, technologies or micro-services.

In this workshop you'll learn the basic components of Apache Kafka and how to get started with data streaming using Python. We'll dive deep, with the help of some prebuilt Jupyter notebooks, into how to produce and consume data, including how to have concurrent applications reading from the same source, empowering multiple use-cases with the same streaming data.

Finally we'll demonstrate how to use Apache Flink to reshape streaming data in Kafka in real time, enabling new data stakeholders and, for instance, allowing transformations to satisfy regulatory needs.

Prepare for a Brain Upgrade

You will learn:

• Apache Kafka main components
• How to Produce data to Apache Kafka
• How to Consume data from Apache Kafka
• How to setup concurrent consumers
• How multiple applications can read from the same dataset
• How to reshape the streaming data in real time

Prerequisities

• Web browser
• GitHub Account. Here's the Github repo we will use.