The March 2024 India Open Source Data Infrastructure Meetup - Architecture & Observability

Aiven Community
1

1600Ă—1200 489 KB

We (@adityaoberai, @Floor, and I) organized the second edition of the India Open Source Data Infrastructure meetup on March 2nd, with over 100+ people attending :tada: The meetup began with a brief introduction about the India Open Source Data Infrastructure meetup. People showed considerable interest in the meetup, with most of them working as engineers in data teams. They gathered to learn more and network with individuals facing similar challenges.

Aditya and Nancy kicked off the meetup with a welcoming introduction. This was followed by a talk by Ekansh Gupta, who discussed “Choosing Argo Workflows Over Airflow in a Distributed Environment.” This speaker highlighted differences in the architecture and execution models between Airflow and Argo workflows while demonstrating how to orchestrate pipeline jobs with Argo Workflows. The speaker also discussed how Argo Workflows and Kubernetes provide distinct scaling advantages for any data pipeline users.

1600Ă—1200 207 KB

Later, we had a panel discussion. The panelists, Amitosh Swain Mahapatra, Jones Zachariah Noel, Hrittik Roy, and Shivay Lamba, discussed a number of topics in the areas of open source, cloud-native, and data technologies. The topics discussed included monitoring and deployment practices for LLMs in MLOps, how full-text search works and achieving the same in PostgreSQL, collection of observability data and logs from low-compute edge devices, serverless solutions for Next.js apps, search tools for large-scale data applications (alternatives to Elastic and OpenSearch), and Golang-based open-source projects in the cloud-native ecosystem.

1600Ă—1200 314 KB

Following this, we had a networking session where many folks expressed their interest in the upcoming meetup and showed interest in speaking as well. In the end, we would like to thank Zeta for making this meetup possible at their office. All event photos are available here.

The next meetup will occur May 4 (yes, that’s Star Wars Day!) at the Microsoft Reactor in Bengaluru. Timed right after Kafka Summit, it will have a Kafka theme: India Open Source Data Infrastructure Meetup - May 2024, Sat, May 4, 2024, 11:00 AM | Meetup

This was written collaboratively with @adityaoberai :purple_heart:

2 Likes
2

Thank you @Nancy_Chauhan and @adityaoberai! So nice to read this! The panel discussion is such a great idea.

3 Likes
3

It was lovely helping organize and hosting the event with Nancy! :grin:

2 Likes
4

AMAZING! :star_struck:

Thank you both SO much, not only for your skill and flexibility at dealing with unforeseen circumstances, but your ability to turn it around to make something EVEN BETTER than was previously imagined. <3 While we haven’t met in person (yet!) you both clearly embody the wonderful spirit of Community, and we’re so fortunate to have you as part of ours. :slight_smile: I literally can’t WAIT to hear more from the next “May the 4th Be With You™” meetup. :smiley:

1 Like
5

I am looking forward to meeting you! Hopefully DevRelCon New York 2024 :crossed_fingers:

1 Like