India Open Source Data Infrastructure Meetup - October 2023

  • Are you interested in learning more about open-source data technologies? :white_check_mark:
  • Do you want to network with local and international tech professionals in a fun, relaxed environment? :white_check_mark:

Then join us on October 22, at the CRED offices, for an evening full of inspiring conversations and exciting talks.

Agenda:

  • 11:00 - 11:30 Welcome: Networking & refreshments
  • 12:30 - 11:40 Kickoff: Welcome from Aiven and Cred
  • 11:40 - 12:00 Delta lake tables - behind the scenes - Apoorva Aggarwal
  • Speaker: Apoorva works at Microsoft as a Software Engineer 2. She’s been active in the data infrastructure domain for close to 5 years now.
  • Abstract: In this talk, we will explore the storage format of delta lake tables, its transaction log management, and the optimizations it uses to process and retrieve big data faster
  • 12:00 - 12:20 Data Quality Platform at Cred - Chintan Shah & Manas Bhardwaj
  • Abstract: Chintan and Manas share Cred’s journey of building a trustworthy big data quality platform in AWS. In this talk, they will cover the requirements of the platform, the challenges encountered, the technologies chosen, and the tradeoffs that were made to build a high quality large-scale diverse data lake.
  • 12:20 - 12:40 TBA - Rohil Surana
  • Speaker: Rohil Surana is an Engineering Manager Cloud@Pixxel.
  • 12:40 ~ 14:00 Food & networking