What is infrastructure? You may think of public transport and utilities, or perhaps networking and databases. All of those are infrastructure, and they actually have quite a bit in common. If words like “expensive”, “inconvenient” and “too slow” now come to mind, these are sad truths about buses, but your analytics pipelines could be running to a better schedule! Data is arriving faster and in greater quantities than ever before, from everywhere, all the time—we simply cannot afford to wait.
In this session, we will use live data feeds from Helsinki’s transport network to show how a complete open source data pipeline—from collection to insights—can be created in a matter of minutes using infrastructure-as-code and visualization tools you’re already familiar with. If you’re a software developer, platform engineer, data engineer, or analyst, we hope you’ll take away some tips and tricks to relieve the toil and frustration of your data infrastructure. (But sorry, we can’t fix the buses and trains…)