Modern applications and their data needs are evolving at an evermore dizzying pace and part of our job is to ensure that our customers don’t get caught flat-footed. One need that has been increasing, especially over the last two years, is a purpose-built, time series datastore.
In this brief post, we’ll perform a quick flyover and discuss the reasoning behind our choices, provide links throughout for you to get more in-depth info and lastly, tell you how to get started!
Time series database: the need
As noted, time series datastores have been exponentially increasing in popularity over the past two years. Their meteoric rise is not only indicative of the use case’s development, but the need for tailored solutions that fit the data type’s characteristics — its volume for instance.
More pragmatically, we needed to address our growing monitoring and observability needs with a robust backbone that could serve us well into the future — and that's M3. As our VP Tech Ops Mika Eloranta put it,
“We selected M3 because it’s truly Open Source, properly implements clustering, and is highly adaptable to various high-throughput, real-world use cases.”
In short, we’re betting that time series data needs will continue to explode and require a truly distributable solution, as our internal needs have.
A TSDB and an aggregator: separating workloads
M3 is pretty cool; in fact, it’s better to think of it as more of a platform as it includes three components: a coordinator, database, and aggregator (learn more about M3’s ins and outs). For those less familiar, aggregation is more or less the gathering and expression of data in summary form and can be especially useful for gaining insights about particular resources.
But here’s the hitch; although M3’s coordinators can handle aggregation by virtue of their role within the architecture, they possess limitations. By offering M3 Aggregator as a separate service, you can independently scale your aggregation workloads and make them highly available.
So, can you handle aggregation with Aiven for M3? Yes. Is it ideal if you want highly available aggregation workloads that are scalable independently of your primary database cluster? No.
M3 as a service: try it for yourself
Now that you know why we’ve doubled down on time series data and built the first managed, open-source solution that is truly distributable to handle it, it’s time to try it for yourself! For those of you who are already Aiven customers, simply launch it as you would any other service.
Not an Aiven customer? Try it for free by signing up to our no obligation, 30-day trial where you can launch your first M3 cluster along with our other products in minutes. Still not convinced or just want to learn a little more? Visit our Aiven for M3 and Aiven for M3 Aggregator pages.
We couldn’t close without thanking everyone who’s been involved in its development within the broader community and here at Aiven — this is a prime example of the synergies we’ll continue to create as we promote Open Source with new services and contributions.