JobCloud builds event-driven architecture with Aiven

After a long time juggling legacy systems, JobCloud now runs Switzerland's largest job board on Apache Kafka.

Overview

JobCloud has the biggest job boards in Switzerland. Since they decided to implement an event-driven architecture, Aiven for Apache Kafka® has been helping them leverage their old infrastructure and add elements with no downtime and sustained performance.

Highlights

  • JobCloud implemented an event-driven architecture on top of their existing data infra with Aiven for Apache Kafka® and can add new elements to their big job board infra without downtime.
  • Aiven can provide all features needed like ACLs on topics and locking integration.
  • Aiven for Kafka just quietly works as it should without making an issue of itself.
JobCloud-Nicolas-Chiu.png

"I really feel like you guys want to help us out."

Nicolas Chiu

Lead Software Developer at JobCloud

The challenge

Founded in 2013, JobCloud provides traditional job-posting and job-searching services as well as multilingual semantic recruitment technologies, candidate management, employer branding tools, analytics and programmatic job ads.

For historical reasons, JobCloud had ended up running a number of legacy systems. “We have a lot of legacy systems in place, using outdated languages and implemented with a really strange database setup, and nobody dared to touch them,” says Nicolas Chiu, Lead Software Developer at JobCloud. The systems were just there, mostly working, but this was hardly ideal from a maintenance viewpoint.

JobCloud’s goal was to modernise their systems into an event-driven architecture to better support modern data requirements. At the same time, they really didn’t want to directly access the strange APIs. The easiest answer, it seemed, would be to insert a messaging layer between the other systems that would separate the complexity of the legacy systems from other services, whether existing or new.

After months of evaluating messaging and streaming solutions, JobCloud decided to go with Apache Kafka, arguably the quintessential solution for streaming event data. “It has a huge ecosystem and contributor base. It also has a lot of connectors, which makes it easy to integrate other systems,” Nick says.

But Apache Kafka is not the easiest system to run.

“When we started out, we noticed that Apache Kafka has a huge learning curve. There's just so many things that you can configure. And at the very beginning, we were really overwhelmed.”

Finding a provider wasn’t easy, either. The first one they tried couldn’t offer all the features they needed, like ACLs on topics and locking integration, in spite of the prohibitive price tag. The JobCloud systems also proved to be too much for the provider’s technical capabilities.

“We were desperate to find anything better, and back then it was really hard to find good providers,” Nick reminisces. “So when we found Aiven, we were immediately like 'hel-lo, what kind of plans do you have to offer?!'”

The solution

“We’ve never had any problems with Aiven,” says Nick. “No interruptions, nothing, not even when there are lots of maintenance updates and Kafka versions to apply at once. The only thing we see in the monitoring is the broker names and whatever change. Nothing bad ever happens.”

Thinking about it, Nick can remember one instance when JobCloud had to open a real support case with Aiven. “But it was solved so quickly, and it went away so completely, that I can’t even remember what it was about,” he chuckles.

Aiven is always looking for ways to serve customers better, like all companies, but Nick is particularly impressed by the way Aiven goes about it. He feels that the customer’s feedback and input is actively sought and then acted on where it comes to things like feature roadmaps.

Over the past three years, JobCloud’s event-driven structure has grown and is still growing heavily, and everything still works like a dream. The company has been able to live with its legacy architecture while still expanding and helping ever-increasing numbers of employers and job seekers.


“We’re really, really happy with the approach that we took, and that we chose Aiven as the provider,” Nick says. “I see a bright future for us here.”

JobCloud-Nicolas-Chiu.png

We’ve never had any problems with Aiven. No interruptions, nothing.

Nicolas Chiu

Lead Software Developer at JobCloud

The outcome

Right now, day by day, JobCloud sysadmins hardly even remember that Aiven for Kafka is there. It’s just working as it should, and nothing’s really going on.

“We’ve never had any problems with Aiven,” says Nick. “No interruptions, nothing, not even when there are lots of maintenance updates and Kafka versions to apply at once. The only thing we see in the monitoring is the broker names and whatever change. Nothing bad ever happens.”

Thinking about it, Nick can remember one instance when JobCloud had to open a real support case with Aiven. “But it was solved so quickly, and it went away so completely, that I can’t even remember what it was about,” he chuckles.

Aiven is always looking for ways to serve customers better, like all companies, but Nick is particularly impressed by the way Aiven goes about it. He feels that the customer’s feedback and input is actively sought and then acted on where it comes to things like feature roadmaps.

Over the past three years, JobCloud’s event-driven structure has grown and is still growing heavily, and everything still works like a dream. The company has been able to live with its legacy architecture while still expanding and helping ever-increasing numbers of employers and job seekers.

“We’re really, really happy with the approach that we took, and that we chose Aiven as the provider,” Nick says. “I see a bright future for us here.”

Related case studies

Explore more customer success stories relevant to this one or browse all Aiven case studies

Comcast

Consumer Services

Comcast's home security system runs massive amounts of IoT data through an Apache Kafka centric infrastructure.

Wolt

Consumer Services

Wolt achieves major savings by using Aiven's managed data infrastructure. Find out how they are utilizing open source tools in the delivery technology space.

OVO Energy

Energy and Utilities

OVO is a UK-based energy company. It uses an Apache Kafka-based data infrastructure to meet its sustainability goals.

Where to go next

Check out these related resrouces in our library!

Event Driven Architecture illustration

Event Driven Architecture

If you’re looking for a modern, responsive, and flexible architecture for rapid data flows, you’ll want to start looking at event-driven architecture.

Create, manage and evolve message schemas with Karapace illustration

Aiven Docs

Create, manage and evolve message schemas with Karapace

Karapace enables you to produce and consume messages, and manage your Kafka cluster via REST APIs.

Aiven welcomes Kafkawize, now Klaw illustration

Blog

Aiven welcomes Kafkawize, now Klaw

Aiven enters the next phase of its open source commitment with Apache Kafka® data governance. Read what Oskari Saarenmaa has to say about Kafkawize.

Get started today

Want to know how Aiven can make your life easier? Get in touch, and we'll talk!

Book a demo