Easily migrate your Cassandra data into Aiven with sstableloader

You can now simply and quickly migrate your external Apache Cassandra data into Aiven using sstableloader; learn about the specifics in this post.

31 July 2019
John Hammink
John Hammink RSS Feed
Developer Advocate at Aiven

Aiven now supports sstableloader, an open source utility which allows you to easily migrate all of the data from your external Apache Cassandra instances into a managed Aiven for Cassandra cluster. Sstableloader allows this seamless migration by bulk-loading data from remote SSTables into an Aiven for Cassandra cluster via the target nodes’ internode ports.

How sstableloader works

An SStable is a persistent, immutable file format where your Cassandra data is stored. It is created when fast memory stores called memtables are flushed to disk. Sstableloader works by first connecting to the new Cassandra cluster to determine which nodes of the target cluster should receive which rows, then uploading the SSTable data to the target nodes.

migrating cassandra into aiven using sstableloader

This data upload - called streaming - is implemented as a command line client using the same Java code the Cassandra service uses internally to replicate data between cluster nodes, connecting to the Cassandra internode port to achieve a more efficient way to transfer large amounts of data.

Clients cannot normally connect to this internode port, and Aiven requires sstableloader to connect with SSL through client certificates to secure access. As a result, large clusters for which inserting the source cluster's data row by row with CQL would take unfeasibly long can now be migrated.

Wrapping up

With sstableloader, you now have the industry standard for bulk data loading into Cassandra which makes migrating your full data pipeline to Aiven that much simpler.

You can find the complete procedure here.

We’re always adding more features to the Aiven platform, so stay up to date with our blog and changelog RSS feeds, or follow us on Twitter and LinkedIn.

announcementsfeaturescassandra
orange decoration
yellow decoration

Start your free 30 day trial!

Build your platform, and throw in any data you want for 30 days, with no ifs, ands, or buts.

orange decoration
yellow decoration

Start your free 30 day trial!

Build your platform, and throw in any data you want for 30 days, with no ifs, ands, or buts.

Products

Aiven for Apache Kafka®Aiven for Apache Kafka Connect®Aiven for Apache Kafka MirrorMaker 2®Aiven for Apache Flink® BetaAiven for M3Aiven for M3 AggregatorAiven for Apache Cassandra®Aiven for OpenSearchAiven for PostgreSQLAiven for MySQLAiven for RedisAiven for InfluxDBAiven for Grafana

Let‘s connect

Apache Kafka, Apache Kafka Connect, Apache Kafka MirrorMaker 2, Apache Flink and Apache Cassandra are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. ClickHouse, M3, M3 Aggregator, OpenSearch, PostgreSQL, MySQL, Redis, InfluxDB, Grafana are trademarks and property of their respective owners. All product and service names used in this website are for identification purposes only and do not imply endorsement.