How Discord Migrated Trillions of Messages from Cassandra to ScyllaDB

Bo Ingram29 minutesFebruary 15, 2023

Learn why and how Discord’s persistence team recently completed their most ambitious migration yet: moving their massive set of trillions of messages from Cassandra to ScyllaDB. Bo Ingram, Senior Software Engineer at Discord, provides a technical look, including:

  • Their reasons for moving from Apache Cassandra to ScyllaDB
  • Their strategy for migrating trillions of messages
  • How they designed a new storage topology – using a hybrid-RAID1 architecture – for extremely low latency on GCP
  • The role of their existing Rust messages service, new Rust data service library, and new Rust data migrator in this project
  • What they’ve achieved so far, lessons learned, and what they’re tackling next
Share this

Video Slides

Video Transcript

Learn why and how Discord’s persistence team recently completed their most ambitious migration yet: moving their massive set of trillions of messages from Cassandra to ScyllaDB.