Scylla Open Source 3.0 is a landmark release for ScyllaDB: Materialized Views and Secondary Indexes are production-ready, and Scylla Open Source 3.0 can now read and write the Cassandra 3.x SSTable (“mc”) format. In addition, Scylla Open Source 3.0 provides a variety of performance improvements to existing functionality. In this article we will explore the nature of a pair of those performance improvements, and the scenarios in which Scylla users can expect to see a significant performance gain. Streaming When one Scylla node needs to transfer data to another, it undertakes a process called streaming. This happens when a new […]
In this blog post, we will take a closer look at how Scylla streaming works in detail and how Scylla 2.4’s new streaming improves streaming bandwidth by 240% and reduces the time it takes to perform a “rebuild” operation by 70%.
Let’s talk about a financial use case where streaming and near-real-time messaging is used through Kafka and Scylla. We will model a system that allows subscribers to follow stock prices for companies of their interest, similar to a simplified use of a trading terminal. Our system follows an architectural pattern in which updates of stock prices are pushed to a Kafka queue, and subscribers consume messages that contain company stock information. These consumed messages are then stored in Scylla instances, where they can be used later for more sophisticated analysis (for example, using an engine like Spark).