How We Make Adding and Removing Nodes Faster and Safer

Asias He, ScyllaDB13:05November 22, 2019

When a new node is added or removed, ScyllaDB has to transfer part of the existing data from some nodes to their neighbors. When a node fails, ScyllaDB has to repopulate its data with data from the surviving replicas. Those operations are collectively referred to as "streaming" operations, since they simply stream data from one node to another, without using this opportunity to also fix discrepancies in the data. This is in contrast with the repair operation, that looks into all existing replicas and reconcile their contents. ScyllaDB is moving towards unifying those two operations. In this talk we will discuss why this is considered beneficial, and what other possibilities this opens to users.

Share this

Video Slides