Dec21

Scylla Summit 2018 Keynote: Four Years of Scylla

Share on facebook
Share on twitter
Share on print
Share on email
Share on linkedin

Subscribe to Our Blog

Dor Laor at Scylla Summit 2018
Now that the dust has settled from our Scylla Summit 2018 user conference, we’re glad for the chance to share the content with those who couldn’t make the trip to the Bay Area. We’ll start with the keynote from our CEO and Co-founder, Dor Laor, who kicked off the event with his talk about the past, present and future of Scylla.

Watch the video in full:

Browse the slides:

Dor began with an overview of the trends in the industry and first and foremost, digital transformation. Sticking to the down-to-earth, practical culture at ScyllaDB, Dor covered real life customer examples from all around us. Starting with space, with satellite-enabled services like GPS Insight and TellusLabs, to the rain forest plant-based beauty products of Brazil’s Natura, to the GE Predix-powered Industrial Internet of Things (IIoT) platform, Comcast X1’s on-demand services, as well as automotive applications from Faraday Future and Nauto.

In the beginning…

Scylla and Charybdis

Dor shared our company’s origins. He recalled first announcing the Seastar framework in February 2015, and leaving stealth mode in September of that year. ScyllaDB CTO Avi Kivity. presented at that year’s Cassandra Summit on how a new database, Scylla, could deliver 1,000,000 CQL operations per server.

Scylla 1.0 Release Graphic

Over the ensuing three years we made a great deal of progress. We released Scylla 1.0 at the end of March 2016. That year also saw the first Scylla Summit in September. The following year, in March 2017, Scylla unveiled its first Enterprise software release.

Scylla Enterprise Release Graphic

While Scylla was blazing its own path in the world of NoSQL, Dor also remarked on the successes of others in the industry, including MongoDB’s public offering in October 2017, and the September 2018 IPO of Elastic. These events serve as validation of the growing Big Data market as the hunger for data increases, fed by the growing appetite of modern, planet scale software. Not only most enterprises now trust in the operational capabilities of NoSQL distributed databases, the new world requirements cannot be met by traditional relational models.

State of the Art

Moving to the present, Dor announced Scylla Open Source 3.0. With this release, Scylla was finally achieving feature parity with Cassandra, and, in some cases, it was taking the lead. For storage, SSTable format 3.0 (mc) would reduce data footprint on disk. Production-ready Materialized Views (MV) and Global Secondary Indexes (GSI) will help users access only the data they need. Lightweight Transactions (LWT) remains the last major feature to achieve full feature parity with Cassandra.

Dor also announced that our cloud managed database, Scylla Cloud, was available as early access. running on Amazon Web Services (AWS), Scylla Cloud lets users launch a fully managed single-tenant, self-service Scylla cluster in minutes.

Scylla Cloud Graphic

As much as we talk about Cassandra, we are shifting gears and wish to be competitive with the best of breed NoSQL databases, led by DynamoDB as an example.

Scylla vs. Dynamo Graphic

Dor shared results from a head-to-head YCSB comparison of Scylla versus Amazon DynamoDB. We just recently published the comparative benchmark results. Our test results show you can achieve 1/4th the latency and spend only 1/7th the cost with Scylla for similar throughput on DynamoDB. (Scylla Cloud is 4-6X less expensive than DynamoDB.)

However, the real performance difference occurred in Zipfian distributions. You can read the blog in full as to why this is an important real-world consideration. Analogous test results were found for Bigtable, and CosmosDB was expected to perform similarly.

OLTP vs. OLAP Graphic

Another key feature introduced for the first time at Scylla Summit 2018 was our unique ability to support per-user SLAs, allowing system managers to limit database resource utilization. With this, Scylla customers can use the same Scylla cluster to service both transaction processing (mixed read-write, or write-heavy loads) as well as analytics (read-only/mostly) requests. Glauber Costa would host a full session on this, entitled OLAP or OLTP: Why not both?

Per-user-SLA utilizes 3 years of development of SLA guarantee for real time operations over distributed database background operations such as compaction, repair and streaming. This is a point in time evolution towards perfect multi tenant database.

Dor then enumerated a list of noteworthy accomplishments and the challenges we still have before us. For example, while he was proud of our Mutant Monitoring System (MMS), there is still work to be done on our Knowledgebase, as well as our upcoming launch of Scylla University. And while performance is good, and compactions are relatively smooth compared to other offerings, there are still more optimizations to be done. And while he was proud of the work we’ve done to integrate with Apache Spark, there’s a lot more to do to align Scylla with Kubernetes.

The Shape of Things to Come

 

To conclude, Dor gave a glimpse into the future of Scylla. Finishing up Cassandra parity features, especially Lightweight Transactions. Fleshing out Scylla Cloud. Making Scylla itself a stronger offering, with new tiered storage options, improvements in performance and additional drivers. And finally, making Scylla even easier to manage.

It has been a remarkable journey over the past four years. From all of us at ScyllaDB, thank you for following us on our journey, and for a wonderful 2018. 

Looking ahead, 2019 is sure to be another amazing year of pioneering achievements in the world of Big Data, both for Scylla as well as our users and customers. We’re looking forward to all that we will accomplish together!


Tags: Dor Laor, scylla, Scylla Summit