Scylla and Apache Spark

Scylla is the highly scalable, high performance NoSQL database that can keep up with the streaming analytics demands of Apache Spark

Scylla is the fastest, most powerful and scalable NoSQL database. Apache Spark is the fastest, most powerful and scalable data analytics framework. Many users who deploy one deploy the other because they are entirely complementary technologies.

Hooking Up Spark and Scylla

Four part blog series providing a primer on how to use Spark and Scylla together: We provide all the open source code in Github for you to try this yourself.

Part One:
Overview

Part Two:
Data Transformations

Part Three:
DataFrames

Part Four:
Structured Streaming

Mastering the Scylla Spark Migrator

The Scylla Spark Migrator is our workhorse engine written in Apache Spark, capable of taking data from multiple sources, including databases such as Apache Cassandra or DynamoDB, or big data file formats like Apache Parquet, and migrating them into Scylla or Scylla Cloud.

Moving from Cassandra to Scylla via Apache Spark: The Scylla Migrator

Migrating from DynamoDB to Scylla’s DynamoDB- compatible API

Migrate Parquet Files with the Scylla Migrator

Migrating to Scylla Cloud

Spark, File Transfer, and More: Strategies for Migrating Data to and from a Cassandra or Scylla Cluster

Deep Dive into the Scylla Spark Migrator

Case Studies

GE Predix: Industrial-
Strength IoT at Scale

Ola Cabs: Two Years of Using ScyllaDB in Production

Tubi: Scaling Up Machine Experimentation with Scylla and Scala

Natura Achieves Beautiful Results with Scylla (also Em português)

Read the blog

Augury Foresees a Bright Future with Scylla

Read the blog

From SAP to Scylla:
Tracking the Fleet at GPS Insight

Additional Resources

Apache Spark at Scylla Summit, Part 1: Best Practices

Apache Spark at Scylla Summit, Part 2: Tips for Building Resilient Pipelines

Spark Powered by Scylla: Your Questions Answered

Databricks Discusses Stateful Streaming Applications with Apache Spark

Scylla University

Get started on the path to Scylla expertise.

Live Test

Spin up a 3-node Scylla cluster to see our light-speed performance

Virtual Workshop

Interactive sessions with our NoSQL solution architects.

Product

Resources

ScyllaDB

Apache® and Apache Cassandra® are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. Amazon DynamoDB® and Dynamo Accelerator® are trademarks of Amazon.com, Inc. No endorsements by The Apache Software Foundation or Amazon.com, Inc. are implied by the use of these marks.