ScyllaDB and Apache Spark

ScyllaDB is the highly scalable, high performance NoSQL database that can keep up with the streaming analytics demands of Apache Spark

apache-spark-logo

ScyllaDB is the fastest, most powerful and scalable NoSQL database. Apache Spark is the fastest, most powerful and scalable data analytics framework. Many users who deploy one deploy the other because they are entirely complementary technologies.

Hooking Up Spark and ScyllaDB

Four part blog series providing a primer on how to use Spark and ScyllaDB together: We provide all the open source code in Github for you to try this yourself.

Part One:
Overview

Part Two:
Data Transformations

Part Three:
DataFrames

Part Four:
Structured Streaming

Mastering the ScyllaDB Spark Migrator

spark
+
parquet

The ScyllaDB Spark Migrator is our workhorse engine written in Apache Spark, capable of taking data from multiple sources, including databases such as Apache Cassandra or DynamoDB, or big data file formats like Apache Parquet, and migrating them into ScyllaDB or ScyllaDB Cloud.

Case Studies

predix

GE Predix: Industrial-
Strength IoT at Scale

ola-logo

Ola Cabs: Two Years of Using ScyllaDB in Production

tubi-logo

Tubi: Scaling Up Machine Experimentation with ScyllaDB and Scala

natura-logo

Natura Achieves Beautiful Results with ScyllaDB (also Em português)

Read the blog

augury-logo

Augury Foresees a Bright Future with ScyllaDB

Read the blog

gps insight logo

From SAP to ScyllaDB:
Tracking the Fleet at GPS Insight

Additional Resources

Apache Spark at ScyllaDB Summit Part 1 Best Practices
Apache Spark at ScyllaDB Summit, Part 1: Best Practices
Apache Spark at ScyllaDB Summit Part 2 Tips for Building Resilient Pipelines
Apache Spark at ScyllaDB Summit, Part 2: Tips for Building Resilient Pipelines
spark-faq
Spark Powered by ScyllaDB: Your Questions Answered
Databricks Discusses Stateful Streaming Applications with Apache Spark
Databricks Discusses Stateful Streaming Applications with Apache Spark
ScyllaDB University Mascot

ScyllaDB University

Get started on the path to ScyllaDB expertise

Level Up Your Skills
ScyllaDB Cloud Mascot

ScyllaDB Cloud

It’s easy to get started with our NoSQL DBaaS

Free Trial

Start scaling with the world's best high performance NoSQL database.

Get Started
Github

Product

Resources

Company

Social

Legal

2024 ©ScyllaDB | ScyllaDB, and ScyllaDB Cloud, are registered trademarks of ScyllaDB, Inc.

Apache® and Apache Cassandra® are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. Amazon DynamoDB® and Dynamo Accelerator® are trademarks of Amazon.com, Inc. No endorsements by The Apache Software Foundation or Amazon.com, Inc. are implied by the use of these marks.