Where Database Monsters Connect!

‹ Back to all sessions Learn more at ScyllaDB University ›

Elasticity vs. State? Exploring Kafka Streams Cassandra State Store

23 minutes
Discover the latest trends and best practices impacting data-intensive applications. Register for access to all 30+ sessions available on demand.
Enter your email to watch this session from the ScyllaDB Summit 2024 livestream. You’ll also get access to all available recordings
https://docs.google.com/presentation/d/e/2PACX-1vT3ror_UhCI1aizZtspIdZ8Jm5DPXC5Iv5KPSDN4_j2nBhfU1CZepNGIq9YXjmcOsgJxybUMRa2tqrb/embed?start=false&loop=false&delayms=3000

In This NoSQL Presentation

kafka-streams-cassandra-state-store' is a drop-in Kafka Streams State Store implementation that persists data to Apache Cassandra. By moving the state to an external datastore the stateful streams app (from a deployment point of view) effectively becomes stateless. This greatly improves elasticity and allows for fluent CI/CD (rolling upgrades, security patching, pod eviction, ...). It also can also help to reduce failure recovery and rebalancing downtimes, with demos showing sporty 100ms rebalancing downtimes for your stateful Kafka Streams application, no matter the size of the application’s state. As a bonus accessing Cassandra State Stores via 'Interactive Queries' (e.g. exposing via REST API) is simple and efficient since there's no need for an RPC layer proxying and fanning out requests to all instances of your streams application.

Hartmut Armbruster, Software Architect, Developer, Thriving.dev

Hartmut Armbruster is a senior software engineer with many years of experience designing and building solutions for high-load projects using distributed technologies. Over the past 6 years he has been working in real-time data processing at HSBC, NEX Group plc, Deutschebahn on mission critical platforms. Striving to see the bigger picture, passionate about architecture, combining, integrating, and bringing all things together.

ScyllaDB Summit 2024

What’s next for data-intensive applications

‹ Back to all sessions Learn more at ScyllaDB University ›

Elasticity vs. State? Exploring Kafka Streams Cassandra State Store

23 minutes
Discover the latest trends and best practices impacting data-intensive applications. Register for access to all 30+ sessions available on demand.
Enter your email to watch this session from the ScyllaDB Summit 2024 livestream. You’ll also get access to all available recordings
<iframe style="border: 1px solid #CCC; border-width: 1px; margin-bottom: 5px; max-width: 100%;" width="595" height="485" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" allowfullscreen="allowfullscreen" class="optanon-category-C0003 " src="https://docs.google.com/presentation/d/e/2PACX-1vT3ror_UhCI1aizZtspIdZ8Jm5DPXC5Iv5KPSDN4_j2nBhfU1CZepNGIq9YXjmcOsgJxybUMRa2tqrb/embed?start=false&loop=false&delayms=3000″ data-lf-form-tracking-inspected-laxoeakwmyoaoygd=”true” data-lf-yt-playback-inspected-laxoeakwmyoaoygd=”true” data-lf-vimeo-playback-inspected-laxoeakwmyoaoygd=”true” data-gtm-yt-inspected-12=”true”>
<iframe style="border: 1px solid #CCC; border-width: 1px; margin-bottom: 5px; max-width: 100%;" width="595" height="485" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" allowfullscreen="allowfullscreen" class="optanon-category-C0003 " src="https://docs.google.com/presentation/d/e/2PACX-1vT3ror_UhCI1aizZtspIdZ8Jm5DPXC5Iv5KPSDN4_j2nBhfU1CZepNGIq9YXjmcOsgJxybUMRa2tqrb/embed?start=false&loop=false&delayms=3000" data-lf-form-tracking-inspected-laxoeakwmyoaoygd="true" data-lf-yt-playback-inspected-laxoeakwmyoaoygd="true" data-lf-vimeo-playback-inspected-laxoeakwmyoaoygd="true" data-gtm-yt-inspected-12="true">

In This NoSQL Presentation

kafka-streams-cassandra-state-store' is a drop-in Kafka Streams State Store implementation that persists data to Apache Cassandra. By moving the state to an external datastore the stateful streams app (from a deployment point of view) effectively becomes stateless. This greatly improves elasticity and allows for fluent CI/CD (rolling upgrades, security patching, pod eviction, ...). It also can also help to reduce failure recovery and rebalancing downtimes, with demos showing sporty 100ms rebalancing downtimes for your stateful Kafka Streams application, no matter the size of the application’s state. As a bonus accessing Cassandra State Stores via 'Interactive Queries' (e.g. exposing via REST API) is simple and efficient since there's no need for an RPC layer proxying and fanning out requests to all instances of your streams application.

Hartmut Armbruster, Software Architect, Developer, Thriving.dev

Hartmut Armbruster is a senior software engineer with many years of experience designing and building solutions for high-load projects using distributed technologies. Over the past 6 years he has been working in real-time data processing at HSBC, NEX Group plc, Deutschebahn on mission critical platforms. Striving to see the bigger picture, passionate about architecture, combining, integrating, and bringing all things together.

Start scaling with the world's best high performance NoSQL database.

Get Started
Github

Product

Resources

Company

Social

Legal

2024 ©ScyllaDB | ScyllaDB, and ScyllaDB Cloud, are registered trademarks of ScyllaDB, Inc.

Apache® and Apache Cassandra® are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. Amazon DynamoDB® and Dynamo Accelerator® are trademarks of Amazon.com, Inc. No endorsements by The Apache Software Foundation or Amazon.com, Inc. are implied by the use of these marks.