Discover the latest trends and best practices impacting data-intensive applications. Register for access to all 60+ sessions available on demand.
At Red Canary, we've been looking into ways to more efficiently store large amounts of data coming from hundreds of thousands of simultaneously running sources. We had tried to mash lots of data together using AWS Kinesis & Firehose to minimize our S3 PUT costs but that came with not great compromises. This talk delves into our first stab at moving the less risky data into ScyllaDB and flipping our want of big files to save costs into lots of tiny data to take advantage of ScyllaDB's high IOPS capabilities.
A software engineer for the LinuxEDR team at Red Canary, a team that builds a sensor to capture live endpoint telemetry (e.g., process or networks events) in Linux systems for later threat analysis.
