blue-star-01-1

Extreme scale engineering

Discover the latest trends and best practices impacting data-intensive applications. Register for access to all 60+ sessions available on demand.

Yours, Mine, and Ours: Efficient Set Reconciliation in O(n log n) of the SET DIFFERENCE

Pat HellandDaniel May30 minutes
Share this
Share this

Register for access to all 60+ sessions available on demand.

Fill out the form to watch this session from the Monster Scale Summit livestream. You’ll also get access to all available recordings.

In this Monster Scale Summit Presentation

This session presents a new algorithm for efficient set reconciliation that operates in O(n log n) time relative to the set difference, not the total set size. By combining erasure codes and fountain codes, the algorithm enables replica repair over future content, where distributed systems can reconcile sets before all items exist. We'll explore applications including replica repair, improved gossip protocols, genome comparison, and distributed systems, concluding with audience discussion of additional use cases.

Pat Helland, Software Architect, Salesforce

Pat Helland is a Software Architect at Salesforce.

Daniel May, Solutions Architect, Salesforce

Daniel May is a Principal Engineer at Salesforce.