Stream processing, LSMs and leaky abstractions with Chris Riccomini

22/08/2024 53 min Episodio 1
Stream processing, LSMs and leaky abstractions with Chris Riccomini

Listen "Stream processing, LSMs and leaky abstractions with Chris Riccomini"

Episode Synopsis


In this episode, we  chat with Chris Riccomini about the evolution of stream processing and the challenges in building applications on streaming systems. We also chat about leaky abstractions, good and bad API designs, what Chris loves and hates about Rust and finally about his exciting new project that involves object storage and LSMs. Connect with Chris at:LinkedInXBlogMaterialized View Newsletter - His newsletterThe missing README - His bookSlateDB - His latest OSS ProjectChapters00:00 Introduction and Background04:05 The State of Stream Processing Today08:53 The Limitations of SQL in Streaming Systems14:00 Prioritizing the Developer Experience in Stream Processing18:15  Improving the Usability of Streaming Systems27:54 The Potential of State Machine Programming in Complex Systems32:41 The Power of Rust: Compiling and Language Bindings34:06 The Shift from Sidecar to Embedded Libraries Driven by Rust35:49 Building an LSM on Object Storage: Cost-Effective State Management39:47 The Unbundling and Composable Nature of Databases47:30 The Future of Data Systems: More Companies and Focus on MetadataClick here to view the episode transcript.

More episodes of the podcast Tech on the Rocks