WarpStream: A drop-in replacement for Kafka

19/07/2024 1h 12min

Listen "WarpStream: A drop-in replacement for Kafka"

Episode Synopsis

In this episode of The GeekNarrator podcast, host Kaivalya Apte interviews Ryan and Richie, the founders of WarpStream. They discuss the architecture, benefits, and core functionalities of WarpStream, a drop-in replacement for Apache Kafka. The conversation covers their experience with Kafka, the design decisions behind WarpStream, and the operational challenges it addresses. They also delve into the seamless migration process, the scalability, and cost benefits, the integration with the Kafka ecosystem, and potential future features. This episode is a must-watch for developers and tech enthusiasts interested in modern, distributed data streaming solutions.

Chapters:
00:00 Introduction
02:27 Introducing Warpstream: A Kafka Replacement
11:07 Deep Dive into Warpstream's Architecture
35:42 Exploring Kafka's Ordering Guarantees
36:52 Handling Buffering and Compaction
38:44 Efficient Data Reading and File Caching
44:06 WarpStream's Flexibility and Cost Efficiency
01:06:59 Future Features

Links:
WarpStream : https://www.warpstream.com/
Blog: https://www.warpstream.com/blog

X:
Ryan: https://x.com/ryanworl
Richard Artoul: https://x.com/richardartoul
Kaivalya Apte: https://x.com/thegeeknarrator

If you like this episode, please hit the like button and share it with your network.
Also please subscribe if you haven't yet.

Database internals series: https://youtu.be/yV_Zp0Mi3xs

Popular playlists:
Realtime streaming systems: https://www.youtube.com/playlist?list=PLL7QpTxsA4se-mAKKoVOs3VcaP71X_LA-

Software Engineering: https://www.youtube.com/playlist?list=PLL7QpTxsA4sf6By03bot5BhKoMgxDUU17

Distributed systems and databases: https://www.youtube.com/playlist?list=PLL7QpTxsA4sfLDUnjBJXJGFhhz94jDd_d

Modern databases: https://www.youtube.com/playlist?list=PLL7QpTxsA4scSeZAsCUXijtnfW5ARlrsN

Stay Curios! Keep Learning!

#distributedsystems #kafka #s3 #streaming