Listen "DOP 333: The Hidden Problems Behind Every Data Pipeline"
Episode Synopsis
#333: Pete Hunt, CEO of Dagster and early React team member, explores the evolution from Facebook's early React development through trust and safety infrastructure at Twitter, to building modern data orchestration tools. The conversation reveals how similar infrastructure problems plague every industry - whether you're launching rockets or managing porta-potties, the core challenges remain consistent: late data, quality issues, and mysterious errors that require both automated solutions and human oversight. The discussion dives into the technical realities of scaling systems, from the microservices complexity trap to the current AI adoption wave. Hunt shares candid insights about leadership challenges, including how well-intentioned technology recommendations can backfire, and why most data projects fail despite sophisticated multi-agent orchestration. The conversation touches on career advancement pressures that drive unnecessary complexity and the importance of focusing on actual user adoption rather than technical sophistication. This episode features Pete Hunt in conversation with hosts Darin and Viktor, covering everything from regular expression nightmares to the future of data infrastructure and the lessons learned from building products that people actually use. Pete's contact information: X: https://x.com/floydophone LinkedIn: https://www.linkedin.com/in/pwhunt/ YouTube channel: https://youtube.com/devopsparadox Review the podcast on Apple Podcasts: https://www.devopsparadox.com/review-podcast/ Slack: https://www.devopsparadox.com/slack/ Connect with us at: https://www.devopsparadox.com/contact/
More episodes of the podcast DevOps Paradox
DOP 332: 2026 - The Year of Discovery
07/01/2026
DOP 327: When AI Tools Go Rogue
03/12/2025
DOP 325: KubeCon North America 2025 Review
19/11/2025
ZARZA We are Zarza, the prestigious firm behind major projects in information technology.