Optimizing infrastructure for LLMs - Episode 235

What the Dev?
31/10/2023 16 min
Optimizing infrastructure for LLMs - Episode 235

Listen "Optimizing infrastructure for LLMs - Episode 235"

Descargar episodio

Episode Synopsis

In this episode, we explore the infrastructure that is needed for LLMs, the key components to building it, and common challenges. We also talk about why LLMs hallucinate and how to reduce the frequency of that from occurring. Joining us in the discussion this week is Trey Doig, CTO and co-founder of Pathlight, which is a generative AI company.

More episodes of the podcast What the Dev?

338: The challenges of open source projects being abandoned (with Chainguard's Dan Lorenc) 13/01/2026
337: Using the power of community and mentorship to navigate the age of AI (Guidance Counselor 2.0) 06/01/2026
336: The parts of the software development life cycle that can't be automated by AI (with OutSystems' Woodson Martin) 16/12/2025
REPLAY: How cognitive fatigue impacts developer productivity (with Gradle's Hans Dockter) 02/12/2025
335: The development skills required for building software-defined vehicles (with QNX's Justin Moon) 18/11/2025
334: A developer's Hippocratic Oath in the age of AI (with Sonatype's Mitchell Johnson) 11/11/2025
333: What vibe coding means for the future of citizen development and entrepreneurship (with Block's Angie Jones) 04/11/2025
332: Knative graduates from CNCF (with Knative maintainer Dave Protasowski) 28/10/2025
331: How Spotify created its own AI tool, AiKA, to improve developer productivity (with Spotify's Pia Nilsson) 21/10/2025
330: Code quality + security shouldn't be separate concerns (with Aikido Security's Khachatur Virabyan) 14/10/2025
© 2003-2026 ZARZA | AHEAD OF OUR TIME
privacy policy
In God we trust In God we trust
PreSales Questions? Click Here
or call our toll-free line at +1-888-5002068 Miami, Florida, USA