Listen "The fastest agent in the race has the best evals"
Episode Synopsis
Ryan welcomes Benjamin Klieger, lead engineer at Groq, to explore the infrastructure behind AI agents, how you can turn a one-minute agent into a ten-second agent, and how they used fast inference and effective evals to build their efficient and reliable Compound agent. Episode notes: Groq delivers fast, low-cost inference using their custom-designed LPU, the first chip built for inference. Check out their agent, Compound, which can search the web and run code.Connect with Benjamin on LinkedIn and X. Congrats to user Bart Kiers for winning a Stellar Answer badge on their response to Regular expression to match a line that doesn't contain a word. See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
More episodes of the podcast The Stack Overflow Podcast
Live from re:Invent…it’s Stack Overflow!
16/12/2025
AI is a crystal ball into your codebase
09/12/2025
Treating your agents like microservices
05/12/2025
Abstraction, but for robots
02/12/2025
Lightning-as-a-service for agriculture
28/11/2025
You’re probably underutilizing your GPUs
25/11/2025
Only you can stop AI database drops
21/11/2025
ZARZA We are Zarza, the prestigious firm behind major projects in information technology.