ZARZA We are Zarza, the prestigious firm behind major projects in information technology.
Listen "Can AI Bring Both Speed and Accuracy: Josh Broyde of AI21 Labs"
Episode Synopsis
This week, we are joined by Joshua Broyde, PhD and Principal Solutions Architect at AI21 Labs. Broyde discusses AI21 Labs' work in developing foundation models and AI systems for enterprise use, with a focus on their latest model, Jamba-Instruct.
Josh explains the concept of foundation models and how they differ from traditional AI models. He highlights AI21 Labs' work with financial institutions on use cases like term sheet generation and financial document Q&A. The conversation explores the challenges and benefits of training models on company-specific data versus using retrieval augmented generation (RAG) techniques.
The interview delves into the development of Jamba Instruct, a hybrid model combining Mamba and Transformer architectures to achieve both speed and accuracy. Broyde discusses the model's performance, industry reaction, and potential applications.
Safety and security considerations for AI models are addressed, with Broyde explaining AI21 Labs' approach to implementing guardrails and secure deployment options for regulated industries. The discussion also covers the balance between model quality and cost, and the trend towards matching specific models to appropriate tasks.
Josh also shares his thoughts on future developments in the field, including the potential for agent-based approaches and increased focus on cost optimization in AI workflows.
Listen on mobile platforms: Apple Podcasts | Spotify | YouTube
Contact Us:
Twitter: @gebauerm, or @glambert
Email: [email protected]
Music: Jerry David DeCicca
Transcript on 3 Geeks
Josh explains the concept of foundation models and how they differ from traditional AI models. He highlights AI21 Labs' work with financial institutions on use cases like term sheet generation and financial document Q&A. The conversation explores the challenges and benefits of training models on company-specific data versus using retrieval augmented generation (RAG) techniques.
The interview delves into the development of Jamba Instruct, a hybrid model combining Mamba and Transformer architectures to achieve both speed and accuracy. Broyde discusses the model's performance, industry reaction, and potential applications.
Safety and security considerations for AI models are addressed, with Broyde explaining AI21 Labs' approach to implementing guardrails and secure deployment options for regulated industries. The discussion also covers the balance between model quality and cost, and the trend towards matching specific models to appropriate tasks.
Josh also shares his thoughts on future developments in the field, including the potential for agent-based approaches and increased focus on cost optimization in AI workflows.
Listen on mobile platforms: Apple Podcasts | Spotify | YouTube
Contact Us:
Twitter: @gebauerm, or @glambert
Email: [email protected]
Music: Jerry David DeCicca
Transcript on 3 Geeks
More episodes of the podcast The Geek In Review
From Bad Data to Better Deals: John Tertan on Narrative, Pricing, and Law Firm Relationships
08/12/2025
Furlong, Matthews, and Sutherland: Truth Tellers, Rented Land, and 20 Years of the Clawbies
01/12/2025
Trust at Scale: Nam Nguyen on How TruthSystems is Building the Framework for Safe AI in Law
29/10/2025
In God we trust