Listen "713: Llama 2, Toolformer and BLOOM: Open-Source LLMs with Meta's Dr. Thomas Scialom"
Episode Synopsis
Artificial General Intelligence, RLHF’s application in AI, and how entrepreneurs can enter the AI industry: Meta’s AI Research Scientist Thomas Scialom gives us behind-the-scenes insights into developing Llama 2 and what’s in the works for Llama 3. With host Jon Krohn, he discusses the future of Artificial General Intelligence, why the Galactica science-focused LLM was taken down, and what he learned from it.This episode is brought to you by AWS Inferentia, by Grafbase, the unified data layer, and by Modelbit, for deploying models in seconds. Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.In this episode you will learn:• Llama 2: Behind the Scenes of Today’s Top Open-Source LLM [05:04]• Responsible use of Llama 2 [15:26]• Toolformer: LLM That Learns How to Use External Tools [24:57]• Galactica: The Science-Specific LLM and Why It Was Brought Down [36:57]• Is AGI Around the Corner? [57:03]• Advice for AI entrepreneurs [1:05:46]• How Thomas develops and manages large-scale AI projects [1:14:42]Additional materials: www.superdatascience.com/713
More episodes of the podcast Super Data Science: ML & AI Podcast with Jon Krohn
953: Beyond “Agent Washing”: AI Systems That Actually Deliver ROI, with Dell’s Global CTO John Roese
30/12/2025
952: How to Avoid Burnout and Get Promoted, with “The Fit Data Scientist” Penelope Lafeuille
26/12/2025
948: In Case You Missed It in November 2025
12/12/2025
946: How Robotaxis Are Transforming Cities
05/12/2025
945: AI is a Joke, with Joel Beasley
02/12/2025
ZARZA We are Zarza, the prestigious firm behind major projects in information technology.