692: Lossless LLM Weight Compression: Run Huge Models on a Single GPU

Super Data Science: ML & AI Podcast with Jon Krohn
30/06/2023 7 min
692: Lossless LLM Weight Compression: Run Huge Models on a Single GPU

Listen "692: Lossless LLM Weight Compression: Run Huge Models on a Single GPU"

Descargar episodio

Episode Synopsis

Join Jon as he navigates listeners through the innovative SpQR approach—a cutting-edge, lossless LLM weight compression technique that harnesses the power of quantization. Tune in as Jon delves into the four steps behind this groundbreaking method in this week's episode.Additional materials: www.superdatascience.com/692Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.

More episodes of the podcast Super Data Science: ML & AI Podcast with Jon Krohn

953: Beyond “Agent Washing”: AI Systems That Actually Deliver ROI, with Dell’s Global CTO John Roese 30/12/2025
952: How to Avoid Burnout and Get Promoted, with “The Fit Data Scientist” Penelope Lafeuille 26/12/2025
951: Context Engineering, Multiplayer AI and Effective Search, with Dropbox’s Josh Clemm 23/12/2025
950: Happy Holidays from All of Us at the SuperDataScience Podcast 19/12/2025
949: Why AI Keeps Failing Society, with Stanford professor Alex “Sandy” Pentland 16/12/2025
948: In Case You Missed It in November 2025 12/12/2025
947: How to Get Hired at Top Firms like Netflix and Spotify, with Jeff Li 09/12/2025
946: How Robotaxis Are Transforming Cities 05/12/2025
945: AI is a Joke, with Joel Beasley 02/12/2025
944: Gemini 3 Pro: Google’s Back on Top 28/11/2025
© 2003-2025 ZARZA | AHEAD OF OUR TIME
privacy policy
In God we trust In God we trust
PreSales Questions? Click Here
or call our toll-free line at +1-888-5002068 Miami, Florida, USA