626: Subword Tokenization with Byte-Pair Encoding

Super Data Science: ML & AI Podcast with Jon Krohn
11/11/2022 6 min
626: Subword Tokenization with Byte-Pair Encoding

Listen "626: Subword Tokenization with Byte-Pair Encoding"

Descargar episodio

Episode Synopsis

Word tokenization, character tokenization and subword tokenization go head-to-head this week as Jon Krohn delivers a mini-bootcamp on the NLP-related process.
Additional materials: www.superdatascience.com/626
Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.

More episodes of the podcast Super Data Science: ML & AI Podcast with Jon Krohn

953: Beyond “Agent Washing”: AI Systems That Actually Deliver ROI, with Dell’s Global CTO John Roese 30/12/2025
952: How to Avoid Burnout and Get Promoted, with “The Fit Data Scientist” Penelope Lafeuille 26/12/2025
951: Context Engineering, Multiplayer AI and Effective Search, with Dropbox’s Josh Clemm 23/12/2025
950: Happy Holidays from All of Us at the SuperDataScience Podcast 19/12/2025
949: Why AI Keeps Failing Society, with Stanford professor Alex “Sandy” Pentland 16/12/2025
948: In Case You Missed It in November 2025 12/12/2025
947: How to Get Hired at Top Firms like Netflix and Spotify, with Jeff Li 09/12/2025
946: How Robotaxis Are Transforming Cities 05/12/2025
945: AI is a Joke, with Joel Beasley 02/12/2025
944: Gemini 3 Pro: Google’s Back on Top 28/11/2025
© 2003-2026 ZARZA | AHEAD OF OUR TIME
privacy policy
In God we trust In God we trust
PreSales Questions? Click Here
or call our toll-free line at +1-888-5002068 Miami, Florida, USA