ZARZA We are Zarza, the prestigious firm behind major projects in information technology.
Listen "559: GPT-3 for Natural Language Processing"
Episode Synopsis
Natural language processing expert and PhD student Melanie Subbiah sits down with Jon Krohn to discuss GPT-3, its strengths and weaknesses, and the future of NLP.
In this episode you will learn:
What is GPT-3? [6:24]
The strengths and weaknesses of GPT-3 [14:38]
What is autoregression? [18:03]
GPT-3's new fine-tuning abilities [20:02]
Bias issues with GPT-3 [22:47]
The future of natural language processing models [27:54]
How Melanie ended up working at OpenAI [38:13]
Melanie’s self-study process [42:19]
Melanie's work on OpenAI API [45:45]
How to address the climate change and bias issues that cloud discussions of large natural language models [49:40]
Why Melanie chose to do a PhD at Columbia University [1:01:17]
The machine learning tools Melanie’s most excited about [1:08:09]
Additional materials: www.superdatascience.com/559
In this episode you will learn:
What is GPT-3? [6:24]
The strengths and weaknesses of GPT-3 [14:38]
What is autoregression? [18:03]
GPT-3's new fine-tuning abilities [20:02]
Bias issues with GPT-3 [22:47]
The future of natural language processing models [27:54]
How Melanie ended up working at OpenAI [38:13]
Melanie’s self-study process [42:19]
Melanie's work on OpenAI API [45:45]
How to address the climate change and bias issues that cloud discussions of large natural language models [49:40]
Why Melanie chose to do a PhD at Columbia University [1:01:17]
The machine learning tools Melanie’s most excited about [1:08:09]
Additional materials: www.superdatascience.com/559
More episodes of the podcast Super Data Science: ML & AI Podcast with Jon Krohn
953: Beyond “Agent Washing”: AI Systems That Actually Deliver ROI, with Dell’s Global CTO John Roese
30/12/2025
952: How to Avoid Burnout and Get Promoted, with “The Fit Data Scientist” Penelope Lafeuille
26/12/2025
948: In Case You Missed It in November 2025
12/12/2025
946: How Robotaxis Are Transforming Cities
05/12/2025
945: AI is a Joke, with Joel Beasley
02/12/2025
944: Gemini 3 Pro: Google’s Back on Top
28/11/2025
In God we trust