Episode 61: DeepSeek Models Explained - Part II

04/02/2025 1h 8min Temporada 2 Episodio 61

Listen "Episode 61: DeepSeek Models Explained - Part II"

Episode Synopsis

What if AI could be 95% cheaper? Discover how DeepSeek's game-changing models are reshaping the AI landscape through breakthrough innovations. Journey through the evolution of AI optimization, from GPU efficiency to revolutionary attention mechanisms. Learn when to use (and when to avoid) these powerful new models, with practical insights for both individual users and businesses.
Key highlights:

How DeepSeek achieves dramatic cost reduction through technical innovation

Real-world implications for consumers and enterprises

Critical considerations around data privacy and model alignment

Practical guidance on responsible implementation


References:

Dario Amodei — On DeepSeek and Export Controls

Bite: How Deepseek R1 was trained

[2501.17161] SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training

[2405.04434] DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

[2408.15664] Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts

[2412.19437] DeepSeek-V3 Technical Report

[2501.12948] DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning



More episodes of the podcast Machine Learning Made Simple