Training a 1 trillion parameter model

Pretrained
03/09/2025 43 min Episodio 15
Training a 1 trillion parameter model

Listen "Training a 1 trillion parameter model"

Descargar episodio Ver en sitio original

Episode Synopsis


Kimi K2 and Moonshot AI's history, avoiding loss spikes during training, the muon optimizer, and data parallelism
© 2003-2026 ZARZA | AHEAD OF OUR TIME
privacy policy
In God we trust In God we trust
PreSales Questions? Click Here
or call our toll-free line at +1-888-5002068 Miami, Florida, USA