ZARZA We are Zarza, the prestigious firm behind major projects in information technology.
Listen "Is scaling all you need for AI Large Language Models? Scaling laws and the Inverse Scaling Challenge. Featuring Ian McKenzie, FAR AI Research Scientist"
Episode Synopsis
The last couple of years have been an AI model arms race.
The assumption is that the larger the model the better it will perform. But that may not always be the case.
FAR AI Research Scientist Ian McKenzie is a key member of the team organizing the Inverse Scaling Challenge, an initiative set up to investigate scaling laws. We discuss:
Large Language Models and how they are trainedThe scaling laws and how they are being revised as research and development progressesThe Inverse Scaling Challenge and its findings
Article published on Orchestrate all the Things.
In God we trust