Microsoft's investment in AI is paying off, with a 17% jump in revenue and a 20% increase in profit for the first three months of the year.
Apple has released eight small AI language models aimed at on-device use, using a "layer-wise scaling strategy" to improve performance and transparency.
Multi-Head Mixture-of-Experts is a new approach to address issues with Sparse Mixtures of Experts, outperforming existing models on three different tasks.
Stream of Search (SoS) is a new technique for teaching language models to search, resulting in improved search accuracy and the ability to solve previously unsolved problems.
Contact:  [email protected]
Timestamps:
00:34 Introduction
01:28 Microsoft Reports Rising Revenues as A.I. Investments Bear Fruit
03:14 Apple releases eight small AI language models aimed at on-device use
05:00 Fake sponsor
07:01 Multi-Head Mixture-of-Experts
08:43 Achieving >97% on GSM8K: Deeply Understanding the Problems Makes LLMs Perfect Reasoners
10:30 Stream of Search (SoS): Learning to Search in Language
12:31 Outro

Ver todos los episodios