Amazon is limiting new Kindle books due to the rapid evolution of generative AI, which has flooded the market with low-quality content. DeepMind's co-founder believes that interactive AI is the future, which can carry out tasks by calling on other software and people to get things done. "Compositional Foundation Models for Hierarchical Planning" proposes a solution for effective decision-making in novel environments with long-horizon goals. "Scaling Laws for Sparsely-Connected Foundation Models" explores the impact of parameter sparsity on the scaling behavior of transformers trained on massive datasets, which can lead to more efficient and scalable models in the future.
Contact:  [email protected]
Timestamps:
00:34 Introduction
01:42 Citing “rapid evolution of generative AI,” Amazon limits new Kindle books
02:56 DeepMind’s cofounder: Generative AI is just a phase. What’s next is interactive AI.
05:10 Mitigating LLM Hallucinations: a multifaceted approach
06:27 Fake sponsor
08:52 Compositional Foundation Models for Hierarchical Planning
10:39 Replacing softmax with ReLU in Vision Transformers
11:56 Scaling Laws for Sparsely-Connected Foundation Models
13:37 Outro

Ver todos los episodios