Apple's use of AI in its new devices, including a new chip that includes improved data crunching capabilities and a four-core "Neural Engine" that can process machine learning tasks up to twice as quickly. Elon Musk's proposal for a federal department of AI after his Capitol Hill summit, citing the potential harm of unchecked AI development. Cutting-edge research on efficient memory management, mesa-optimization algorithms, and extremely parameter-efficient MoE. The proposed solutions to challenges in serving large language models efficiently, including PagedAttention and vLLM.
Contact:  [email protected]
Timestamps:
00:34 Introduction
01:41 AI quietly reshapes Apple iPhones, Watches
03:06 Elon Musk calls for federal department of AI after Capitol Hill summit
04:34 Jason Wei tweets
06:15 Fake sponsor
08:06 Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning
09:33 Uncovering mesa-optimization algorithms in Transformers
11:06 Efficient Memory Management for Large Language Model Serving with PagedAttention
12:53 Outro

Ver todos los episodios