PaLM 2 details leaked 🤐 // Apple's Speech Cloning 🗣️ // Contextual Pre-Training 📖

18/05/2023 14 min

Listen "PaLM 2 details leaked 🤐 // Apple's Speech Cloning 🗣️ // Contextual Pre-Training 📖"

Episode Synopsis

Apple's AI-Driven Accessibility Updates and Google's PaLM 2. We also delve into the world of efficient audio generation with SoundStorm and explore the potential of active retrieval augmented generation. Finally, we discuss the importance of in-context learning in NLP and how Pre-Training to Learn in Context can enhance language models' abilities.
Contact: [email protected]
Timestamps:
00:34 Introduction
01:45 Apple's AI-Driven Accessibility Updates Include Text-to-Speech That Can Mimic Your Voice
03:10 PaLM 2 Details Leaked: it uses 5x the data the original PaLM trained on
05:32 Numbers every LLM Developer should know
06:48 Fake sponsor
08:38 SoundStorm: Efficient Parallel Audio Generation
09:58 Active Retrieval Augmented Generation
11:30 Pre-Training to Learn in Context
13:26 Outro

More episodes of the podcast GPT Reviews