White House on AI Safety 🤖 // Beatles AI Song 🎵 // RedPajama Dataset 📊

31/10/2023 15 min

Listen "White House on AI Safety 🤖 // Beatles AI Song 🎵 // RedPajama Dataset 📊"

Episode Synopsis

President Biden's executive order on safe and trustworthy AI, the release of a "final" Beatles song created with AI technology, and exciting developments in the world of language models. They also explore a groundbreaking open dataset called RedPajama-Data-v2 and highlight three research papers on training large language models, modeling truthfulness in language models, and code generation.
Contact:  [email protected]
Timestamps:
00:34 Introduction
02:48 President Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence
04:32 The Beatles: ‘final’ song Now and Then to be released thanks to AI technology
06:15 RedPajama-Data-v2: an Open Dataset with 30 Trillion Tokens for Training Large Language Models
07:43 Fake sponsor
09:38 FP8-LM: Training FP8 Large Language Models
11:06 Personas as a Way to Model Truthfulness in Language Models
12:23 CodeFusion: A Pre-trained Diffusion Model for Code Generation
14:11 Outro

More episodes of the podcast GPT Reviews