OpenAI's Sora: Text-to-Video 📹 // Google's Gemini 1.5 🚀 // Data-efficient LLMs 💾

16/02/2024 14 min

Listen "OpenAI's Sora: Text-to-Video 📹 // Google's Gemini 1.5 🚀 // Data-efficient LLMs 💾"

Episode Synopsis

OpenAI's announcement of Sora, a text to video model that can generate realistic and imaginative scenes from text instructions.
Google's new Gemini 1.5, which delivers dramatically enhanced performance and achieves the longest context window of any large-scale foundation model yet.
"How to Train Data-Efficient LLMs" paper from Google DeepMind, UC San Diego, and Texas A&M University, which explores two data-efficient approaches to optimize the training of large language models.
"OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset" paper from NVIDIA, which presents a new math instruction tuning dataset called OpenMathInstruct-1, constructed using an open-source language model.
Contact:  [email protected]
Timestamps:
00:34 Introduction
01:38 OpenAI Announces Sora: a Text to Video Model
03:11 Google Introduces Gemini 1.5
05:27 Magika: AI powered fast and efficient file type identification
06:37 Fake sponsor
08:21 How to Train Data-Efficient LLMs
09:58 Generative Representational Instruction Tuning
11:28 OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset
13:22 Outro

More episodes of the podcast GPT Reviews