Listen "2: data2vec"
Episode Synopsis
Todays paper: data2vec (https://arxiv.org/abs/2202.03555)Summary of the paperA multimodal SSL algorithm that predicts latent representation of different types of input.Highlights of discussionWhat are the motivations of SSL and multimodalHow does the student teacher learning work?What are similarities and differences between ViT, BYOL, and Reinforcement Learning algorithms.
More episodes of the podcast Argmax
Mixture of Experts
08/10/2024
LoRA
02/09/2023
15: InstructGPT
28/03/2023
14: Whisper
17/03/2023
13: AlphaTensor
10/03/2023
12: SIRENs
24/10/2022
9: Heads-Up Limit Hold'em Poker Is Solved
29/07/2022
8: GATO (A Generalist Agent)
29/07/2022
ZARZA We are Zarza, the prestigious firm behind major projects in information technology.