2: data2vec

07/03/2022 53 min Temporada 1 Episodio 2
2: data2vec

Listen "2: data2vec"

Episode Synopsis

Todays paper: data2vec (https://arxiv.org/abs/2202.03555)Summary of the paperA multimodal SSL algorithm that predicts latent representation of different types of input.Highlights of discussionWhat are the motivations of SSL and multimodalHow does the student teacher learning work?What are similarities and differences between ViT, BYOL, and Reinforcement Learning algorithms.