ZARZA We are Zarza, the prestigious firm behind major projects in information technology.
Listen "3: VICReg"
Episode Synopsis
Todays paper: VICReg (https://arxiv.org/abs/2105.04906)Summary of the paperVICReg prevents representation collapse using a mixture of variance, invariance and covariance when calculating the loss. It does not require negative samples and achieves great performance on downstream tasks.Highlights of discussionThe VICReg architecture (Figure 1)Sensitivity to hyperparameters (Table 7)Top 5 metric usefulness
More episodes of the podcast Argmax
Mixture of Experts
08/10/2024
LoRA
02/09/2023
15: InstructGPT
28/03/2023
14: Whisper
17/03/2023
13: AlphaTensor
10/03/2023
12: SIRENs
24/10/2022
9: Heads-Up Limit Hold'em Poker Is Solved
29/07/2022
8: GATO (A Generalist Agent)
29/07/2022
In God we trust