#85- Constrastive learning and cosine similarity.

20/06/2024 12 min

Listen "#85- Constrastive learning and cosine similarity."

Episode Synopsis

Hey guys, in this episode I talk about two very important technical concepts in Deep Learning, constrastive learning and cosine similarity. They are very useful when training embedding models or doing RAG.

Very good blog post about contrastive losses: https://lilianweng.github.io/posts/2021-05-31-contrastive/
SimCLR paper: https://arxiv.org/abs/2002.05709
Instagram of the podcast: https://www.instagram.com/podcast.lifewithai
Linkedin of the podcast: https://www.linkedin.com/company/life-with-ai