The episode covers cutting-edge AI research on vision and language models, including a new pretraining methodology for open-vocabulary object detection and a physically grounded VLM for robotic manipulation tasks. The show also features two interesting papers on DSPy, a framework for working with language models and retrieval models, and Verba, an open-source initiative for retrieval-augmented generation applications. The crew discusses the TIME100 Most Influential People in AI, highlighting the significance of generative AI and the ethical questions surrounding its development.
Contact:  [email protected]
Timestamps:
00:34 Introduction
01:38 How We Chose the TIME100 Most Influential People in AI
03:16 DSPy: Programming—not prompting—Foundation Models
04:28 Verba Retrieval Augmented Generation from Weaviate
05:26 Fake sponsor
07:28 Contrastive Feature Masking Open-Vocabulary Vision Transformer
09:24 Physically Grounded Vision-Language Models for Robotic Manipulation
11:27 Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning
13:40 Outro

Ver todos los episodios