Limits of Transformers, with Nouha Dziri

12/03/2025 49 min Episodio 1

Listen "Limits of Transformers, with Nouha Dziri"

Episode Synopsis

Nouha Dziri is an AI research scientist at the Allen Institute for AI, ex-Google DeepMind, ex-Microsoft Research.In this episode, we dive deep into the limitations of transformer models with Nouha Dziri, a research scientist at Allen Institute for AI. Nouha shares insights from her research on understanding the capabilities and constraints of LLMs. We discuss the challenges in reasoning, factuality, and ethical considerations that come with deploying these powerful AI systems. This conversation explores both technical aspects and broader implications for the future of AI research.ReferencesNoha's google scholar profileThe Generative AI Paradox:" What It Can Create, It May Not Understand"The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"Faith and Fate: Limits of Transformers on CompositionalityWiAIR websiteCheck out the podcast website for the teasers, episode schedule, and more informationhttps://women-in-ai-research.github.ioFollow us atYoutubeLinkedInBlueskyX (Twitter)