Listen "Keeping it Local: Generative AI at the Edge"
Episode Synopsis
Unlocking AI at the Edge with NXP's eIQ GenAI Flow | EdgeVerse Techcast In this episode of the EdgeVerse Techcast, hosts Bridgette Stone and Kyle Dando delve into the transformative impact of NXP's eIQ GenAI Flow on edge computing. Joined by AI expert Davis Sawyer, the conversation covers the deployment of large language models at the edge, the integration of audio tasks, and the role of Retrieval Augmented Generation (RAG) in improving model accuracy. The discussion also highlights real-world applications in automotive, healthcare, and industrial automation, showcasing how eIQ GenAI Flow enables secure, efficient, and local AI processing. Tune in to discover how this innovative tool is setting new standards for AI performance at the edge. Additional resources to keep learning: eIQ on NXP.com: www.nxp.com/eIQ Read a Blog: www.nxp.com/company/about-nxp/smarter-world-blog/BL-GEN-AI-FOR-EMBEDDED-APPS Read a Paper: www.nxp.com/webapp/Download?colCode=GEN-AI-RAG-WHITEPAPER Watch Training: www.nxp.com/design/design-center/training/TS-MACHINE-LEARNING-AND-AI 00:00 Introduction and Hosts 00:53 Guest Introduction: Davis Sawyer 01:39 Understanding eIQ GenAI Flow 03:06 Exploring RAG (Retrieval Augmented Generation) 05:44 Quantization and NPU Acceleration 08:08 Real-World Applications of GenAI Flow 10:17 Future of Edge-Based GenAI 12:01 Conclusion and Wrap-Up