EP 8: AI Inference: From Model to Action

04/06/2025 19 min Temporada 1 Episodio 8

Listen "EP 8: AI Inference: From Model to Action"

Episode Synopsis

This episode explores AI inference, the critical step where trained AI models solve real-world problems. Expert Soo Mei May clarifies the difference between training and inference, and discusses key challenges for businesses: use case definition, cost management, and handling "hallucinations." She emphasizes the importance of data privacy and the growing role of AI PCs in enabling on-device inference.