Episode 30 - The Challenges of Using LLM and Generative AI

29/06/2024 35 min Temporada 1 Episodio 30
Episode 30 - The Challenges of Using LLM and Generative AI

Listen "Episode 30 - The Challenges of Using LLM and Generative AI"

Episode Synopsis

Send us a textAs with all the discussions of AI, and particularly LLM's and Generative AI, this is a discussion of the challenges of getting it right, making it useful, and using these tools successfully in a business.Major Points:There are a large number of commercial and open-source models available.Tens and even hundreds of millions of dollars were spent, and equal amounts of person years were expended to create these models. Your business cannot and should not duplicate this effort and expense.You therefore must know the best way to use the models, and that is to collect enough data about your operations to extend the models to know about your enterprise.You also must have enough subject matter expertise to know when the models are producing incorrect answers, such as "hallucinations".You must be aware of the security challenges the models represent, particularly in sensitive industries such as finance and health care.You must be able to create testing to ensure you know and limit the risks of incorrect answers, and security problemsThere is no such thing as a free lunch. You must expend the effort necessary to teach the models you use, test those models, and ensure that you have limited the scope of security problems from the models.Cory Doctorow - Human in the Middle AIChatGPT Gemini Anthropic ClaudeEpisode Transcript