GitHub Copilot's Losing Money 💰 // Polymathic AI's Foundation Models 🧬 // Mistral 7B Language Model 🤖

12/10/2023 15 min

Listen "GitHub Copilot's Losing Money 💰 // Polymathic AI's Foundation Models 🧬 // Mistral 7B Language Model 🤖"

Episode Synopsis

Polymathic AI's initiative to change how people use AI and machine learning in science, the high cost of running generative AI models like Microsoft's GitHub Copilot, the impressive performance of Mistral 7B, a 7-billion-parameter language model, and the introduction of iTransformer, a new model for time series forecasting that achieves state-of-the-art results on several real-world datasets.
Contact:  [email protected]
Timestamps:
00:34 Introduction
01:32 Announcing: Polymathic AI 🎉
03:12 Microsoft's GitHub Copilot Loses $20 a Month Per User
04:52 Fake sponsor
06:55 Mistral 7B
08:22 LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression
10:28 Functional Interpolation for Relative Positions Improves Long Context Transformers
11:49 iTransformer: Inverted Transformers Are Effective for Time Series Forecasting
13:42 Outro

More episodes of the podcast GPT Reviews