Benchmarking AI with Stanislav Khromov

30/10/2025 1h 13min Episodio 86
Benchmarking AI with Stanislav Khromov

Listen "Benchmarking AI with Stanislav Khromov"

Episode Synopsis


In this episode, Stanislav Khromov joins the Svelte Radio team to discuss his work on Svelte Bench, abenchmarking tool that scientifically measures how well different LLMs understand and write Svelte 5 code.The conversation explores the challenges of AI-assisted coding with Svelte 5, the development of the officialSvelte MCP (Model Context Protocol) that provides LLMs with documentation and auto-fixing capabilities, andthe surprising performance differences between major AI providers. Stanislav also shares insights on workingwith AI tools, the future of local models, and the economics of AI coding assistants.NotesStanislav KhromovSvelte BenchGitHubSvelte MCPAnthropic Spending VC MoneyUnpopular OpinionsKevin: Serverless is overratedStanislav: OpenAI has the worst models of the big threeAntony: Heat Pumps are badTechnology ConnectionsTech IngredientsPicksKevin: Kasai Hibachi Grill (now tested, and can confirm, it is PENG!)Stanislav: Ball x PitAntony: Saunas By the Sea