Listen "161: The Intersection of Generative AI and Data Infrastructure with Chang She of LanceDB"
Episode Synopsis
Highlights from this week’s conversation include:Chang’s background and journey with Pandas (6:26)The persisting challenges in data collection and preparation (10:37)The resistance to change in using Python for data workflows (13:05)AI hype and its impact (14:09)The success and evolution of Pandas as a data framework (20:04)The vision for a next-generation data infrastructure (26:48]LanceDB's file and table format (34:35)Trade-Offs in Lance Format (42:45)Introducing the Vector Database (46:30)The split between production and serving databases (51:14)The importance of unstructured data and multimodal use cases (57:01)The potential of generative AI and the balance between value and hype (1:01:34)Changing expectations of interacting with information systems (1:13:53)Final thoughts and takeaways (1:15:32)The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
More episodes of the podcast The Data Stack Show
Re-Air: Context is King: Building Intelligent AI Analytics Platforms with Paul Blankley of Zenlytic
19/11/2025
Re-Air: From PDFs to BI and Beyond: The Future of the Data Frontend with Ryan Dolley of GoodData
05/11/2025
Re-Air: Ringing Out the Old: AI's Role in Redefining Data Teams, Tools, and Business Models
15/10/2025
ZARZA We are Zarza, the prestigious firm behind major projects in information technology.