21min chapter

The Data Stack Show cover image

161: The Intersection of Generative AI and Data Infrastructure with Chang She of LanceDB

The Data Stack Show

CHAPTER

Evolution of Data Infrastructure and Next-Generation Solutions

The chapter explores the evolution of data infrastructure, highlighting the transition from system engineers to data engineers in addressing scalability and data challenges. It discusses the roles of data scientists, data engineers, and ML engineers, emphasizing the importance of accessibility in technology adoption using pandas and Snowflake as examples. The conversation introduces LanceDB as a specialized infrastructure solution for AI data, addressing the challenges of handling various data formats and the need for a unified data format like LensDB integrated with Apache Arrow.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode