The Data Stack Show cover image

246: AI, Abstractions, and the Future of Data Engineering with Pete Hunt of Dagster

The Data Stack Show

00:00

Navigating the Modern Data Stack

This chapter explores the emergence of the modern data stack and the complexities it introduces into data engineering. It emphasizes the importance of abstraction and software engineering best practices in managing these complexities while fostering collaboration among different stakeholders. The discussion includes the evolution of team roles, the impact of AI on workflow orchestration, and the development of tools to facilitate effective data management.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app