The Data Stack Show The PRQL: Breaking Down Silos: Collaborative Data Engineering in the AI Era with Pete Hunt of Dagster
May 26, 2025
The discussion dives into innovations transforming data engineering. It highlights the impact of emerging technologies, like large language models, on the industry. The guest from Dagster shares insights about breaking down silos in collaborative data work. The conversation emphasizes the blending of AI with data processes to drive smarter decisions and improve customer experiences.
AI Snips
Chapters
Transcript
Episode notes
Pete Hunt's Career Journey
- Pete Hunt shared his career path from engineering at Facebook to entrepreneurship and CEO at Dagster.
- His journey includes working on ReactJS, building Smite for stream processing, and joining Dagster through connections.
Evolving Data Engineering Roles
- Development tools and frameworks enable diverse roles to engage in engineering processes.
- The rise of large language models is reshaping who can contribute to data engineering tasks.
DevTools and AI Synergy
- DevTools best practices are crucial in adapting to the changing landscape of data roles.
- These shifts are exciting as they merge engineering skills with evolving AI capabilities.