The Data Engineering Show
Joe Reis and Matt Housley on the fundamentals of data engineering
Sep 6, 2023
Join Joe Reis, co-author of 'Fundamentals of Data Engineering,' and Matt Housley, a cloud technologies consultant, as they dive into the evolving landscape of data engineering. They discuss the necessity of foundational knowledge in this field, the shift to cloud-based solutions, and ensuring data governance. The duo reflects on historical challenges in data integration and the importance of inter-team collaboration to enhance outcomes. Expect a blend of insights and humor as they navigate the complexities of data's role in driving business value.
42:11
Episode guests
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- The transition from data science to data engineering emphasizes building foundational systems that support data-driven business objectives and enhance customer experiences.
- Despite technological advancements, industry challenges persist due to inadequate focus on data governance and the need for effective collaboration among data professionals.
Deep dives
Transitioning from Data Science to Data Engineering
Professionals transitioning from data science to data engineering are motivated by the need to build foundational systems that support successful data science initiatives. Many data scientists have experienced limitations in traditional on-premises systems, prompting them to seek cloud solutions for enhanced scalability. The ability to dynamically adjust computing resources in the cloud has transformed how data workflows operate, allowing for greater efficiency and responsiveness. This shift demonstrates a growing recognition of data engineering as an essential discipline that underpins the effectiveness of analytics and machine learning.
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
