Data Engineering Podcast cover image

How Orchestration Impacts Data Platform Architecture

Data Engineering Podcast

CHAPTER

Evolving Data Management: Orchestration and Challenges

This chapter explores the transformation of data management from a cost center to a crucial element of product workflows, highlighting the shift towards agility and specialization. It delves into the complexities of data orchestration, addressing challenges related to visibility, quality, and management while stressing the importance of flexibility in architecture. Additionally, it contrasts time-based and event-based orchestration in data flows, underscoring the need for effective metadata frameworks to streamline processes across diverse systems.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner