17min chapter

The Data Stack Show cover image

158: The Orchestration Layer as the Data Platform Control Plane With Nick Schrock of Dagster Labs

The Data Stack Show

CHAPTER

Fragmentation vs. Integration in Data Infrastructure

This chapter explores the debate around the fragmentation or rebundling of data infrastructure systems. It discusses vertical integration examples like Databricks and Snowflake, as well as the resistance to vertical integration and the potential for a horizontal layer. The chapter argues that the orchestrator control plane layer is a natural place to integrate these capabilities and provide a user experience that balances order and heterogeneity.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode