The PRQL: The Power of Data Orchestration: A Game-Changer for Data Infrastructure, Featuring Nick Schrock of Dagster Labs
Oct 2, 2023
auto_awesome
Nick Schrock, Co-founder of Dagster Labs, discusses the power of data orchestration and its impact on data infrastructure. He explores the history, current state, and future of orchestration, and shares insights from his experience at Facebook.
Nick Schrock provided a comprehensive explanation of the spectrum of data orchestration, from temporal to DBT, giving valuable insights into the history and future of orchestration.
The podcast delved into the unique perspectives on the differences and overlaps between product engineering and data engineering, offering valuable insights into the future of infrastructure and data engineering.
Deep dives
Insights on Data Orchestration Landscape
During the podcast episode, the guest, Nick, provided a concise and articulate response to a question about the data orchestration landscape. He discussed the spectrum of data orchestration, ranging from temporal, which is embedded in application code, to DBT, which involves ginger templating and managing jobs for running SQL queries. Nick's explanation painted a comprehensive picture of the entire landscape, offering valuable insights for anyone interested in understanding the history, current state, and future of orchestration.
Exploring the Overlaps Between Product Engineering and Data Engineering
Another significant topic discussed in the podcast was the differences and overlaps between product engineering and data engineering. The conversation highlighted the unique perspective of the guest, Nick, who had extensive experience at the scale of Facebook. The discussion delved into the tooling, infrastructure, and the transfer of knowledge between these two domains. Nick's insights provided valuable and often hard-to-find perspectives on these aspects. By exploring these overlaps, listeners gained a deeper understanding of the future of infrastructure and data engineering.
1.
Insights on Data Orchestration and Engineering: A Rare Perspective from Nick Schrock