Zero Prime Podcast

Data Council
undefined
Oct 3, 2022 • 23min

E02: Metadata Architecture w/ Shirshanka Das

Shirshanka Das spent a decade leading data architecture at LinkedIn where he was the co-creator of DataHub, Apache Gobblin, Databus, Espresso and other high scale data infrastructure projects. Today he is the co-founder and CEO of Acryl Data, listen and learn what problems they are seeking to solve.Highlights:[1:10] Leaving LinkedIn and starting Acryl [4:33] Datahub growth [8:12] Where will the data catalog market segment be in 5 to 10 years?[12:07] Unlimited context within the operating system [16:08] Organizations adopting the right thinking behind metadata [21:00] Is the data catalog a stand alone category of data infrastructure 10 years from now?-- Mark your calendars for May 12-14, 2026 and join us for Data Council AI, the technical conference built by engineers for engineers. It's the only event where you'll be able to connect with 2,000+ practitioners for 3 full days of technical deep dives, battle-tested architectures and production insights in San Francisco, the heart of the AI world. Visit us at https://www.datacouncil.ai/ for the latest updates or subscribe to the newsletter as we release more details about the 2026 event!
undefined
Sep 13, 2022 • 21min

E01: Data Orchestration w/ Nick Schrock

Get an update from Nick Schrock on the dagster project. This episode discusses the world of data orchestration at large, when and how to implement dagster, and the broader competitive landscape.Highlights:[0:34] The Dagster project and the problems it solves[3:05] Software defined assets and how they work [4:55] Example of how this can be implemented [6:30] Promotion of Dagster pipelines from development to production[10:34] Dagster cloud overview [13:15] When to adopt a data orchestrator [14:23] Will data orchestration be subsumed into larger data platforms or remain standalone? [18:10] The competitive landscape of data orchestration-- Mark your calendars for May 12-14, 2026 and join us for Data Council AI, the technical conference built by engineers for engineers. It's the only event where you'll be able to connect with 2,000+ practitioners for 3 full days of technical deep dives, battle-tested architectures and production insights in San Francisco, the heart of the AI world. Visit us at https://www.datacouncil.ai/ for the latest updates or subscribe to the newsletter as we release more details about the 2026 event!

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app