Data Engineering Podcast cover image

Re-Bundling The Data Stack With Data Orchestration And Software Defined Assets Using Dagster

Data Engineering Podcast

00:00

Cloud Computing and the Datalake Use Case - What's Next?

There are slike lake f s that allow you to have a sort of branch and merge style work flow four your data. But the entire idea is that by having this capability built into the orchestration layer, the orchestrationlayer itself can manage all these tests environments. And that's really where this magic comes together for the datalake use case. Ino iceberg and project nesse are looking to be able to do that in the space of things like hive tables, or tables in your, you know, amazon athena lake, or things like that.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app