Gnarly Data Waves by Dremio cover image

EP20 - What's New in the Apache Iceberg Project: Updates, PyIceberg, Compute Engines

Gnarly Data Waves by Dremio

00:00

The PR for Streaming Read in Fling Sync

The next one is around the same branching and tagging capability in iceberg. So with this new change, we can write to iceberg branches in Fling sync via an API. The third one is around adding, totally in support for streaming read. For example, if you have a stream join job reading from two different iceberg tables, the first table has maybe more real-time data or later arriving data. Then it would be great to delay the consumption for that second table. And this way we can reduce the join window in Plink State. That's really good as well. Finally, the last one basically deals with the enabling multiple flink sink support.

Play episode from 37:36
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app