Gnarly Data Waves by Dremio cover image

EP20 - What's New in the Apache Iceberg Project: Updates, PyIceberg, Compute Engines

Gnarly Data Waves by Dremio

00:00

Apache Spark 3.3: Support for Storage Partition Join

The support for storage partition join is now immediately available for Facebook table in Spark 3.3. Next, we have the change for automatically setting certain Apache arrow environment variables for improving the read performance. And finally, we have another PR that try to optimize the delete operation.

Play episode from 32:15
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app