Gnarly Data Waves by Dremio cover image

EP20 - What's New in the Apache Iceberg Project: Updates, PyIceberg, Compute Engines

Gnarly Data Waves by Dremio

00:00

Spark and Performance Updates

Fling is another engine used heavily for streaming application. And the iceberg Fling combo is really maturing day by day. So that was all about Spark and performance updates. Let's quickly look at what has happened on the Apache Filling site. The metadata table allows you to do things like, how many small files do I have in my environment? How can I do some data quality checks? How much now values are added per writes in a particular,. It's table, iceberg table.

Play episode from 36:10
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app