Gnarly Data Waves by Dremio cover image

EP20 - What's New in the Apache Iceberg Project: Updates, PyIceberg, Compute Engines

Gnarly Data Waves by Dremio

00:00

How Spark Has Improvised in This Particular Scenario

In one of the scenarios, we're migrating from the Hadoop catalog to dreamy optic. And I'm migrating your only one table, which is just the nominee's table. So basically, if you get this command, you will now have this particular table from glue to Nessie. Now moving forward, I think we can discuss a bit about how Spark in general has brought some major performance improvement and that would be super interesting for me as well at a personal level.

Play episode from 29:41
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app