DataNation - Podcast for Data Engineers, Analysts and Scientists cover image

51 – Open Data Standards (Apache Iceberg, Apache Parquet, Apache Arrow, Apache Ibis, Apach Substrait)

DataNation - Podcast for Data Engineers, Analysts and Scientists

00:00

Optimizing Data Transfer with Apache Arrow Flight and ADBC

This chapter explores the advantages of Apache Arrow and Apache Arrow Flight in enhancing data transfer efficiency within the data industry. It delves into how Apache Arrow Flight, through the use of Apache Arrow buffers and GRPC protocol, accelerates data transfer, particularly in compute clusters, and introduces the Arrow Database Connectivity (ADBC) standard as a potential replacement for JDBC, enabling faster and more efficient data transport for analytical applications.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app