
51 – Open Data Standards (Apache Iceberg, Apache Parquet, Apache Arrow, Apache Ibis, Apach Substrait)
DataNation - Podcast for Data Engineers, Analysts and Scientists
00:00
Optimizing Data Transfer with Apache Arrow Flight and ADBC
This chapter explores the advantages of Apache Arrow and Apache Arrow Flight in enhancing data transfer efficiency within the data industry. It delves into how Apache Arrow Flight, through the use of Apache Arrow buffers and GRPC protocol, accelerates data transfer, particularly in compute clusters, and introduces the Arrow Database Connectivity (ADBC) standard as a potential replacement for JDBC, enabling faster and more efficient data transport for analytical applications.
Transcript
Play full episode