The MapScaping Podcast - GIS, Geospatial, Remote Sensing, earth observation and digital geography

GeoParquet For Beginners

May 23, 2024

Exploring the world of cloud-native geospatial technologies like Geoparquet, range requests, and COPCs. Understanding the impact of these concepts on GIS in the future. Special focus on GeoParquet and its role in cloud-native geospatial. Insightful conversations with experts and recommendations for further exploration in the field.

42:00

Creator website

AI Summary

Highlights

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

GeoParket enables efficient data handling in cloud-native geospatial contexts, enhancing scalability and processing capabilities without local hardware.

Utilizing GeoParket's columnar storage and compression mechanisms enhances data retrieval speed, network performance, and selective access to subsets.

Deep dives

Overview of GeoParket and its Impact

GeoParket is introduced as a cloud-native geospatial format, acting as a vector equivalent to cloud-optimized geotiffs. The importance of cloud-native geospatial technologies is emphasized for handling large datasets efficiently in the geospatial industry. The format's structure enables scaling workloads without the need for local hardware, enhancing processing capabilities on cloud platforms. Collaboration on GeoParket's metadata standardization aims to streamline data storage and analysis within the geospatial community.

Distinguishing Visualization from Analysis in Data Interpretation

00:35

Efficient Compression in Parquet for Data Sharing

00:56

Efficient Cloud Native Geospatial Format

00:29

Introduction

2min

Exploring Cloud Engineering and Geo-spatial Data Processing

3min

Exploring GeoParquet: Storing Geospatial Vector Data

10min

Efficient Data Handling with GeoParquet

4min

Navigating the Complexity of Spatial Partitioning and Indexing Large Datasets

2min

Efficiency and Innovation with GeoParquet and GeoArrow

19min

Concluding Remarks and Project Promotions

2min

Cloud-native geospatial, range requests, chucks, COGs and COPCs ... [ insert confusing acronym here ]

Sometimes It feels like we need to learn a whole new vocabulary and if you have been doing #geo for a while you might be wondering how much of this is actually going to impact me. What bits of this are the ones that I need to know about?

I don’t think that anyone is going to be talking about cloud native in 10 years, in the same way, no one talks about digital cartography or computer analysis because where else would you do your cartography? And how else would you do your analysis?

Maybe the names won’t be as important but the concepts will and while this episode is focused on Geoparquet it does so within the context of cloud-native geospatial - and this concept is not going away!

You can connect with Kyle Barron here https://x.com/kylebarron2 or here https://kylebarron.dev/

If you want to learn more about cloud-native geospatial I can highly recommend these episodes

https://mapscaping.com/podcast/cloud-optimized-point-clouds/

https://mapscaping.com/podcast/introduction-to-cloud-native-geospatial/

https://mapscaping.com/podcast/planet-scale-tiled-maps-without-a-server/

https://mapscaping.com/podcast/what-is-modern-gis/

https://mapscaping.com/podcast/the-planetary-computer/

I am working on a new project called https://quickmaptools.com/ like the name suggests it is a bunch of browser-based map tools. So far we have created several different conversion tools and will continue to add more to the list. Check it and let me know what you think!

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

The MapScaping Podcast - GIS, Geospatial, Remote Sensing, earth observation and digital geography

GeoParquet For Beginners