2min chapter

Weaviate Podcast cover image

Our Mad Journey of Building a Vector Database in Go - Weaviate at FOSDEM 2023

Weaviate Podcast

CHAPTER

How to Sum Up 80 Million Numbers in a Database

We need to somehow represent that data on disk. And we're looking at two ways to do this. The first one is JSON representation and then the second one would be sort of binary encoding. So in our fictional example, that would take up 1.6 gigabyte. But also it's slow. Part of why it's slow is again because we have these memory allocations but also the whole parse interest takes time. In our example, this took 14 seconds to sum up those 80 million numbers.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode