3min chapter

Weaviate Podcast cover image

GPT Index and Weaviate with Jerry Liu and Bob van Luijt - Weaviate Podcast #37

Weaviate Podcast

CHAPTER

The Cost and Latency of Defining Complex Graph Structures

Every call to GPT is gonna take around like, two to three seconds of you just give it like, 3,000, 4,000 tokens. So there are just some practical constraints in making this graph overly complicated. For a lot of tree structures, practically speaking, what has worked well are just slightly more shallow structures. But I think generally speaking, you know, as these models get better and cost and lanes does come down, this notion of repeatedly querying or recursively querying the L M for more information has already proven to be pretty useful in a lot of cases.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode