Eye On A.I. cover image

#127 Clemens Mewald: Redefining the Boundaries of Artificial Intelligence & GPT-4

Eye On A.I.

CHAPTER

GPT for 32,000 Tokens

The largest amount that they currently have is the GPT for 32,000 token window. It's not like doesn't cover like 400 pages, right? And I think I know that they're working on a larger context model. The way it actually works and what we've spent a lot of time implementing for converse is when you upload all of these documents,. We create embeddings with them and then we store them into a vector database. Then when you ask a question, we first do the vector search in the database. So if it's a retrieval question, we basically just find the chunk that's most relevant and then we send that chunk as context to the GPT model.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner