Eye On A.I. cover image

#127 Clemens Mewald: Redefining the Boundaries of Artificial Intelligence & GPT-4

Eye On A.I.

00:00

GPT for 32,000 Tokens

The largest amount that they currently have is the GPT for 32,000 token window. It's not like doesn't cover like 400 pages, right? And I think I know that they're working on a larger context model. The way it actually works and what we've spent a lot of time implementing for converse is when you upload all of these documents,. We create embeddings with them and then we store them into a vector database. Then when you ask a question, we first do the vector search in the database. So if it's a retrieval question, we basically just find the chunk that's most relevant and then we send that chunk as context to the GPT model.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
 Get the app