What's AI Podcast by Louis-François Bouchard cover image

Building with Large Language Models, chatGPT, and Working at OpenAI - The What's AI Podcast episode 11

What's AI Podcast by Louis-François Bouchard

CHAPTER

How Open AI Tokenizes Language Models

GPT stands for generative pre-trained transformers which is the technology that GPT 4 and GPT 3.5 all those models are based on. Tokens are what the model how the model understands text so instead of like understanding text at a word level or a individual character level it understands at a token level. RLHF is part of that alignment process in some sense where you actually tune the model to look at a bunch of like human preferences.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner