What's AI Podcast by Louis-François Bouchard cover image

Building with Large Language Models, chatGPT, and Working at OpenAI - The What's AI Podcast episode 11

What's AI Podcast by Louis-François Bouchard

00:00

How Open AI Tokenizes Language Models

GPT stands for generative pre-trained transformers which is the technology that GPT 4 and GPT 3.5 all those models are based on. Tokens are what the model how the model understands text so instead of like understanding text at a word level or a individual character level it understands at a token level. RLHF is part of that alignment process in some sense where you actually tune the model to look at a bunch of like human preferences.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app