The Alternative Data Podcast cover image

The SynerAI episode

The Alternative Data Podcast

CHAPTER

The Art of Natural Language Processing

The biggest challenge in natural language processing is turning text into numbers. No matter how sophisticated the computer program you're working on, it does not understand language. The whole art of these large language models is to turn words into numbers. So even that six or seven word sentence is now a vector with BurtYou'll get something like 733 different numbers to describe what that sentence is. They don't actually mean anything that would make sense to us but they've just optimized this mathematical space.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner