
AI Today Podcast: AI Glossary Series – Tokenization and Vectorization
AI Today Podcast
00:00
Vectorization and Vector Space in Machine Learning
A vector is a line that connects two points in different dimensions. It encodes the meaning of a word in such a way that words that are closer to each other in the vector space probably have similar meaning, right? So maybe it's based on these words are used frequently together and they're used in the same context. So with machine learning approaches, we can learn how the words are related to have similar meaning.
Transcript
Play full episode