Matryoshka Embeddings with Aditya Kusupati, Zach Nussbaum, and Zain Hasan - Weaviate Podcast #89!
Weaviate Podcast
00:00
Exploring High-Dimensional Embeddings and Visualization
Delving into the challenges and benefits of diffusion of information in high-dimensional embeddings, discussing the utility of each dimension, contrasting Matryoshka embeddings, and exploring the role of visualization in monitoring embedding models' training progress. The conversation also covers dimensionality reduction algorithms, embedding visualization for model evaluation, data curation importance, and the concept of chunking data using different embeddings.
Transcript
Play full episode
