This Day in AI Podcast cover image

EP44: The Finale: Google Gemini, SimTheory, Is Ilya OK? Predictions for 2024

This Day in AI Podcast

CHAPTER

Training a Model on Multimodal Tokens

This chapter discusses the training process of a model on over 1.5 trillion multimodal tokens from web documents, books, code, images, audio, and videos. The speakers express their interest in the video capability and audio integration of the model. They suggest that if the creators were more fearless and released the model openly, it could have showcased Google's leadership in the AI space.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner