People by WTF cover image

WTF is Artificial Intelligence Really? | Yann LeCun x Nikhil Kamath | People by WTF Ep #4

People by WTF

00:00

Neural Networks and Language Models: From Theory to Application

This chapter explores the foundations of neural network language models, tracing back to the early concepts of information theory. It highlights the challenges of context length in language generation and the differences between processing text and visual data, emphasizing the limitations of current models in understanding complex environments. The discussion includes advancements in self-supervised learning and introduces the JEPA architecture, which seeks to enhance AI's ability to learn from video content and predict future events.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app