Infinite Curiosity Pod with Prateek Joshi cover image

AutoGPT, LLMs for developers, Context windows | Aditya Naganath, Investor at Kleiner Perkins

Infinite Curiosity Pod with Prateek Joshi

00:00

The Importance of L-LMS in Code Bases

If an L-lm can reason well over larger windows, new emergent properties could be uncovered. The time it takes to process the context scales quadratically with the size of the context window. It struggles to effectively compute the context once the context grows beyond a certain limit. And so that can mean that you lose, for example, the sense of long range dependencies.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app