The Inside View cover image

Breandan Considine on Neuro Symbolic AI, Coding AIs and AI Timelines

The Inside View

00:00

Parallel Scaling in Programming Synthesis

As you make it wider and wider, you approximate in the limit this kind of a universal functional approximator. In practice, we see that depth has a nice effect because if you make it deeper, you need fewer parameters. Just make this deeper, you could do things in sequence. But that imposes a sequentiality on the problem domain. And so I think scaling laws will win out in the short term.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app