devtools.fm: Developer Tools, Open Source, Software Development cover image

Jason Liu - Instructor, Shipping LLMs to Production

devtools.fm: Developer Tools, Open Source, Software Development

00:00

Advancements in Model Training and Hardware Efficiency

The chapter discusses the complexities of training models, touching upon limitations of data compression and potential future advancements in model improvement and hardware efficiency. Debates include the necessity of models having world knowledge versus focusing solely on reasoning abilities, as well as creating models with extended context and reasoning abilities without retaining all factual information.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app