The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) cover image

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

Scaling Up Test-Time Compute with Latent Reasoning with Jonas Geiping - #723

Mar 17, 2025
Jonas Geiping, a research group leader at the Ellis Institute and Max Planck Institute for Intelligent Systems, discusses innovative approaches to AI efficiency. He introduces a novel recurrent depth architecture that enables latent reasoning, allowing models to predict tokens with dynamic compute allocation based on difficulty. Geiping contrasts internal and verbalized reasoning in AI, explores challenges in scaling models, and highlights the architectural advantages that enhance performance in reasoning tasks. His insights pave the way for advancements in machine learning efficiency.
58:38

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • The podcast discusses a novel AI architecture that enables models to think in latent space, improving reasoning and performance during evaluation.
  • It contrasts traditional RNNs with a recurrent depth strategy that allows flexible layer repetition, decoupling computation from output production for improved scalability.

Deep dives

Divergent Thinking Approaches

Humans often have the capacity to think about problems without immediately verbalizing their solutions. The podcast delves into the concept that people utilize two distinct axes for scaling their computation and reasoning. This duality suggests that individuals do not always process thoughts linearly, but may simultaneously engage in various cognitive processes. The conversation emphasizes that both humans and models can leverage these different methodologies, enabling more flexible approaches to problem-solving.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode