"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

Imbue CTO Josh Albrecht on Creating AI Agents for Reasoning, Reliability, and Robustness

Dec 2, 2023

01:21:38

Snipd AI

Josh Albrecht, CTO of Imbue, discusses creating AI agents for reasoning, reliability, and robustness. They explore enhancing reasoning systems, separating reasoning and knowledge in AI models, micro reasoning skills, and working with Volta-Tupark. The complexities of AI and deep learning, AI risks, and company projects are also discussed.

AI Summary

Highlights

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Longer sequences of actions require higher accuracy for AI systems, leading to the development of more capable systems that exhibit reasoning and planning abilities.

Coding skills enable AI agents to optimize their own behavior through planning and reasoning, breaking down complex problems and improving decision making and efficiency.

Combining reinforcement learning with coding skills enhances decision making, prompt optimization, and learning from examples, unlocking new possibilities for dynamic and efficient problem-solving.

The integration of reinforcement learning and coding skills revolutionizes AI development, allowing agents to autonomously break down tasks, optimize strategies, and improve performance over time.

Deep dives

Advancements in Long-Term Systems

The next year or two will witness the development of systems that excel at longer-term actions. While being right 80% of the time may suffice for shorter sequences of actions, longer sequences require higher accuracy. We can expect to see significant performance improvements in longer-term tasks, leading to more capable systems that exhibit reasoning and planning abilities.

Transformers and the Importance of Representations in Learning

01:48

Techniques for improving model performance in natural language generation

01:24

The Future of Systems Learning

00:32

How big is GPT-4 and how long does it take to train?

01:19

Introduction

3min

imbue: Advancing AI Agents and Reasoning

10min

Improving Reasoning Systems and Future Performance

4min

Improving Reasoning in AI Agents

13min

Separating Reasoning and Knowledge in AI Models

2min

Micro Reasoning Skills and AI Insights

16min

Speculation on $200 Million Raise and Working with Volta-Tupark

23min

Complexity of AI and Deep Learning

5min

AI risks, company projects, and plans for growth

6min

In this episode, Nathan chats with Josh Albrecht, CTO of Imbue. They discuss how to create agents for reasoning, reliability, and robustness. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period.

We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.

SPONSORS:

Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.

X/SOCIAL

@labenz (Nathan)

@eriktorenberg (Erik)

@CogRev_Podcast

TIMESTAMPS:

(00:00:00) – Episode Preview

(00:07:14) – What does it mean to be a research company?

(00:10:25) – How is the reasoning landscape these days and how might it evolve?

(00:11:03) – Data quality is highly important

(00:21:15) – What’s the difference between good features and a good world model?

(00:27:31) – The impact of new modalities on reasoning

(00:29:15) – How much can reasoning and knowledge be separated?

(00:45:13) – Imbue demo and are they building their own LLMs or using others?

(00:49:37) – Does Imbue have a deal with Nvidia?

(00:57:48) – Carbs framework

(01:12:57) – Imbue’s involvement with policy and and AI safety

(01:16:23) – Takeaways from AI Safety Summit and Biden’s Order

This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export