"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

The Open Source AI Question - Part 2 | Robert Wright & Nathan Labenz

May 15, 2024

48:19

Snipd AI

Join Nathan Labenz and Robert Wright as they discuss AI's transformative potential, AI alignment research challenges, AI-powered VR, and the importance of safety measures in an open source AI world. Explore topics such as AI in smart contracts, resolving international disputes, the ethical implications of AI training on human text, representation engineering in AI models, and the skepticism towards AI alignment techniques in an open-source development environment.

AI Summary

Highlights

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

AI alignment research needs layered defense strategy to prevent misaligned behaviors.

AI-powered VR integration could lead to immersive, personalized virtual experiences.

Deep dives

Transformative Potential of AI-powered VR and Risks of Advanced AI

The wide-ranging discussion delves into the transformative potential of AI-powered virtual reality and considers Eliezer Yudkowski's warnings about the risks posed by advanced AI. The conversation explores the emerging field of mechanistic interpretability, aiming to unveil the inner workings of neural networks, and reflects on the current state of AI alignment research. It highlights concerns that while present-day language models may not inherently seek power, the sophistication of AI systems could heighten the risk of misaligned behaviors, prompting the suggestion of a layered defense strategy.

Knowledge Editing at Scale

01:30

Balancing Performance and Safety in AI Systems

01:27

Empowering individuals with AI in low-stakes disputes

01:22

Introduction

2min

Future of Virtual Reality, AI in Smart Contracts, and AI in Adjudication

11min

Exploring Radical Uncertainty and Human Impact on the Environment in Relation to AI

3min

Ethical Implications of AI Training on Human-Generated Text

15min

Exploring Representation Engineering and AI Behavior Transformation

5min

AI Alignment Skepticism and Open-Source Development

8min

Exploring Alignment Tools and Representation Engineering in AI Models

2min

Dive into an in-depth conversation with Nathan and Robert Wright as they discuss AI's transformative potential, mechanistic interpretability, and the sobering realities of AI alignment research. Learn about the defensive strategies and safety measures necessary for managing advanced AI risks in an open source world. Don't miss the insights on AI-powered VR, and be sure to check out part one on the non-zero feed.

Checkout the Part 1 of the conversation here : https://www.youtube.com/watch?v=s8bgB8TCdBs

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

CHAPTERS:

(00:00:00) Introduction

(00:07:13) AI in Governance

(00:11:08) Sci-fi doomer

(00:13:58) Sponsors: Oracle | Brave

(00:16:05) The frontier models

(00:20:22) Emergent behavior

(00:23:48) Theory of mind

(00:28:09) Mechanistic interpretability

(00:34:12) Sponsors: Squad | Omneky

(00:38:12) AI Alignment Techniques

(00:42:38) The Sweet Spot of AI

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

The Open Source AI Question - Part 2 | Robert Wright & Nathan Labenz

Podcast summary created with Snipd AI

Quick takeaways

Deep dives

Transformative Potential of AI-powered VR and Risks of Advanced AI

Integration of Virtual Reality and AI in Future Technologies

Implications of AI in Smart Contracts and Dispute Adjudication

Challenges in Achieving AI Alignment and Need for Defensive Strategies

Knowledge Editing at Scale

Balancing Performance and Safety in AI Systems

Empowering individuals with AI in low-stakes disputes

SPONSORS:

CHAPTERS:

Get the Snipd
podcast app

AI-powered
podcast player

Discover
highlights

Save any
moment

Share
& Export

AI-powered
podcast player

Discover
highlights

"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

The Open Source AI Question - Part 2 | Robert Wright & Nathan Labenz

Podcast summary created with Snipd AI

Quick takeaways

Deep dives

Transformative Potential of AI-powered VR and Risks of Advanced AI

Integration of Virtual Reality and AI in Future Technologies

Implications of AI in Smart Contracts and Dispute Adjudication

Challenges in Achieving AI Alignment and Need for Defensive Strategies

Knowledge Editing at Scale

Balancing Performance and Safety in AI Systems

Empowering individuals with AI in low-stakes disputes

SPONSORS:

CHAPTERS:

Get the Snipdpodcast app

AI-poweredpodcast player

Discoverhighlights

Save anymoment

Share& Export

AI-poweredpodcast player

Discoverhighlights

Get the Snipd
podcast app

AI-powered
podcast player

Discover
highlights

Save any
moment

Share
& Export

AI-powered
podcast player

Discover
highlights