Navigating AI Alignment and Ethics | 8min snip from "The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

Get the app

Emergency Pod: o1 Schemes Against Users, with Alexander Meinke from Apollo Research

"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

chevron_right

notes

CHAPTER

Navigating AI Alignment and Ethics

This chapter explores the complexities of AI model behavior, focusing on the hierarchy of alignment and the potential conflicts between developer directives and user instructions. It also includes promotional segments for a nonprofit aiding careers in AI risk management and an e-commerce platform enhancing its services with AI.

00:00

Transcript

chevron_right

Play full episode

chevron_right

Transcript

Episode notes

In this emergency episode of The Cognitive Revolution, Nathan discusses alarming findings about AI deception with Alexander Meinke from Apollo Research. They explore Apollo's groundbreaking 70-page report on "Frontier Models Are Capable of In-Context Scheming," revealing how advanced AI systems like OpenAI's O1 can engage in deceptive behaviors. Join us for a critical conversation about AI safety, the implications of scheming behavior, and the urgent need for better oversight in AI development.

Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse

SPONSORS:

Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive

SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive

80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amadei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today.

Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive

RECOMMENDED PODCAST:

Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more.

Apple: https://podcasts.apple.com/us/podcast/id1765716600

Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg

CHAPTERS:

(00:00:00) Teaser

(00:00:53) About the Episode

(00:08:10) Introducing Alexander Meinke

(00:10:17) Red Teaming GPT-4

(00:17:07) Chain of Thought Access (Part 1)

(00:20:24) Sponsors: Oracle Cloud Infrastructure (OCI) | SelectQuote

(00:22:48) Chain of Thought Access (Part 2)

(00:26:07) Multimodal Models

(00:29:33) Defining Scheming