2min chapter

The Gradient: Perspectives on AI cover image

Jeremie Harris: Realistic Alignment and AI Policy

The Gradient: Perspectives on AI

CHAPTER

The Importance of Inner Alignment in AI

The challenge is how do you actually come up with an objective that is not subject to that kind of pathological optimization no matter what objective you encode. The easiest way to make that objective go up might look like hacking the system that stores the objective or convincing humans to do things in the physical world that increase the value of your goal. So this is a pretty fundamental and intrinsic difficulty of encoding what we want into these systems which needs to be stored somewhere. If you apply security mindset there's going to be a way to take those boxes that looks nothing like what we anticipate.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode