Welcome to the AI Safety Newsletter by the Center for AI Safety. We discuss developments in AI and AI safety. No technical background required. Listen to the AI Safety Newsletter for free on Spotify or Apple Podcasts.
In this newsletter, we explore two recent papers from CAIS. We’d also like to highlight that CAIS is hiring for editorial and writing roles, including for a new online platform for journalism and analysis regarding AI's impacts on national security, politics, and economics.
Utility Engineering
A common view is that large language models (LLMs) are highly capable but fundamentally passive tools, shaping their responses based on training data without intrinsic goals or values. However, a new paper from the Center for AI Safety challenges this assumption, showing that LLMs exhibit coherent and structured value systems.
Structured preferences emerge with scale. The paper introduces Utility Engineering, a framework for analyzing and controlling AI [...]
---
Outline:
(00:26) Utility Engineering
(04:48) EnigmaEval
---
First published:
February 18th, 2025
Source:
https://newsletter.safe.ai/p/ai-safety-newsletter-48-utility-engineering
---
Want more? Check out our ML Safety Newsletter for technical safety research.
Narrated by TYPE III AUDIO.
---
