Patrick McKenzie (patio11) is joined by Emmett Shear, co-founder of Twitch, former interim CEO of OpenAI, who now runs Softmax AI alignment. Emmett argues that current AI safety approaches focused on "systems of control" are fundamentally flawed and proposes "organic alignment" instead—where AI systems develop genuine care for their local communities rather than following rigid rules.
–
Full transcript available here: www.complexsystemspodcast.com/ai-alignment-with-emmett-shear/
–
Sponsor: Mercury
This episode is brought to you by Mercury, the fintech trusted by 200K+ companies — from first milestones to running complex systems. Mercury offers banking that truly understands startups and scales with them. Start today at Mercury.com
Mercury is a financial technology company, not a bank. Banking services provided by Choice Financial Group, Column N.A., and Evolve Bank & Trust; Members FDIC.
–
Links:
–
Timestamps:
(01:26) Understanding AI alignment
(04:42) The concept of universal constructors
(13:45) AI's rapid progress and practical applications
(19:08) Sponsor: Mercury
(20:19) AI's impact on work
(34:59) AI's sensory and action space
(42:10) User intent vs. user request
(44:35) The illusion of a perfect AI
(49:57) Causal emergence and system dynamics
(55:19) Reflective and intentional alignment
(01:01:08) Engineering challenges in AI alignment
(01:04:15) The future of AI
(01:26:40) Wrap
