The Complexities of Corrigibility in AI

This chapter delves into the challenges of creating corrigible AI systems that adjust their goals with new information while optimizing existing objectives. It examines the distinction between optimizer and satisficer models and presents a thought-provoking scenario about human preferences and the difficulties of adapting them.