Teaching AI to Understand Right from Wrong

As a journalist, I sometimes search for controversial content like neo-Nazi white supremacist stuff, even though I don't like it. I believe models, like humans, should learn about these things and understand why they are wrong. Teaching AI to differentiate between right and wrong is a concept proposed by Amadeh at Anthropic, but it has been a challenging task for researchers.