Google has invested more time and effort into RLA-CHF than any other company. They've kind of lobotomized the system in the same way that we saw Microsoft lobotomize Bing chat shortly after it came out, he says. "I very much hope that's not the case this is part of the reason why I really wish opening I would release more information specifically about the alignment part of GPT-4"