AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Constitutional AI: A Strategy to Better Align Large Language Models
constitutional AI is designed to be a strategy to better align large language models. It's based on this constitution that the AI uses to self critique. So it evaluates the output of the first model, and then it writes a kind of corrected version of that output which is consistent with the constitution. And then the first model gets retrained on the corrected output. In general, it appears to work better than learning from human feedback.