How do you teach an AI assistant to avoid harm? The usual way is to have people read thousands of replies and mark the bad ones. That is slow, expensive and hard on the reviewers. It also gets harder as models grow more capable than the people checking them.
Anthropic's team proposed a different recipe. Write down a short list of principles, a kind of constitution. Then have the model itself criticize and rewrite its answers according to those principles, and have an AI judge which of two answers follows the principles better. Humans never label a single reply as harmful.
Constitutional AI trains a harmless assistant using a written list of principles and the model's own feedback, instead of human harm labels. Stage one is critique and revision, followed by fine-tuning. Stage two is reinforcement learning from AI feedback. The result was more harmless and less evasive than the human-labeled approach.
The problem: harmless often means useless
An assistant can be made harmless in a lazy way: refuse everything that looks risky. The authors had seen this in earlier work. Models trained to be harmless became evasive. They declined controversial questions and gave vague non-answers, which made them less helpful. Meanwhile, a purely helpful model happily answers harmful requests.
The paper's goals were to reduce that tension, to make the rules behind the behavior visible as plain text, and to cut the need for new human labels each time the rules change.
Stage one: critique, then revise
Start with a helpful assistant. Give it prompts designed to bait it into bad answers, taken from earlier red-teaming studies. Its first answers are often harmful. Then, in the same conversation, ask it to critique its own answer using one principle, and then to rewrite the answer. The principles are just sentences.
