Reference library
Constitutional AI: Harmlessness from AI Feedback
Paper summary
Trains assistants using self-critiques, revisions, and AI-generated preferences guided by a human-written constitution. Supervised and reinforcement-learning stages shift behavior without human harmlessness labels for each example.
Relevance to the project
An example for the behavioral-origin catalog: feedback can be model-generated while its evaluative principles remain externally supplied.
Model-produced judgments do not establish internally originating norms.
Source record
- Reference ID
- arxiv-2212-08073
- Archived version
- arXiv preprint; retrieved version indicated in PDF
- Summary provenance
- reference-library/papers/arxiv-2212-08073/metadata.json · summary
- Review status
- initial orientation summary; not a critical full-paper review
- Reading scope
- Selected abstract/opening and available closing discussion/conclusion passages in the preserved text extract; broader project notes provide context. No reproduction of experiments, exhaustive methods review, or equation/figure audit.