pen Life Lab
Back to reference library

Reference library

Self-Rewarding Language Models

Paper summary

Self-Rewarding Language Models generate their own preference judgments and train through iterative DPO. Experiments report improved instruction following and judging quality across a small number of iterations.

Relevance to the project

Relevant to how evaluative mechanisms change alongside behavior. Independent correctness or causal tests are needed to separate better judged outputs from real improvement.

Language modelsPreference learningLanguage model training

Read alongside reward-hacking evidence; self-judgment is not an independent ground truth.

Source record

Reference ID
arxiv-2401-10020
Archived version
arXiv preprint; retrieved version indicated in PDF
Summary provenance
reference-library/papers/arxiv-2401-10020/metadata.json · summary
Review status
initial orientation summary; not a critical full-paper review
Reading scope
Selected abstract/opening and available closing discussion/conclusion passages in the preserved text extract; broader project notes provide context. No reproduction of experiments, exhaustive methods review, or equation/figure audit.