Reference library
Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models
Paper summary
SPIN iteratively contrasts model-generated responses with retained human demonstrations. Starting from a supervised model, self-play-based fine-tuning improves evaluated responses without collecting new annotations at each iteration.
Relevance to the project
Highlights that self-generated training can still depend on an external reference distribution. Useful for the behavioral-origin record and synthetic-data controls.
Absence of new labels does not imply absence of human-origin supervision.
Source record
- Reference ID
- arxiv-2401-01335
- Archived version
- arXiv preprint; retrieved version indicated in PDF
- Summary provenance
- reference-library/papers/arxiv-2401-01335/metadata.json · summary
- Review status
- initial orientation summary; not a critical full-paper review
- Reading scope
- Selected abstract/opening and available closing discussion/conclusion passages in the preserved text extract; broader project notes provide context. No reproduction of experiments, exhaustive methods review, or equation/figure audit.