Reference library
Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data
Paper summary
Tests whether model collapse depends on replacing past training data. Language-model experiments confirm degradation under recursive replacement but find that retaining and accumulating real and synthetic data can avoid collapse in the studied settings.
Relevance to the project
A direct comparison for the earlier collapse paper: retained evidence and update history can change lineage outcomes. Useful if systems learn from outputs of predecessors.
The studied accumulation regimes do not guarantee safety for every synthetic-data mixture.
Source record
- Reference ID
- arxiv-2404-01413
- Archived version
- arXiv preprint; retrieved version indicated in PDF
- Summary provenance
- reference-library/papers/arxiv-2404-01413/metadata.json · summary
- Review status
- initial orientation summary; not a critical full-paper review
- Reading scope
- Selected abstract/opening and available closing discussion/conclusion passages in the preserved text extract; broader project notes provide context. No reproduction of experiments, exhaustive methods review, or equation/figure audit.