pen Life Lab
Back to reference library

Reference library

Reinforced Self-Training (ReST) for Language Modeling

Paper summary

ReST alternates generating samples from a language policy and improving it using filtered data and offline reinforcement learning. Machine-translation experiments investigate efficient reuse of samples and established quality rewards.

Relevance to the project

An example of self-generated data within an externally evaluated update loop. Useful for separating data generation, selection, and retained parameter adaptation.

Language modelsLanguage model trainingReinforcement learning

Generating one's own samples does not make the reward criterion intrinsic.

Source record

Reference ID
arxiv-2308-08998
Archived version
arXiv preprint; retrieved version indicated in PDF
Summary provenance
reference-library/papers/arxiv-2308-08998/metadata.json · summary
Review status
initial orientation summary; not a critical full-paper review
Reading scope
Selected abstract/opening and available closing discussion/conclusion passages in the preserved text extract; broader project notes provide context. No reproduction of experiments, exhaustive methods review, or equation/figure audit.