Reference library
LoRA: Low-Rank Adaptation of Large Language Models
Paper summary
LoRA freezes a pretrained model and learns low-rank additions to selected weight matrices. Experiments demonstrate parameter-efficient task adaptation with much smaller trainable state than full fine-tuning.
Relevance to the project
A structured update comparison if F or optional models later need constrained adaptation. Fixed base weights and trainable additions should remain explicit in provenance.
Low-rank updates may restrict useful changes; they are not adopted for F.
Source record
- Reference ID
- arxiv-2106-09685
- Archived version
- 2106.09685v2
- Summary provenance
- reference-library/papers/arxiv-2106-09685/metadata.json · summary
- Review status
- initial orientation summary; not a critical full-paper review
- Reading scope
- Selected abstract/opening and available closing discussion/conclusion passages in the preserved text extract; broader project notes provide context. No reproduction of experiments, exhaustive methods review, or equation/figure audit.