pen Life Lab
Back to reference library

Reference library

Overcoming catastrophic forgetting in neural networks

Paper summary

Elastic weight consolidation protects earlier tasks by slowing changes to parameters estimated to be important for them. Sequential-task experiments show improved retention compared with unrestricted learning.

Relevance to the project

A comparison for useful lifetime adaptation versus forgetting. The project could measure retained capabilities after environmental change before deciding on any protection mechanism.

Continual learningLearning and adaptationMemory

Task boundaries and importance estimation are supplied by the training setup.

Source record

Reference ID
arxiv-1612-00796
Archived version
arXiv preprint; retrieved version indicated in PDF
Summary provenance
reference-library/papers/arxiv-1612-00796/metadata.json · summary
Review status
initial orientation summary; not a critical full-paper review
Reading scope
Selected abstract/opening and available closing discussion/conclusion passages in the preserved text extract; broader project notes provide context. No reproduction of experiments, exhaustive methods review, or equation/figure audit.