Reference library
Universal Transformers
Paper summary
Universal Transformers repeatedly apply a shared self-attention transformation across depth, with an option for adaptive computation. Experiments address limitations of fixed-depth sequence models and test algorithmic generalization.
Relevance to the project
A comparison for a shared mechanism applied repeatedly to state. Repetition depth and runtime stopping costs must remain explicit when considering GPU regularity.
Depth recurrence differs from the engine's temporal, externally coupled recurrence.
Source record
- Reference ID
- arxiv-1807-03819
- Archived version
- arXiv preprint; retrieved version indicated in PDF
- Summary provenance
- reference-library/papers/arxiv-1807-03819/metadata.json · summary
- Review status
- initial orientation summary; not a critical full-paper review
- Reading scope
- Selected abstract/opening and available closing discussion/conclusion passages in the preserved text extract; broader project notes provide context. No reproduction of experiments, exhaustive methods review, or equation/figure audit.