Skip to main content

LooM: Loop-Invariant Memory for Causal Encoder-Decoder Language Models

Lele Yang, Muxi Diao, Zhonghao Yan, Jiankang Chen, Bin Wen, Tingting Gao, Wentao Zhang, Kongming Liang, Zhanyu Ma, Weiran Xu

Reuses a fixed memory bank while decoder layers repeat their reads. Each token writes its local cache once, allowing different recurrent-depth budgets without increasing the stored cache size.

First public: · Added to this list: November 9, 2026

Cite this paper

ArXiv preprint

arXiv:2611.06835 · Initial submission: 2026-11-04

BibTeX · CSL-JSON

Explore this approach

Recurrent reasoning — Repeat parts of the model or keep intermediate information in memory while working through a problem. Some methods also learn how many passes to run.