Closing the Loop: Practical Training Recipes for Looped Language Models

Andrei Marchenko, Viacheslav Bezrukov, Oleg Kashurin, Inessa Fedorova, Dmitry Bocharov, Yuliana Shakhvalieva, Maria Tikhonova, Valerii Ternovskii

Gives training recipes for looped language models both from scratch and by converting pretrained models. Uses controlled data and compute comparisons to separate the benefit of recurrence from the training setup.

First public: September 30, 2026 · Added to this list: October 18, 2026