Towards Looped Models Done Right, Part I: Topology, Input Injection, Recurrent-State Design
Compares where to place shared layers, how to reintroduce the input, and how to organize recurrent states in looped language models. Uses matched dense-model comparisons and a mixture-of-experts study to separate these design choices.
First public: · Added to this list: October 22, 2026
Explore this approach
Recurrent reasoning — Repeat parts of the model or keep intermediate information in memory while working through a problem. Some methods also learn how many passes to run.
Analysis and evaluation — Measure how well these methods work, investigate what their internal computation does, and identify where they fail. This includes experiments, studies of model internals, and mathematical results.