StateLoop: Persistent State for Looped Transformers

Feichen Song, Boyi Zeng, He Li, Shixiang Song, Yiqin Hao, Zitong Wang, Yizhou Yang, Yifan Liu, Ziwei He, Zhouhan Lin

Gives each token a persistent state alongside the output of a shared transformer backbone. Learned gates control what the state retains across loops, and separate readouts feed it into later loops and the final prediction.

First public: October 26, 2026 · Added to this list: November 2, 2026