How to Loop Your Transformer: Loop Scaling, Specialization, and Parallel Inference

Chanakya Ekbote, Artidoro Pagnoni, Devendra Singh Sachan, Shruti Bhosale, Mike Lewis, Maryam Fazel-Zarandi, Shashank Rajput, Sujan Kumar Gonugondla

Compares which transformer blocks to repeat, how to give each repetition its own small adapter, and how to run loops in parallel during decoding. Separates the effects of state handoffs and shared attention caches across model sizes and compute budgets.

First public: October 29, 2026 · Added to this list: November 2, 2026