Polymorphic Universal Transformer
Varies which feed-forward units are active across loops of a shared transformer and strengthens nonlinear attention. Studies how this affects hidden-state rank, depth scaling, and the computation needed for reasoning.
First public: · Added to this list: November 9, 2026
ACL Anthology release date. Date source.
Cite this paper
Published version
Polymorphic Universal Transformer
Yilong Chen, Zitian Gao, Yihao Xiao, Jason Klein Liu, Xinyu Yang, Yifan Luo, Tingwen Liu, Haoming Luo, Zhengmao Ye, Ran Tao, Bryan Dai
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2026, pp. 39001-39013.
Explore this approach
Recurrent reasoning — Repeat parts of the model or keep intermediate information in memory while working through a problem. Some methods also learn how many passes to run.
Analysis and evaluation — Measure how well these methods work, investigate what their internal computation does, and identify where they fail. This includes experiments, studies of model internals, and mathematical results.