Skip to main content

LTA-thinker: Latent Thought-Augmented Training Framework for Large Language Models on Complex Reasoning

Jiaqi Wang, Binquan Ji, Haibo Luo, Yiyang Qi, Ruiting Li, Huiyan Wang, Yuantao Han, Cangyi Yang, Jiaxu Zhang, Feiliang Ren

Trains a small transformer module to produce continuous thought vectors for a frozen language model. Aligns those vectors with the question and important solution steps; the language model then generates a written explanation and answer.

First public: · Added to this list: November 9, 2026

Cite this paper

ArXiv preprint

arXiv:2509.12875 · Initial submission: 2025-09-16

BibTeX · CSL-JSON

Explore this approach

Continuous-state reasoning — Use vectors—lists of numbers—to carry intermediate reasoning from one step to the next, instead of selecting a text token at every step. Some methods use the model's hidden states; others combine several candidate token representations.