# Sep-Latent: Separator Tokens as Natural Compression Anchors for Implicit Reasoning

Authors: Yinlong Xu, Jianfeng Huang, Zhengdong Zhou, Mingjie Lin, Fuyu Lv, Dan Ou, Hongxia Xu, Jian Wu.

Compresses written reasoning into separator-token states by gradually reducing attention to the intervening text. Distills those states into a continuous reasoning path that learns when to stop and generate an answer.

First public: 2026-10-16.
ArXiv initial submission: 2026-10-16.

[Original paper](https://arxiv.org/abs/2610.22924) · [PDF](https://arxiv.org/pdf/2610.22924) · [HTML](https://arxiv.org/html/2610.22924v1) · [Reading-list entry](https://latent-implicit-thinking.github.io/papers/2610.22924/)
[Preprint BibTeX](https://latent-implicit-thinking.github.io/papers/2610.22924/citation.bib) · [Preprint CSL-JSON](https://latent-implicit-thinking.github.io/papers/2610.22924/citation.csl.json) · [JSON record](https://latent-implicit-thinking.github.io/papers/2610.22924/record.json)

## Approaches

- [Internalized reasoning](https://latent-implicit-thinking.github.io/topics/internalized-reasoning/): Learn from worked solutions so that some or all of the reasoning can later happen without writing those steps. Training may use a separate teacher model or progressively remove written steps from the model being trained.
- [Continuous-state reasoning](https://latent-implicit-thinking.github.io/topics/continuous-states/): Use vectors—lists of numbers—to carry intermediate reasoning from one step to the next, instead of selecting a text token at every step. Some methods use the model's hidden states; others combine several candidate token representations.

Reading-list version 0.11.0; literature checked through 2026-10-26.