# Distilling System 2 into System 1

Authors: Ping Yu, Jing Xu, Jason Weston, Ilia Kulikov.

Uses outputs from a slower deliberative process as training data for a faster model, studying when System-2-like behavior can be compressed into direct prediction.

First public: 2024-07-08.
ArXiv initial submission: 2024-07-08.

[Original paper](https://arxiv.org/abs/2407.06023) · [Reading-list entry](https://latent-implicit-thinking.github.io/papers/2407.06023/)
[Preprint BibTeX](https://latent-implicit-thinking.github.io/papers/2407.06023/citation.bib) · [Preprint CSL-JSON](https://latent-implicit-thinking.github.io/papers/2407.06023/citation.csl.json) · [JSON record](https://latent-implicit-thinking.github.io/papers/2407.06023/record.json)

## Approaches

- [Internalized reasoning](https://latent-implicit-thinking.github.io/topics/internalized-reasoning/): Learn from worked solutions so that some or all of the reasoning can later happen without writing those steps. Training may use a separate teacher model or progressively remove written steps from the model being trained.

Summary and categories are editorial. Read the original paper to verify claims and limitations. A citation to a paper does not, by itself, establish that a later method builds on it.

Reading-list version 0.9.5; literature checked through 2026-10-18.