Skip to main content

Curriculum Learning Teaches LLMs Long-Horizon Implicit Reasoning, Up To A Limit

Jimson Huang, Maxwell Nickell, Ruowang Zhang, Abulhair Saparov

Trains models to select the next step of a proof without writing intermediate reasoning, gradually increasing required lookahead and the number of attribute labels. Studies how training compute, model size, initialization, and curriculum steps affect learned lookahead and transfer to other reasoning tasks.

First public: · Added to this list: October 22, 2026

Cite this paper

ArXiv preprint

arXiv:2610.25612 · Initial submission: 2026-10-19

BibTeX · CSL-JSON

Explore this approach

Analysis and evaluation — Measure how well these methods work, investigate what their internal computation does, and identify where they fail. This includes experiments, studies of model internals, and mathematical results.