Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Faster
Splits teacher rationales into chunks, then trains a student to skip chunks whose removal preserves the answer. The model retains key written steps while internalizing transitional or summary chunks.
First public: · Added to this list: November 2, 2026
Explore this approach
Internalized reasoning — Learn from worked solutions so that some or all of the reasoning can later happen without writing those steps. Training may use a separate teacher model or progressively remove written steps from the model being trained.