Where KV-Cache Error Lives in Looped Language Models: A Diagnostic Study of Ouro and Huginn
Measures how quantizing different loop-specific keys and values changes predictions in Ouro and Huginn. Tests sensitivity-based error estimates and bit allocations, distinguishing typical-sequence behavior from large errors concentrated in a few sequences.
First public: · Added to this list: November 2, 2026
Explore this approach
Recurrent reasoning — Repeat parts of the model or keep intermediate information in memory while working through a problem. Some methods also learn how many passes to run.
Analysis and evaluation — Measure how well these methods work, investigate what their internal computation does, and identify where they fail. This includes experiments, studies of model internals, and mathematical results.