LoopKV: Loop-Aware KV Cache Compression for Serving Looped Transformers

Tianle Zhou, Yang Zhang, Tianyu Wu, Zhuohan Wang, William Nixon, Juncheng Yang

Allocates cache precision separately for each loop and layer, shares selected caches across loops, and reads low-attention values at lower precision to reduce the memory and latency of looped language models.

First public: November 3, 2026 · Added to this list: November 9, 2026