KV Cache Quantization for Diffusion Language Models
Calibrates diffusion-language-model cache quantization on intermediate masked states that match the decoding process. Keeps selected keys in high precision to preserve attention choices while quantizing the remaining keys and values.
First public: · Added to this list: November 2, 2026
Explore this approach
Alternative generation methods — Change how intermediate steps are generated, revised, or searched—for example, by refining several steps in parallel. Some produce written chains of thought.