Skip to main content

Diffusion Language Models Change Speed Across Tasks and Languages

Mohsen Fayyaz, Ali Modarressi, Daniel Israel, Lucas Bandarkar, Nanyun Peng

Measures how many forward passes diffusion language models spend per output token across tasks and languages. Relates this cost to output copying and novelty, and tests whether answer-decoding speed can improve voting over sampled math answers.

First public: · Added to this list: October 22, 2026

Cite this paper

ArXiv preprint

arXiv:2610.25835 · Initial submission: 2026-10-19

BibTeX · CSL-JSON

Explore this approach

Alternative generation methods — Change how intermediate steps are generated, revised, or searched—for example, by refining several steps in parallel. Some produce written chains of thought.

Analysis and evaluation — Measure how well these methods work, investigate what their internal computation does, and identify where they fail. This includes experiments, studies of model internals, and mathematical results.