Skip to main content

Hierarchical Masked Diffusion Language Models

Parul Gupta, Satwik, Avni Aggarwal, Bhavesh Gurnani, Arnab Kumar Mondal, Dinesh Khandelwal, Dinesh Garg, Parag Singla

Predicts which masked positions should be filled first, then predicts their tokens with a hierarchy-aware diffusion model. Tests this ordering on text generation and Sudoku, where earlier solved cells can help determine later ones.

First public: · Added to this list: October 22, 2026

Cite this paper

ArXiv preprint

arXiv:2610.29255 · Initial submission: 2026-10-21

BibTeX · CSL-JSON

Explore this approach

Alternative generation methods — Change how intermediate steps are generated, revised, or searched—for example, by refining several steps in parallel. Some produce written chains of thought.