Skip to main content

PBPO: Prefix-Block Policy Optimization for Diffusion Language Models

Katherine Tieu, Dongqi Fu, Si Zhang, Hanqing Zeng, Tianxin Wei, Chenglin Wei, Yinglong Xia, Hong Li, Jingrui He

Trains diffusion language models with policy updates conditioned on completed prefix blocks. Applies importance weights and clipping to individual tokens within each block, avoiding the unstable product of all token ratios.

First public: · Added to this list: November 9, 2026

Cite this paper

ArXiv preprint

arXiv:2611.07783 · Initial submission: 2026-11-05

BibTeX · CSL-JSON

Explore this approach

Alternative generation methods — Change how intermediate steps are generated, revised, or searched—for example, by refining several steps in parallel. Some produce written chains of thought.