Masked Diffusion LLMs Fail on Reasoning Tasks Due to Commitment Order
A recent study published on arXiv (2608.05687) indicates that masked diffusion language models (dLLMs), capable of committing tokens in any sequence, struggle with reasoning tasks. Research involving LLaDA-8B demonstrates that unrestricted decoding often results in the final answer being committed prematurely (15-24% of the trajectory), while a significant portion of the reasoning area remains masked. Consequently, answer-only outputs occur in up to 90% of cases as the canvas expands. The challenge lies not in the model's termination beliefs but in reachability—whether the sampler can operate on those beliefs at far-off positions. A 2x2 prompt-decoder framework reveals that chain-of-thought benefits only under ordered commitment, showing an interaction increase of +34.8 percentage points (95% CI [26.8, 42.8]). The study further dissects this interaction, shedding light on the shortcomings of dLLMs in reasoning tasks.
Key facts
- Masked diffusion language models (dLLMs) commit tokens in any order
- Unconstrained decoding on LLaDA-8B commits final answer at 15-24% of trajectory
- Half of reasoning region remains masked during early commitment
- Collapses to answer-only outputs on up to 90% of problems as canvas grows
- EOS pressure is nearly identical across decoders
- Chain-of-thought helps only under ordered commitment
- Interaction of +34.8 percentage points (95% CI [26.8, 42.8])
- Study decomposes the interaction between prompt and decoder
Entities
Institutions
- arXiv