From Interface to Inference: Eliciting Any-Order Inference from Any-Order Models
Preprint
Masked diffusion models advertise any-order generation, but then quietly decode left-to-right. Positional uncertainty is why, and insertion-based and latent-space masked diffusion are two ways out — a 7B FlexMDM for code and a 125M LatentMDM for GSM8K, freeing the model to decide where, not just what.
@article{kim2026interfaceinference,
title = {From Interface to Inference: Eliciting Any-Order Inference from Any-Order Models},
author = {Kim, Seunggeun and Kim, Jaeyeon and Lee, Taekyun and Chen, Yuyuan and Du, Yilun and Kakade, Sham and Chen, Sitan},
journal = {arXiv preprint arXiv:2607.26504},
year = {2026}
}