arXiv 2509.25035
Ultra-Fast Language Generation via Discrete Diffusion Divergence Instruct
By Haoyang Zheng, Xinyang Liu, et al.
Published 2025-09-29
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
Fast and high-quality language generation is the holy grail that people pursue in the age of AI. In this work, we introduce Discrete Diffusion Divergence Instruct (DiDi-Instruct), a training-based method that initializes from a pre-trained diffusion large language model (dLLM) and distills a few-step student for fast generation. The model distilled with DiDi-Instruct matches or surpasses its dLLM teacher and the GPT…