TreasureX Researchcs.AIRethinking Classifier-Free Guidance in On-Policy Diffusion Distillation
Bingnan Li, Haozhe Wang, Haozhong Xiong, Fangtai Wu, Jinpeng Yu, Yang Shi, Jiaming Liu, Ruihua Huang · July 27, 2026
Diffusion models are powerful but slow. To speed them up, researchers use "on-policy distillation" (OPD), where a student model learns from a teacher by following the student's own generated paths. However, most diffusion systems rely on classifier-free guidance (CFG), which combines a positive and a negative branch to steer generation. The paper shows that naively matching the teacher's guided output in OPD can cause a problem called Negative Branch Asymmetry (NBA): the student may reduce error in the positive branch but increase error in the negative branch, leading to instability. To fix this, the authors propose Positive–Direction Matching (PDM), which separately constrains the positive prediction and the CFG direction. They apply PDM to video control tasks, where it makes distillation robust to different guidance scales. This matters because it could lead to faster, more reliable diffusion models for image and video generation, reducing computational costs and enabling real-time applications. Practical implications include cheaper AI art tools and better video generation for content creators.
Read more: https://arxiv.org/abs/2607.24731
Educational content only, generated with AI assistance from public research abstracts. Not investment advice. Thank you to arXiv for use of its open access interoperability.