MeanFlowNFT: Making Fast Image Generators Learn from Rewards
Yushi Huang, Xiangxin Zhou, Jun Zhang, Liefeng Bo, Tianyu Pang · July 16, 2026
Key Idea
MeanFlow generators create images or videos in just a few steps by predicting average velocities over time intervals. This makes them fast and efficient. Now, researchers have combined them with reinforcement learning (RL) to align outputs with human preferences or specific goals. The challenge was that existing RL methods for diffusion models optimize instantaneous velocities, while MeanFlow uses average velocities. The new method, MeanFlowNFT, bridges this gap by building an auxiliary predictor that estimates instantaneous velocities from the average ones. This allows standard RL objectives to be applied, while sampling still uses the fast average-velocity approach.
Why It Matters
This work enables fine-tuning of fast few-step generators using reward signals, which is crucial for practical applications like generating images that match user tastes or adhere to safety guidelines. It also provides a theoretical guarantee that the policy improves with each step.
Practical/Economic Implications
MeanFlowNFT can improve the quality of generated content while keeping generation fast and cheap. In experiments, it outperformed previous RL-tuned few-step models on most metrics and even beat multi-step RL-tuned diffusion models using far fewer steps. This could reduce computational costs for content creation, making high-quality AI-generated media more accessible.
Read the original paper on arXiv: https://arxiv.org/abs/2607.15273
Educational content only, generated with AI assistance from public research abstracts. Not investment advice. Thank you to arXiv for use of its open access interoperability.