TreasureX Researchcs.AIReToken: One Token to Rule Them All in Visual Search
Yao Xiao, Reuben Tan, Zhen Zhu, Yuqun Wu, Jianfeng Gao, Derek Hoiem · July 30, 2026
Vision-language models (VLMs) like Qwen and InternVL are powerful, but they struggle when given a huge number of images or video frames. The more irrelevant 'distractor' images there are, the worse they perform, and processing all that visual data at once can blow up GPU memory. Researchers from UIUC and Google introduce ReToken, a clever fix: a single learnable 'token' that acts as a search query. After the model processes all images once (creating a cache), ReToken picks out only the most relevant visual tokens for the user's question. This slashes computation and boosts accuracy. Training only needs a small image-QA dataset, and it works on both images and videos. On the Visual Haystacks benchmark, ReToken improves Qwen3VL-8B by 13.4 points and InternVL3.5 by 12.4 points (over 20% relative gain). It even transfers to long videos without extra training, adding 8.0 points on LVBench. Because it's lightweight, training and long-video inference fit on a single H100 GPU. This could make VLMs far more practical for real-world tasks like searching through security footage, medical scans, or personal photo libraries, reducing cost and latency. For investors, this signals a trend toward efficient AI that does more with less, potentially lowering the barrier for edge deployment and cloud services.
This summary is based on the paper "ReToken: One Token to Improve Vision-Language Models for Visual Retrieval" by Yao Xiao et al., available on arXiv at https://arxiv.org/abs/2607.28627.
Educational content only, generated with AI assistance from public research abstracts. Not investment advice. Thank you to arXiv for use of its open access interoperability.