TreasureX Researchcs.AIAI Judges for Computer Agents: A New Test Reveals They're Too Lenient
Qiushi Sun, Kanzhi Cheng, Yian Wang, Bowen Yang, Hang Yan, Liheng Chen, Fangzhi Xu, Zichen Ding, Nuo Chen, Jialin Cao, Xingdong Gong, Zehao Li, Kaiming Jin, Xinfeng Yuan, Zhoumianze Liu, Jingyang Gong, Zhangyue Yin, Jiahui Gao, Zhiyong Wu, Tianbao Xie, Jianbing Zhang, Ben Kao, Lingpeng Kong · July 30, 2026
Computer-using agents (CUAs) are AI systems that can navigate websites, click buttons, and type text to complete tasks like booking flights or filling out forms. To train and evaluate these agents, developers often rely on vision-language models (VLMs) to judge whether the agent's actions actually accomplished the goal. But are these AI judges trustworthy? A new paper introduces OSReward, a benchmark designed to test the reliability of VLM judges on realistic computer-use trajectories. The results are sobering: even the best models show a systematic leniency bias, often labeling failed attempts as successful. While some commercial models are accurate, they're too expensive for large-scale use, and cheaper open-source models lag behind. To address this, the authors release OS-Shepherd-100K, a dataset of reasoning-annotated trajectory judgments, and train OS-Shepherd (9B and 35B), open reward models that match commercial quality at 30-60% lower cost. This matters because reliable, affordable AI judges are crucial for scaling up agent training and evaluation, potentially accelerating the development of more capable digital assistants. For investors, this highlights the growing importance of efficient AI evaluation tools as the market for AI agents expands. Read the paper: https://arxiv.org/abs/2607.28609
Educational content only, generated with AI assistance from public research abstracts. Not investment advice. Thank you to arXiv for use of its open access interoperability.