TreasureX Researchcs.AIActive Vision Benchmark Reveals MLLMs Can't See Like Humans Do
Jiarui Zhang, Muzi Tao, Shangshang Wang, Ollie Liu, Xuezhe Ma, Willie Neiswanger · July 17, 2026
A new paper introduces ActiveVision, a benchmark designed to test whether multimodal large language models (MLLMs) can perform active observation—the continuous, hypothesis-driven redirection of gaze that humans use. Unlike standard vision-language tasks that rely on a single static description, ActiveVision forces models to repeatedly perceive visual information across 17 tasks. The results are stark: the best model, GPT-5.5, solved only 10.6% of items and scored zero on 11 tasks. Even Claude Fable 5, a top performer on reasoning and coding benchmarks, managed just 3.5%, while humans averaged 96.1%. The gap persists even when models write and run their own vision code, as such code fails on realistic imagery and catching errors requires the active perception the models lack. This suggests that current MLLMs lack robust active visual observation, highlighting the need for new architectures that close the perception-reasoning loop. For investors, this underscores that despite rapid progress, MLLMs still have fundamental limitations in perception, which could affect applications in robotics, autonomous driving, and any field requiring real-time visual interaction.
Read more: https://arxiv.org/abs/2607.16165
Educational content only, generated with AI assistance from public research abstracts. Not investment advice. Thank you to arXiv for use of its open access interoperability.