New AI Model Shows Its Work: Evidence-Backed Video Question Answering

Shijie Wang, Honglu Zhou, Ziyang Wang, Ran Xu, Caiming Xiong, Silvio Savarese, Chen Sun, Juan Carlos Niebles · July 13, 2026

Current video AI models can answer questions about videos, but they often act as black boxes—giving answers without showing what they actually saw. Researchers from Salesforce and academia propose Evidence-Backed Video Question Answering (E-VQA), a new task where models must output both a semantic answer and precise spatio-temporal evidence: which time segments and which specific pixels (via tracked object masks) support the answer. To train and evaluate this, they created ST-Evidence, the first human-verified benchmark for pixel-level grounding in video QA. Testing top models revealed a surprising gap: high QA accuracy doesn't mean the model truly sees the relevant objects—scaling alone doesn't fix this. So they built ST-Evidence-Instruct, a 160k-scale dataset with automated generation pipelines, and fine-tuned a grounded Video LLM. The result? A 7B model achieved +27.2% improvement in temporal grounding and +13.8% in segmentation accuracy over baselines. This makes video AI more transparent and trustworthy—critical for applications like autonomous driving, surveillance, and assistive tech where knowing why an answer is given matters as much as the answer itself.