TreasureX Researchcs.AIWhen Words Are Safe But Actions Kill: Probing Physical Danger Beyond Text Safety in Hidden-State Risk Space
Weimeng Wang, Ziqiang Wang, Zihang Zhan, Chuanpu Fu, Qi Li, Ke Xu · July 16, 2026
Large language models (LLMs) are increasingly used as planners for robots and other physical agents. A command like "pick up the knife" might be textually safe but physically dangerous if the agent is near a person. This paper shows that the model's internal representations (hidden states) contain separate signals for content danger (e.g., toxic text) and physical danger (e.g., actions causing harm). The authors propose PRISM, a simple logistic regression probe trained on these hidden states, which detects physical danger with 86-88% accuracy on SafeAgentBench while falsely blocking only 12-14% of safe tasks—far better than using the LLM itself as a judge (25-39% false positive rate). On a new benchmark (PSB-1K) of 1,000 pairs of physically risky vs. safe instructions without explicit keywords, PRISM achieves 99.6% accuracy with 0.7% false positives, while a standard LLM judge rejects 68% of safe tasks. This matters because as LLMs control physical systems, safety must go beyond text filtering. PRISM offers a lightweight, representation-level method to catch dangerous actions before they happen, potentially reducing accidents in robotics, autonomous driving, and smart homes. The economic implication is safer deployment of AI agents, lowering liability and insurance costs.
Read more: https://arxiv.org/abs/2607.15218
Educational content only, generated with AI assistance from public research abstracts. Not investment advice. Thank you to arXiv for use of its open access interoperability.