Why AI Explanations Can Lie—and a Fix That Makes Them Tell the Truth

Hiskias Dingeto · July 22, 2026

A new paper reveals a flaw in how we test AI explanations: the standard reconstruction test—where an explanation is considered faithful if the AI's internal activation can be rebuilt from it—can be fooled. The test only checks the gist, not individual claims. Up to ~2% of specific claims in an explanation may be false yet still pass the test because they don't affect reconstruction. The authors propose RECAP, a training method that adds linear heads to the AI model to keep designated content decodable. RECAP makes explanations independently verifiable by probes. In tests, RECAP's probe detected lies with 96% accuracy, while the standard method dropped to near-chance (51%) when an adversary edited explanations to hide lies. The cost is tiny: +0.001 nats in loss. For investors, this matters because as AI is deployed in finance, law, and medicine, trusting explanations that can be gamed is risky. RECAP offers a way to make AI's internal reasoning more auditable, potentially reducing liability and improving safety.