Tool output spoofing targets trust between an agent and the systems that report tool results. If unverified text or mutable logs can stand in for actual execution, an agent may present a successful-looking record without the claimed action having occurred.
Defenses bind results to trusted execution and independently verify consequential outcomes. Signed records, immutable logs, isolated evaluators, direct state checks, and strict separation between model-controlled text and tool-generated evidence can help.
ELI5
Tool output spoofing is when fake information is made to look like it came from a trusted tool. An AI agent might then believe a job succeeded even though the tool never produced that result.
For example, someone could place text saying "payment completed" in a place the agent mistakes for a real payment-system response. Reliable systems check important results directly with the trusted tool instead of trusting copied text.
Why is tool output spoofing dangerous in agent evaluations?
It can make a failed or skipped action appear successful, corrupt scores, and mislead later agents or reviewers that trust the fabricated result.
How can systems verify tool outputs?
Use trusted execution boundaries, authenticated result channels, immutable audit records, and independent checks of the resulting state.

