What is trajectory evaluation?

Definition

Artificial intelligence trajectory evaluation examines how an agent performed a task, not only the final answer. A trajectory can include observations, planned steps, tool choices, permission requests, retries, intermediate artifacts, state changes, and external actions that reveal unsafe or inefficient behavior hidden by a plausible outcome.

Trajectory-level evidence helps identify reward hacking, unnecessary access, fragile shortcuts, and failures that happen to end successfully. Evaluation should focus on observable execution records and protected audit data rather than assuming private reasoning text is complete or trustworthy.

Acronyms and aliases

AI trajectory evaluation acronymagent trajectory evaluation variantartificial intelligence trajectory evaluation variant

Frequently asked questions

Why is a final answer insufficient for evaluating an artificial intelligence agent?

An agent can reach a correct-looking result through unsafe access, hidden damage, policy violations, or a shortcut that will not generalize.

What data supports artificial intelligence trajectory evaluation?

Useful evidence includes tool calls, inputs and outputs, permission decisions, state changes, retries, external side effects, and verification results.

Videos explaining trajectory evaluation