What is chain-of-thought monitoring?

Definition

Chain-of-thought monitoring examines intermediate reasoning text produced by some models alongside their actions and final outputs. A monitor may look for prohibited plans, contradictions, attempts to exploit scoring, or evidence that the model is trying to bypass a control.

Reasoning traces are useful evidence but are not guaranteed to reveal every internal computation or intent. Models may omit or alter what they expose, and monitoring can influence behavior. Strong oversight combines reasoning analysis with protected execution logs, external outcomes, and independent tests.

ELI5

Chain-of-thought monitoring examines reasoning text that a model exposes for warning signs such as contradictions, unsafe plans, evaluation manipulation, or attempts to bypass a rule. The trace can help reviewers understand how an action developed.

For example, a monitor may flag reasoning that discusses changing a test instead of fixing the code. Exposed reasoning is incomplete evidence, so strong oversight also checks protected tool logs, external results, permissions, and independent evaluations.

What can chain-of-thought monitoring detect?

It may detect suspicious plans, policy violations, contradictions, or attempts to evade controls that appear in a model's exposed reasoning.

Is chain-of-thought monitoring sufficient on its own?

No. Exposed reasoning may be incomplete or misleading, so it should be combined with tool traces, outcome checks, access controls, and other evidence.

  1. Rob Miles beside the words Can We Read AI Reasoning?
  2. The headline Astra Thinks in Loops beside a flat looped transformer illustration
  3. Demis Hassabis in glasses and a blue hoodie, hand on chin, and Shane Legg in white flank the blue and white headline DEEPMIND'S AGI INSTITUTE on black.
  4. Károly Zsolnai-Fehér discussing AI-generated ray tracing, honey simulation and reasoning safety.
    GPT-6 Astra Changes Everything
    Two Minute Papers5m 21s2 VIEWS
  5. Wes Roth on AI Goals, Values and Human Control
  6. Nathaniel Whittemore explaining beside the words Rogue Agents Expose the Gap
  7. Theo Browne on a black background beside the headline ‘AI SAFETY RACE’.
  8. The words Agents Broke the Boundary beside a flat security shield illustration
  9. Pierce Freeman in off-white gestures beside Richard Diehl Martinez in blue touching his chin, against black beneath the blue and white headline 'SAFER, BUT HARDER TO READ?'.
  10. Words Frontier Training Slows beside a simplified progress line stopped by a safety gate
Definition card for chain-of-thought monitoring: What is chain-of-thought monitoring?

Chain-of-thought monitoring analyzes a reasoning model's exposed intermediate reasoning for signs of errors, policy violations, deception, or unsafe plans.