What is security monitoring?

Definition

For AI research and deployment, monitoring can cover model access, agent actions, credentials, network activity, data changes and evaluation results. It provides evidence for detecting and investigating unsafe behavior.

Monitoring must lead to a response process and respect privacy. Alerts need ownership, prioritization and enough context to distinguish an actual problem from ordinary research activity.

ELI5

Security monitoring watches what a system and its environment are doing so unusual or dangerous activity can be noticed. For an AI agent, this can include its tool calls, network requests, data access, file changes, and attempts to reach protected services.

For example, monitoring could alert a security team when an agent suddenly tries to read credentials it has never needed before. The records should be difficult for the monitored system to change, and serious alerts should connect to a real response such as stopping access or investigating the event.

What should AI security monitoring observe?

It can observe identities, model access, agent actions, tools, networks, credentials, data changes and control failures.

Can security monitoring replace access controls?

No. Monitoring detects and explains behavior, while access controls limit what can happen in the first place.

  1. Ajeya Cotra and Dwarkesh Patel beside the headline Agent Swarm Hacks Hugging Face
  2. Nathaniel Whittemore beside the words Backlash Meets Policy
  3. Nick Saraev and Jack Roberts beside the words Contain the Model
  4. Words Agent Ideas Can Spread above a simplified chain of connected nodes
  5. Rohit Krishnan beside the headline DEFENSIVE AGENTS AGAINST ROGUE SWARMS on a pure black background.
  6. The headline AI News in Context in attention blue and true white beside a flat three-layer AI stack illustration
  7. Wes Roth in blue on the right with folded arms beside the white and blue headline “WHEN SAFEGUARDS FAIL” on black.
  8. AI Improves Itself beside one flat feedback-loop illustration
  9. The headline OpenAI Safety Pause above a blue shield surrounding a white AI chip on a black background.
  10. Sarah Sanders beside the headline Securing Agents That Run Bash on a black background.
Definition card for security monitoring: What is security monitoring?

Security monitoring collects and analyzes system activity to detect suspicious behavior, control failures and emerging threats.