What is risk assessment?

Definition

An assessment defines the system, the people or assets that could be affected, and the conditions under which harm could occur. Evidence can include testing, observed incidents and analysis of plausible failure paths.

The result depends on the available evidence and assumptions. Unknown or changing conditions can limit confidence, so an assessment should state its scope and be revisited when important facts change.

ELI5

Risk assessment asks what could go wrong, how likely it is and how serious the result could be. It also records what is uncertain.

For example, a team can examine whether a document assistant might expose a private file. They consider who could be affected and which controls reduce the chance or impact.

Is risk assessment a guarantee of safety?

No. It is a structured examination of risks under stated assumptions, not proof that every possible failure has been found.

Is likelihood the only factor?

No. A rare event can still matter when its consequences are severe, and uncertainty about either factor also matters.

  1. A warning symbol and research network beside the words AI Risk.
  2. Eugene Yan in a blue shirt beside the blue and white headline “AI FINDS CODE FLAWS” on a black background.
  3. Portraits of Nathaniel Whittemore, Erik Brynjolfsson, Demis Hassabis, Ramez Naam on a black background with the blue and white headline "AI OPTIMISM VS AI PESSIMISM".
    AI Optimism vs AI Pessimism
    The AI Daily Brief19m 36s1 VIEW
  4. Nick Beckstead beside the headline AI safety rules.
  5. Max Kanat-Alexander beside a headline about code quality.
  6. The words Local AI Keeps Files Private beside a portrait of Nate B Jones
  7. Shanu Mathew, Theo Jaffee and Sophia Dew in blue, navy and white tops against black beside the white and blue headline 'AI NEEDS MORE THAN CHIPS'.
  8. Theo Jaffee and Ketan Ramakrishnan on either side of the blue-and-white headline “SUPERVISION NEEDS EVIDENCE” against a black background.
  9. The words Pause the AI Race beside a flat pause symbol
  10. Melanie Warrick beside the headline Humans and Agents
Definition card for risk assessment: What is risk assessment?

Risk assessment identifies potential harmful outcomes and examines their likelihood, impact and uncertainty in a specified context. It provides evidence for deciding how a system should be managed.