What is prompt sensitivity?

Definition

AI prompt sensitivity occurs when wording, order, examples or surrounding context substantially affect model behavior. Casual prompts may understate capability, while highly tuned prompts can overstate how well the model handles ordinary use.

Evaluation should use several realistic prompt forms and preserve the harness and settings. Consistent performance across variations provides stronger evidence than one carefully selected prompt that produces an impressive answer.

ELI5

Prompt sensitivity describes how much an AI's answer changes when the instruction changes only a little. Wording, order, examples, and surrounding details can make the same model perform very differently.

For example, a model may solve a task after a carefully tuned prompt but fail when an ordinary user asks the same thing more casually. Testing several realistic versions shows whether the model is dependable or merely matched to one special prompt.

Why are AI models sensitive to prompts?

Models condition their output on token patterns, so wording, examples, order and context can change the inferred task.

How should prompt sensitivity be evaluated?

Repeat representative tasks with controlled prompt variations and compare success, quality and variance.

  1. Jack Roberts and Nick Saraev beside the words The Free Model Mystery
Definition card for prompt sensitivity: What is prompt sensitivity?

AI prompt sensitivity is the degree to which small changes in instructions or context alter a model's output or performance.