What is forecast calibration?

Definition

Forecast calibration compares groups of predictions with similar assigned probabilities against their observed outcomes. If events given a 70 percent chance occur roughly 70 percent of the time across a suitable set, those forecasts are calibrated at that level.

Scenarios without explicit probabilities can still be reviewed for timing and quantity error, but that is not full probabilistic calibration. Good practice preserves original claims, scores resolution consistently, and separates directional accuracy from exact dates and magnitudes.

Acronyms and aliases

prediction calibration synonymprobability calibration variant

Frequently asked questions

Can a calibrated forecaster still be wrong often?

Yes. A calibrated 70 percent forecast is expected to be wrong about 30 percent of comparable predictions.

Is directional accuracy the same as forecast calibration?

No. Directional accuracy can recognize the right trend while calibration evaluates whether stated probabilities match observed frequencies.

Videos explaining forecast calibration