What is iteration cost?

Definition

Iteration cost accounts for the resources used across the full refinement process, not only the final successful attempt. It can include model usage, tool execution, waiting time, reviewer effort, supplied assets, and the work needed to diagnose and correct failures.

Two workflows can reach similar final quality while having very different iteration costs. Recording those costs makes capability comparisons more realistic and helps users decide whether a process is practical for repeated use.

ELI5

Iteration cost is everything spent while trying again and improving a result. It includes more than money because each extra round can also use time and attention.

For example, an animation that needs six new prompts, two replacement images, and an hour of review has a higher iteration cost than one completed correctly after a single small correction.

What should be included in iteration cost?

Include computing and tool charges, elapsed time, human review, preparation of new inputs, and the cost of correcting failed attempts.

Why does iteration cost matter in model comparisons?

A strong final output may be impractical if it regularly requires many expensive or time-consuming corrections.

  1. A flat cursor illustration beside the headline Agents at Work
Definition card for iteration cost: What is iteration cost?

Iteration cost is the time, money, computing, and human effort consumed by repeated attempts to improve an AI result.