What is compute performance per watt?

Definition

Compute performance per watt compares output with power use under defined conditions. For artificial intelligence inference, the output might be tokens per second, completed requests, or another workload-specific measure.

Meaningful comparisons use the same model, quality target, latency, batch size, precision, and power boundary. A headline ratio can mislead when one test omits host, memory, cooling, or idle consumption.

Acronyms and aliases

energy efficiency synonymperformance-per-watt variant

Frequently asked questions

Why does performance per watt matter for artificial intelligence?

Energy affects operating cost, cooling, data-center capacity, deployment density, and the environmental impact of serving models at scale.

Can performance-per-watt results be compared directly?

Only when the workload, output quality, latency, measurement boundary, hardware configuration, and software stack are sufficiently comparable.

Videos explaining compute performance per watt