What is test-time adaptation?

Definition

Test-time adaptation is a family of methods that adjust a model during evaluation or deployment instead of leaving it completely fixed after training. The adjustment may use the current inputs, feedback or repeated attempts to improve performance on a new distribution or task.

The method can make benchmark progress difficult to attribute to scale alone. A result may reflect the model, the adaptation procedure, additional computation and the way researchers structured the test, so reports should describe the full experimental setup.

Acronyms and aliases

TTA acronym

Frequently asked questions

How is test-time adaptation different from training?

Conventional training happens before deployment on a prepared dataset. Test-time adaptation makes limited adjustments while the model encounters evaluation or real-world inputs, often without rebuilding the model from scratch.

Why can test-time adaptation improve benchmark results?

It can help a model adjust to the structure or distribution of the current task. The improvement belongs to the complete method, including adaptation and computation, not necessarily to the base model alone.

Videos explaining test-time adaptation