What is model training?

Definition

Artificial intelligence model training repeatedly presents examples or tasks, measures the model's output against an objective and updates learned parameters to reduce error or improve reward. The procedure can include pretraining, supervised learning, reinforcement learning and later adaptation stages.

Training quality depends on much more than the quantity of computation. Data selection, task order, objective design, optimization and evaluation all shape the resulting behavior. A strong training method can help a comparatively compact model use its available parameters more effectively.

Acronyms and aliases

AI model training synonymmodel training synonymartificial intelligence model training variant

Frequently asked questions

What is changed during AI model training?

An optimization process changes the model's learned parameters based on an objective, while developers may also adjust data mixtures, task schedules and training settings.

Why can training method matter more than model size?

A carefully designed training process can teach a model to use its capacity efficiently, while a larger model trained on weak data or objectives may perform worse on relevant tasks.

Videos explaining model training