What is model routing?

Definition

Artificial intelligence model routing places a decision layer between an application and multiple available models. The router examines information such as task type, complexity, sensitivity, expected quality, latency target, and budget, then chooses an appropriate model or deployment path.

A routing policy can use fixed rules, learned classifiers, confidence estimates, or staged fallbacks. Effective routing reduces unnecessary use of expensive frontier systems while preserving access to them for requests that genuinely benefit from greater capability.

Acronyms and aliases

model routing synonymAI model routing variantartificial intelligence model routing variantmodel router variantmodel routers variant

Frequently asked questions

Why use an artificial intelligence model router?

A router can improve cost and responsiveness by sending routine work to efficient models and difficult work to more capable models.

Does artificial intelligence model routing require more than one provider?

No. Routing can choose among models from one provider, several providers, or a combination of hosted and self-managed deployments.

Videos explaining model routing