What is tool routing?

Definition

An application can rank tool descriptions, apply fixed rules or ask a classifier to choose a shortlist. It then passes the selected tool definitions to the agent or invokes the selected tool itself.

A shortlist can cut repeated context and reduce irrelevant choices. An evaluation should check whether the correct tool is retrieved, how the system reacts when it is missing and how much overhead the routing adds.

ELI5

For example, a workplace assistant could show calendar tools for a meeting request and inventory tools for a stock question. A long menu of unrelated tools would add work for each request.

If the shortlist leaves out the needed tool, the system can ask for clarification or search a larger list within its existing permissions.

How does tool routing differ from tool calling?

Routing chooses or narrows the available capabilities. Calling runs an authorized tool with its required inputs.

Do small tool collections need routing?

Often a short, stable list can be presented directly. Routing is more useful when the full catalogue is large or filtered by task and permissions.

  1. Sohail Shaikh and Ankush Rastogi in plain T-shirts beside the words Agent Tool Routing on black.
Definition card for tool routing: What is tool routing?

Tool routing selects which tools an AI system can consider or call for a particular task.