What is context pruning in artificial intelligence?

Definition

Long workflows can accumulate messages, retrieved documents and tool results that no longer help the current decision. Context pruning selects the information that remains relevant and omits repetition, stale state or detail that can be summarized safely.

Good pruning reduces token use and distraction without hiding critical constraints or evidence. It needs task-aware relevance, provenance and conservative handling of permissions, decisions and facts that later steps may still require.

Acronyms and aliases

context trimming synonym

Frequently asked questions

Why prune an artificial intelligence model's context?

Pruning can reduce token cost, latency and distraction from irrelevant or duplicated information.

What is the risk of context pruning?

Removing a critical requirement, decision or piece of evidence can make later model output incorrect or unsafe.

Videos explaining context pruning