What is a context window?

Definition

The context may contain instructions, conversation, documents, multimodal input and generated output. A large limit lets more information fit but can increase latency, cost and memory demand.

A headline token count does not show how reliably the model uses distant details. Practical evaluation should test retrieval and reasoning across the claimed range with realistic projects and distractions.

ELI5

A context window is the amount of information an AI model can consider at one time. It can include the current request, earlier conversation, documents, instructions, and results returned by tools.

For example, if a long software project no longer fits, the system may keep the requirements and recent changes while summarizing older discussion. A larger window holds more, but filling it with irrelevant material can still confuse the task.

Acronyms and aliases

context length synonymAI context window variant

Frequently asked questions

Does a one-million-token context window guarantee useful recall?

No. It describes capacity, while retrieval and reasoning tests show whether distant information is used reliably.

What costs can grow with context length?

Memory use, processing time and provider charges can increase as more tokens enter the request.

Videos explaining context window

  1. Jack Roberts and Nick Saraev beside the words The Free Model Mystery
  2. GLM 5.3 Flash - Local Sweet Spot beside a flat layered model block with a small active core
  3. A flat hidden model card beside the words OX Alpha Is Probably GLM
  4. Memory Hungry - Compute Light beside a flat memory stack feeding sparse compute nodes
  5. David Ondrej and Ahmad M. Osman beside the words Own Your AI Compute
  6. Portrait of Bijan Bowen beside the words Ox Alpha Shows Promise
  7. The words Claude Code Ships Fast beside flat feature tiles and a usage gauge
  8. Bijan Bowen beside the words HY4 Preview Tested