What is long-context artificial intelligence model?
Definition
A long-context artificial intelligence model has a context window designed to hold a large sequence of input and generated tokens. This can let the model consider an extended conversation, multiple documents, or a sizeable codebase without manually splitting every task into small independent prompts.
A larger advertised window does not guarantee that every part of the input will be used equally well. Attention cost, retrieval accuracy, positional encoding, memory use, and the tendency to overlook details in the middle of long inputs all affect practical performance. Efficient attention and careful evaluation are therefore important parts of long-context design.
Acronyms and aliases
long-context AI model variantlong-context model variant
General terms
Related terms
Frequently asked questions
What can a long-context model be used for?
It can analyze long documents, maintain extended conversations, compare multiple sources, or reason across a larger body of code within one request.
Does a larger context window always improve an answer?
No. Irrelevant input can distract the model, and some models fail to retrieve or use information consistently across the full advertised window.
Videos explaining long-context artificial intelligence model
