What is a language model?

Definition

Modern language models learn statistical patterns from large collections of data and use context to predict likely next tokens. That ability supports writing, question answering, coding and tool-oriented interfaces.

Fluent output is not proof of consciousness, agency or factual understanding. The same predictive process can produce useful statements and confident errors, so consequential uses need evidence, verification and appropriate supervision.

ELI5

A language model is an AI system trained to recognize patterns in text and other tokenized information. It uses those patterns to work out what kind of response is likely to fit the instructions and context it receives.

For example, a language model can write a plan and ask a specialist protein tool to evaluate a candidate. The useful result may come from the model, the tool, the supplied data, and later laboratory testing together, so the model should not receive credit for every part.

Acronyms and aliases

LM acronym

Frequently asked questions

How does a language model generate text?

It uses the current context to estimate possible next tokens and selects tokens repeatedly to form an output.

Does fluent language-model output prove consciousness?

No. Fluency shows effective language prediction, not evidence that the model has subjective experience.

Videos explaining language model