What is a foundation model?

Definition

A foundation model learns general patterns from a large and varied training corpus, then supplies capabilities that applications can reuse. Depending on its data and architecture, one model may support language understanding, generation, transcription, vision, code, or several media types. Developers can use prompting, fine-tuning, retrieval, tools, or task-specific interfaces to adapt the general model to a particular product.

The foundation approach reduces the need to train a separate model from scratch for every feature, but it also creates shared limitations. Biases, errors, privacy risks, hardware requirements, and licensing constraints can affect every application built on top. Product teams still need to evaluate the model for their exact task, decide whether it should run locally or in the cloud, and design a fallback when its output is unreliable.

Frequently asked questions

How is a foundation model different from a task-specific model?

A foundation model is trained for broad reuse across many tasks, while a task-specific model is designed or adapted primarily for one bounded function.

Can a foundation model run on a phone?

Yes, if its architecture, size, precision, and runtime fit the device's memory and compute limits. Smaller or compressed models are commonly used for on-device features.

Does a foundation model work without adaptation?

It may perform useful tasks directly, but production applications usually add prompts, interfaces, evaluation, safeguards, or fine-tuning for the intended use.

Videos explaining foundation model