ModelRefs / Foundation Model — AI Glossary
Foundation Model — AI Glossary
A large model trained on broad data at scale that can be adapted to a wide range of downstream tasks. Also called FM or pretrained model.
Overview
The term, coined by Stanford HAI (2021), captures models like GPT, Claude, Gemini, and Llama — trained on diverse internet-scale corpora and adapted via fine-tuning, RLHF, or prompting rather than retrained per task.
Reference details
| Topic | models |
|---|---|
| Also known as | FM, pretrained model |
| Last reviewed | 2026-06-24 |
Related terms
How it works
- One model is pretrained on broad data at scale, rather than many models trained per task.
- Capability is general enough that downstream tasks are reached by adaptation — prompting, retrieval, fine-tuning — instead of retraining.
- The term is modality-agnostic by design: vision, audio and multimodal models qualify on the same criteria as text models.
- Because many applications inherit from one model, its limitations and biases propagate to all of them, which is the concentration risk the term was coined to name.
- Adaptation cost is small relative to pretraining cost, which is what shifted the economics from per-task training to per-task prompting.
Example: Why the economics favour adaptation
Training a task-specific model needs labelled data, a training run and a maintenance commitment per task. Ten tasks is ten of each. Adapting one foundation model is ten prompts, or ten small fine-tunes, against one pretraining cost nobody in the chain paid again. The arithmetic is why the field reorganised around adaptation — and the same arithmetic is the concentration risk, because a flaw in the shared model is a flaw in all ten applications at once.
Commonly confused with
Foundation model describes breadth and adaptability — trained on broad data, useful across many downstream tasks, and not restricted to text. Base model describes a training stage: pretrained but not yet instruction-tuned. They are different axes, so an instruction-tuned assistant is still a foundation model and is no longer a base model.
When to use it
Reach for it when:
- Describing broadly capable models adapted to many tasks, across any modality.
- Explaining why applications now start from a pretrained model rather than a training set.
- Discussing concentration risk, where one model's limitations propagate downstream.
Reach for something else when:
- As a synonym for large language model, which is one modality within the category.
- As a synonym for base model, which describes training stage rather than breadth.
- For narrow task-specific models, however large.
Continue your research
Use these connected ModelRefs sections to compare alternatives, inspect implementation paths, and review the evidence and governance boundaries relevant to Foundation Model — AI Glossary.
Frequently asked questions
What is Foundation Model?
A large model trained on broad data at scale that can be adapted to a wide range of downstream tasks.
Is Foundation Model the same as FM?
Yes — FM, pretrained model are common aliases for Foundation Model.
What concepts are related to Foundation Model?
Closely related concepts include llm, pretraining, fine tuning.