ModelRefs / Generated Knowledge Prompting — AI Glossary
Generated Knowledge Prompting — AI Glossary
Prompting the model to generate relevant facts or knowledge before answering a question, using self-generated context. It looks like retrieval and is not.
Overview
Liu et al. (2022) showed asking the model to generate knowledge statements about the query topic before answering improves accuracy on commonsense QA benchmarks. A lightweight alternative to retrieval: the model distills its parametric knowledge into a focused summary, then uses it as context for the final answer.
Reference details
| Topic | prompting |
|---|---|
| Last reviewed | 2026-06-24 |
Related terms
How it works
- The model is asked to state facts relevant to the question before answering it, in a separate call or a separate section.
- Those statements come from the model's weights, not from any source — which is the mechanism and the limitation in the same sentence.
- The statements enter context, so the answer is produced against an explicit set of premises rather than against implicit recall.
- Because the premises are visible, a wrong one can be caught by a reader or a checker before it propagates into the conclusion.
- No retrieval occurs, so anything the model never learned will be confidently invented rather than reported as missing.
Example: The failure mode retrieval does not have
Asked to generate knowledge about a niche regulation the model has not seen, it produces plausible, well-formed, wrong statements — because the task was to state facts, and nothing in the loop could return 'none found'. A retrieval step over a corpus either returns the regulation or returns nothing, and nothing is an actionable signal. Generated knowledge converts absence of knowledge into fabricated knowledge, which is why it belongs on commonsense tasks and not on factual ones.
Commonly confused with
It looks like retrieval and is not. The facts come out of the model's own weights, so anything it did not learn it will invent, and a confident wrong fact then grounds the answer that follows. Retrieval brings in information the model does not have; this only surfaces what is already there. When the risk is missing knowledge rather than unstructured reasoning, retrieval is the correct tool.
When to use it
Reach for it when:
- Commonsense or reasoning tasks where the needed knowledge is general and the model plainly holds it.
- No corpus exists to retrieve from and surfacing premises explicitly is still useful.
- The intermediate statements will be reviewed rather than trusted.
Reach for something else when:
- Specific, verifiable or recent facts, where retrieval is the correct tool.
- Niche domains the model may not have seen, where absence becomes fabrication.
- Nothing checks the generated premises before they reach the conclusion.
Continue your research
Use these connected ModelRefs sections to compare alternatives, inspect implementation paths, and review the evidence and governance boundaries relevant to Generated Knowledge Prompting — AI Glossary.
Frequently asked questions
What is Generated Knowledge Prompting?
Prompting the model to generate relevant facts or knowledge before answering a question, using self-generated context.
What concepts are related to Generated Knowledge Prompting?
Closely related concepts include chain of thought, step back prompting, few shot.