ModelRefs / Hybrid Search — AI Glossary
Hybrid Search — AI Glossary
A retrieval strategy that fuses lexical (BM25 keyword) and semantic (vector embedding) signals for better recall.
Overview
Hybrid search recovers exact-match recall that pure vector search misses (product codes, names, rare terms) while keeping semantic generalization for paraphrase. Reciprocal Rank Fusion (RRF) is the most common fusion method.
Reference details
| Topic | rag |
|---|---|
| Last reviewed | 2026-06-24 |
Related terms
How it works
- Two retrievers run over the same corpus and return their own ranked lists, which cannot be combined by score because a cosine similarity and a BM25 score are not on a common scale.
- Reciprocal Rank Fusion solves this by discarding the scores entirely and using only the position: each document scores one over a constant plus its rank in each list, and the sums are added.
- With the usual constant of 60, a document ranked first in one list and tenth in the other scores 1/61 + 1/70 ≈ 0.0307, while a document ranked third in both scores 1/63 + 1/63 ≈ 0.0317.
- So consistent mid-rank agreement outranks one strong placement paired with a weak one, which is the behaviour the method is chosen for — corroboration across retrievers is treated as evidence.
- The constant controls how sharply early ranks dominate: a smaller value weights the top positions more heavily, and raising it flattens the contribution of rank differences.
- Because fusion reads only ranks, either retriever can be replaced or retuned without renormalising anything — and equally, a retriever returning plausible-looking rubbish at rank one is given full weight by construction.
Example: The query each half gets wrong
Search “ORA-01555 snapshot too old”. Dense retrieval embeds it near general database-error text and may return the wrong code. BM25 matches the literal string and nails it. Now search “why does my long-running report keep failing” — BM25 finds nothing useful because the document never uses those words, and dense retrieval finds it immediately. Hybrid runs both and fuses the rankings, which is why production retrieval rarely picks a side.
Commonly confused with
Hybrid search is not simply running two searches and concatenating results. The fusion step is the substance: two rankings with incomparable score scales have to be combined into one order. Reciprocal Rank Fusion is common precisely because it uses rank position and ignores the raw scores, which are not on the same scale.
When to use it
Reach for it when:
- Queries mix natural language with identifiers, codes or product names
- Either method alone shows recall gaps you can point at in evaluation
- You can afford two index lookups per query
Reach for something else when:
- Queries are uniformly one kind — all lexical or all conversational
- You have not measured which half is failing; hybrid can mask a fixable retriever
- Latency budget will not absorb a second search plus fusion
Referenced by
This term is used by the following ModelRefs references:
Where this appears on ModelRefs
Continue your research
Use these connected ModelRefs sections to compare alternatives, inspect implementation paths, and review the evidence and governance boundaries relevant to Hybrid Search — AI Glossary.
Frequently asked questions
What is Hybrid Search?
A retrieval strategy that fuses lexical (BM25 keyword) and semantic (vector embedding) signals for better recall.
What concepts are related to Hybrid Search?
Closely related concepts include bm25, semantic search, reranker, reciprocal rank fusion.