Updated
Updated What changed on
- Added Ahrefs' March 2026 study of 4 million AI Overview URLs, which shows how far the retrieval set has moved away from the ranking set.
- Added the finding that 18.2% of AI Overview citations which do not rank in the top 100 are YouTube URLs.
What is RAG and why it matters for SEO?
The 30-second answer
RAG (Retrieval-Augmented Generation) is the architecture behind AI Overviews, Perplexity, ChatGPT Search and most modern AI engines. The system retrieves relevant documents first, then generates an answer grounded in those documents. Your SEO work decides whether you make it into the retrieval set; your content structure decides whether you get cited from it. Google's own May 2026 AI Optimisation Guide names RAG plus query fan-out as the underlying mechanics.
What retrieval actually selects
of pages cited in Google AI Overviews also rank in the top 10 for that query.
How it was measured: 863,000 keyword SERPs and 4 million AI Overview URLs. Ahrefs measures the top 10 as blocks, counting ads, featured snippets and video packs as separate blocks.
was the same measurement in July 2025, so the overlap between ranking and being cited has roughly halved in eight months.
How it was measured: 1.9 million citations from 1 million AI Overviews. Ahrefs notes it improved its parsing between this study and the 2026 update, so part of the change may be measurement rather than behaviour.
How RAG works, briefly
Three stages, simplified:
- Retrieve. The system searches an index for documents relevant to the query. For AI Overviews this is Google's search index. For Perplexity, its own real-time crawl. For ChatGPT Search, OAI-SearchBot plus Bing.
- Augment. The retrieved documents are fed into the model's context as grounding material.
- Generate. The model composes an answer using both its training knowledge and the retrieved documents, then cites the documents it leaned on.
Primary sources worth reading direct: the foundational Lewis et al. 2020 RAG paper (Facebook AI Research, now Meta), AWS's RAG explainer, IBM Research's overview, NVIDIA's plain-English version, and the actively-maintained LlamaIndex GitHub repo if you want to read the code.
Why this matters for SEO
The retrieve stage is the SEO stage. If your page does not rank well enough on the underlying index to be retrieved, the generate stage never even sees it. Ahrefs' 2026 research on AI Overviews confirmed this empirically - a Spearman correlation of 0.65 between rank position and AIO citation share, with top-3 pages roughly 30x more likely to be cited per-page than 11-30.
The augment + generate stages reward content the model can lift cleanly: self-contained passages, structured answers, clear topical depth. A page that retrieves but cannot be cleanly extracted gets bypassed for a cleaner source.
What content patterns RAG retrieves and cites cleanly
- Self-contained passages of 100-200 words. Each answers one question without back-references to earlier paragraphs.
- Pages structured around discrete questions and answers. FAQ format suits RAG well.
- Tables and lists. Extracted as structured facts rather than paraphrased.
- Named-expert author + Person schema. Helps the generate stage decide which retrieved source to credit.
- Content with clear topical depth. Thin pages get retrieved less often even when they technically match the query.
What does NOT work well in RAG
- Long prose-only pages with the answer buried in paragraph six.
- Pages built around marketing voice rather than direct answers.
- Content that depends on JavaScript for the answer to render (AI crawlers do not render JS).
- Pages with the relevant information spread across multiple URLs the user has to traverse.
Practical implication
RAG turns SEO into a two-stage game. Stage one: rank well enough to be retrieved. Stage two: structure content so the generation stage cites you rather than the next page in the retrieval set. The teams winning AI citation in 2026 are the ones treating both stages as the same job.
For Google, the surface where this is easiest to see is Google AI Mode: retrieval, query fan-out and answer composition happen visibly inside one conversational result.
Common RAG variants worth knowing
RAG is an architecture pattern, not a single implementation. Wikipedia's RAG entry lists the main variants - useful context because each has different SEO implications:
- Hybrid search RAG. Combines keyword (BM25) and semantic (vector) retrieval. The default for most production systems including Perplexity. Pages need to win on both exact-match terms AND semantic relevance.
- Chunking strategies. RAG systems split your content into chunks before retrieval. Naive 512-token splits cut sentences mid-thought; smarter semantic chunking respects paragraph and heading boundaries. Pages with clear H2/H3 structure get cleaner chunking and better extraction.
- Retriever-centric methods. Improvements like REALM, RETRO and Self-RAG focus on the retrieval stage rather than the generation stage. The SEO implication: retrieval quality is being actively improved, not just generation.
- RAG vs semantic search. AWS draws the line clearly - semantic search returns ranked results, RAG retrieves results then generates a synthesised answer from them. RAG includes a semantic-search stage but adds generation on top.
What can go wrong with RAG (including RAG poisoning)
Two emerging failure modes worth understanding:
RAG poisoning. Adversarial content placed in the retrieval set to manipulate the generated answer. Wikipedia documents this as an active research area - a competitor (or bad actor) publishes high-ranking content designed to be cited inside AI answers in a way that misrepresents the topic. The SEO implication: defending your category reputation in AI answers now requires monitoring not just whether you are cited, but whether competitors are being cited about you in misleading ways.
Outdated retrieved context. RAG retrieves what is in the index. If your latest pricing, product positioning or compliance status only lives on a page the model has not yet re-crawled, the answer will cite old information confidently. Refresh discipline (dateModified updates, IndexNow pings for Bing, manual re-submission for Google) genuinely matters for keeping your RAG citations accurate.
More on RAG.
What does RAG stand for?
RAG stands for Retrieval-Augmented Generation. The AI system retrieves relevant documents from an index, then generates an answer grounded in those documents. AI Overviews, Perplexity, ChatGPT Search and most modern AI engines use RAG architectures.
Why does RAG matter for SEO?
Because the "retrieval" stage decides which pages the AI even considers citing. Your SEO work (ranking, indexability, content depth) directly determines whether you get into the retrieval set. The "generation" stage then picks which retrieved pages to actually cite. Both stages are influenced by SEO discipline.
How is RAG different from a normal search?
A normal search returns a ranked list of links. RAG retrieves a smaller set of documents and composes an answer synthesising them. The user sees prose with citations rather than a list. Click-through behaviour changes accordingly.
Does Google AI Overviews use RAG?
Yes. Google's own May 2026 AI Optimisation Guide names RAG and query fan-out as the underlying mechanics for AI Overviews and Google AI Mode. The retrieval stage uses Google's search index; the generation stage uses Gemini 3.
What content does RAG retrieve cleanly?
Self-contained passages of 100-200 words. Pages structured around discrete questions and answers. Content with clear topical depth on the query. Schema-marked structured data. RAG fails on long, prose-heavy pages where the relevant answer is buried in paragraph six.
What is RAG poisoning?
Adversarial content placed in the retrieval set to manipulate AI-generated answers. A competitor (or bad actor) publishes high-ranking content designed to mislead the AI when it composes an answer about your category. Defending against it means monitoring not just whether you are cited, but whether competitors are being cited about you in misleading ways - and refreshing your own authoritative content faster than the competing narrative gets indexed.
What's the difference between RAG and semantic search?
Semantic search returns a ranked list of relevant documents. RAG retrieves documents via semantic search (and often keyword search alongside it), then feeds them to an LLM that generates a synthesised answer citing those sources. RAG includes a semantic-search stage but adds the generation layer on top. AWS's documentation draws this distinction explicitly.
Jason Burns
Independent UK SEO, GEO and AI consultant. 17 years in search. Portfolio includes 3M, BlackRock, Unilever and E.ON. Owner of SEO Moves Ltd since 2014.
More about Jason →Want help auditing your pages for RAG-readiness?
Send three priority pages. I look at each one through the RAG lens - is it retrievable, is it extractable, would the generation stage actually cite it. Short, written feedback.
Request the audit