Jason Burns / jasonburns.co.uk
Available - taking new work Contact

Updated

Updated What changed on

Fact-checked The claims about Google, OpenAI, Perplexity, Ahrefs, AWS and Wikipedia were re-checked at the source on 14 October 2026. Advice on 100 to 200 word passages and Person schema could not be sourced, so it was removed. The chunking advice under "Why this matters for SEO" was also checked against Google's guide and Ahrefs' July 2026 RAG explainer on the same date.

  • Corrected the Ahrefs ranking figures: the July 2025 study found a 0.347 correlation, not 0.65, and pages ranking first were among the top three AI Overview citations only about half the time.
  • Updated the Google models: Gemini 3.5 Flash became the AI Mode default in May 2026, and Gemini 4 Argon reached AI Mode for paying subscribers on 13 October 2026. Gemini 3 is the AI Overviews default Google named in January 2026.
  • Linked Google's own guide to generative AI features and split the content advice by engine, because Google says no chunking or special schema is needed for its AI features.
  • Updated where Perplexity and ChatGPT retrieve from, and narrowed the JavaScript warning to the crawlers that were actually tested.
  • Added a RAG-ready checklist covering crawler access, the new Search Console AI reports and the opt-out control.
  • Fixed claims credited to Wikipedia and AWS that their pages do not make.
  • Split the advice under "Why this matters for SEO" by engine: Google says there is no need to chunk content for its AI features, while Ahrefs describes ChatGPT splitting pages into chunks and retrieving the chunk closest to the query.
RAG explainer Plain answer + SEO implications

What is RAG and why it matters for SEO?

The 30-second answer

RAG (Retrieval-Augmented Generation) is how Google AI Overviews, AI Mode and Perplexity build answers, and how ChatGPT answers when it runs a web search. The system retrieves relevant pages first, then writes an answer grounded in them and cites some of them. RAG SEO is the work of getting your pages into that retrieved set and making them the ones the answer leans on. Google's own guide, Optimizing your website for generative AI features on Google Search (May 2026, updated July 2026), names RAG, which it also calls grounding, and query fan-out as the mechanics behind AI Overviews and AI Mode.

User query what is X? Retrieve from search index Augment rank + select Generate LLM writes answer Cited answer + sources SEO decides this part Content structure decides this part
RAG pipeline. SEO controls retrieval. Content structure controls citation.

What retrieval actually selects

37.9%

of URLs cited in Google AI Overviews appeared in the first 10 results blocks for that query. Ahrefs counts blocks, not organic results, so this is not the same as ranking in the top 10.

Update: 38% of AI Overview Citations Pull From The Top 10, Ahrefs, Louise Linehan. Published 2 March 2026, revised 31 May 2026. Checked 14 October 2026.

How it was measured: 863,000 keyword SERPs and 4 million AI Overview URLs. Ahrefs measures the top 10 as blocks, counting ads, featured snippets and video packs as separate blocks.

76.1%

was Ahrefs' July 2025 figure. It counted only the top 3 citations per AI Overview, and Ahrefs has since changed its parsing, so the two years are not like for like.

76% of AI Overview Citations Pull From the Top 10, Ahrefs. Published 21 July 2025, revised 2 July 2026. Checked 14 October 2026.

How it was measured: 1.9 million citations from 1 million AI Overviews, analysing only the top 3 most visible citations in each one. Ahrefs notes it improved its parsing between this study and the 2026 update. Both differences mean the fall to 37.9% cannot be read as a like for like change.

18.2%

of AI Overview citations that do not rank in the top 100 are YouTube URLs.

Update: 38% of AI Overview Citations Pull From The Top 10, Ahrefs. Published 2 March 2026. Checked 19 August 2026.

How it was measured: Same 863,000 SERP dataset. YouTube accounts for 5.6% of all AI Overview URLs cited across the dataset.

How RAG works, briefly

Three stages, simplified:

  1. Retrieve. The system searches an index for documents relevant to the query. For AI Overviews and AI Mode this is Google's Search index, with pages picked by Google's core ranking systems. For Perplexity, its own index (built by PerplexityBot) used together with partner search APIs. For ChatGPT search, pages OpenAI's OAI-SearchBot is allowed to crawl plus third-party search providers; OpenAI names Bing in its Enterprise and Edu help page.
  2. Augment. The retrieved documents are fed into the model's context as grounding material.
  3. Generate. The model composes an answer using both its training knowledge and the retrieved documents, then cites the documents it leaned on.

Primary sources worth reading direct: the foundational Lewis et al. 2020 RAG paper (Facebook AI Research, now Meta), AWS's RAG explainer, IBM Research's overview, NVIDIA's plain-English version, and the actively-maintained LlamaIndex GitHub repo if you want to read the code.

Vendors documenting RAG: OpenAI OpenAI Anthropic Anthropic Google Google Perplexity Perplexity Meta Meta (origin)

Why this matters for SEO

The retrieve stage is the SEO stage. Google's guide says its AI features use its core Search ranking systems to pull pages from the Search index, so a page that is not indexed, or not seen as relevant, never reaches the generate stage. Ranking well helps but does not guarantee a citation. Ahrefs' July 2025 study of 1 million keywords and 1.9 million citation links found a Spearman correlation of 0.347 between ranking in the top 10 and being one of the top three AI Overview citations. Even pages ranking first were in those top three citations only about half the time.

For Google AI Overviews and AI Mode, Google's guide says there is no need to chunk content and no ideal page length. Some engines split pages into chunks and retrieve the chunk closest to the query, as Ahrefs describes for ChatGPT, so a passage that answers one question on its own is easier for them to pick up. A page that retrieves but cannot be cleanly extracted gets bypassed for a cleaner source.

What content patterns RAG retrieves and cites cleanly

The answer depends on the engine, so split the advice.

  • Google AI Overviews and AI Mode. Google's guide says you do not need to break content into small chunks, there is no ideal page length, and structured data is not required, with no special schema.org markup to add. The page must be indexed and eligible to show in Google Search with a snippet.
  • Engines that retrieve chunks. Ahrefs' July 2026 RAG explainer, drawing on outside research into ChatGPT, describes pages being split into chunks and the chunk closest to each search query winning. Passages that answer one question without leaning on earlier paragraphs suit that.
  • Pages structured around discrete questions and answers. FAQ format suits RAG well.
  • Tables and lists. Extracted as structured facts rather than paraphrased.
  • Content with clear topical depth. Thin pages get retrieved less often even when they technically match the query.

What does NOT work well in RAG

  • Long prose-only pages with the answer buried in paragraph six.
  • Pages built around marketing voice rather than direct answers.
  • Content that depends on JavaScript for the answer to render. In Vercel's December 2024 measurement, crawlers from OpenAI, Anthropic, Meta, ByteDance and Perplexity did not run JavaScript. Google is different: its AI features draw on the Search index, and Google renders JavaScript as long as it is not blocked.
  • Pages with the relevant information spread across multiple URLs the user has to traverse.

Practical implication

RAG turns SEO into a two-stage game. Stage one: rank well enough to be retrieved. Stage two: structure content so the generation stage cites you rather than the next page in the retrieval set. The teams winning AI citation in 2026 are the ones treating both stages as the same job.

For Google, the surface where this is easiest to see is Google AI Mode: retrieval, query fan-out and answer composition happen visibly inside one conversational result.

RAG SEO applications: a short RAG-ready checklist

  • Let the retrieval crawlers in. OpenAI says sites that opt out of OAI-SearchBot will not be shown in ChatGPT search answers, though they can still appear as navigational links. PerplexityBot is Perplexity's search crawler and, Perplexity says, is not used to crawl content for AI foundation models. Check robots.txt and your CDN rules for both.
  • Put the key facts in the HTML. Prices, specs and direct answers should be readable without JavaScript, for the crawlers that do not render it.
  • Measure what Google retrieves. Search Console's generative AI performance reports show impressions in AI Overviews and AI Mode by page, country, device and date. They reached every site worldwide on 31 August 2026. Google's announcement lists no click metric.
  • Decide whether to help ground answers. A Search Console control, live for all sites worldwide since 31 August 2026, lets you opt out of appearing in and helping ground AI Overviews, AI Mode and AI Overviews in Discover. Opted-out sites get no traffic or impressions from those features. Google says the setting is not a ranking signal for normal search results.

Common RAG variants worth knowing

RAG is an architecture pattern, not a single implementation. Wikipedia's RAG entry covers several of these, including hybrid search and chunking - useful context because each has different SEO implications:

  • Hybrid search RAG. Combines keyword (BM25) and semantic (vector) retrieval. Perplexity describes its own search as mixing keyword and semantic signals, and Anthropic and OpenAI describe the same mix in their retrieval docs. Pages need to win on both exact-match terms AND semantic relevance.
  • Chunking strategies. Many RAG systems split content into chunks before retrieval, and how they split it affects what gets found. Google says its own AI features do not need you to chunk content for them. Clear H2/H3 structure still helps readers, whichever engine is reading.
  • Retriever-centric methods. Wikipedia groups pre-training the retriever, supervised retriever optimisation and reranking under this heading. They improve the retrieval stage rather than the generation stage. The SEO implication: retrieval quality is being actively improved, not just generation.
  • RAG vs semantic search. AWS treats semantic search as part of retrieval: it maps a question to the relevant documents and returns specific text, which then feeds the LLM. Semantic search on its own stops at finding; RAG adds the generation step on top.

What can go wrong with RAG (including RAG poisoning)

Two emerging failure modes worth understanding:

RAG poisoning. Adversarial content placed in the retrieval set to manipulate the generated answer. Wikipedia's RAG poisoning section notes that RAG systems may retrieve factually correct but misleading sources, and its example is a state-funded influence campaign. The commercial version is a competitor (or bad actor) who publishes high-ranking content designed to be cited inside AI answers in a way that misrepresents the topic. The SEO implication: defending your category reputation in AI answers now requires monitoring not just whether you are cited, but whether competitors are being cited about you in misleading ways.

Outdated retrieved context. RAG retrieves what is in the index. If your latest pricing, product positioning or compliance status only lives on a page the model has not yet re-crawled, the answer will cite old information confidently. Refresh discipline (dateModified updates, IndexNow pings for Bing, manual re-submission for Google) genuinely matters for keeping your RAG citations accurate.

Adversarial page published Ranks well in retrieval index Retrieved into RAG context LLM generates cites poisoned source User sees misleading answer Defence: monitor competitor citations about you, refresh authoritative content fast Attack starts here Damage lands here
RAG poisoning attack path. Defence is monitoring + refresh speed, not blocking the attack at any single stage.
// 02 - questions I get

More on RAG.

What does RAG stand for?

RAG stands for Retrieval-Augmented Generation. The AI system retrieves relevant documents from an index, then generates an answer grounded in those documents. Google AI Overviews, AI Mode and Perplexity work this way, and so does ChatGPT when it runs a web search.

Why does RAG matter for SEO?

Because the "retrieval" stage decides which pages the AI even considers citing. Your SEO work (ranking, indexability, content depth) directly determines whether you get into the retrieval set. The "generation" stage then picks which retrieved pages to actually cite. Both stages are influenced by SEO discipline.

How is RAG different from a normal search?

A normal search returns a ranked list of links. RAG retrieves a smaller set of documents and composes an answer synthesising them. The user sees prose with citations rather than a list. Click-through behaviour changes accordingly.

Does Google AI Overviews use RAG?

Yes. Google's guide, Optimizing your website for generative AI features on Google Search (published May 2026, updated July 2026), says AI Overviews and Google AI Mode use RAG, which it also calls grounding, plus query fan-out. Retrieval uses Google's core ranking systems to pull pages from its Search index. For generation, Google made Gemini 3 the default for AI Overviews in January 2026 and Gemini 3.5 Flash the default for AI Mode in May 2026. Since 13 October 2026, Google AI Pro and Ultra subscribers can also use Gemini 4 Argon in AI Mode.

What content does RAG retrieve cleanly?

It depends on the engine. For AI Overviews and AI Mode, Google's guide says you do not need to break content into small chunks, there is no ideal page length and no special schema markup is needed. The page must be indexed and eligible to show in Google Search with a snippet. Systems that retrieve chunks, as Ahrefs describes for ChatGPT, favour passages that answer one question without leaning on earlier paragraphs. On any engine, an answer buried in paragraph six of long prose is harder to find and quote.

What is RAG poisoning?

Adversarial content placed in the retrieval set to manipulate AI-generated answers. A competitor (or bad actor) publishes high-ranking content designed to mislead the AI when it composes an answer about your category. Defending against it means monitoring not just whether you are cited, but whether competitors are being cited about you in misleading ways - and refreshing your own authoritative content faster than the competing narrative gets indexed.

What's the difference between RAG and semantic search?

Semantic search finds the documents or passages that match the meaning of a question. RAG uses that kind of retrieval (often with keyword search alongside it), then feeds the results to an LLM that writes an answer citing those sources. AWS describes semantic search as a way to improve the retrieval side of RAG.

Jason Burns, independent UK SEO, GEO and AI consultant
Written by

Jason Burns

Independent UK SEO, GEO and AI consultant. In search since 2007. Portfolio includes 3M, BlackRock, Unilever and E.ON. Owner of SEO Moves Ltd since 2014.

More about Jason →
// next step

Want help auditing your pages for RAG-readiness?

Send three priority pages. I look at each one through the RAG lens - is it retrievable, is it extractable, would the generation stage actually cite it. Short, written feedback.

Request the audit