Jason Burns / jasonburns.co.uk
Available - taking new work Contact

Updated

Updated What changed on

Fact-checked Prices, plan limits and llms-full.txt support re-checked on each vendor's own pages and docs on 14 October 2026, and every price quoted as a figure confirmed by a second direct fetch. The Ahrefs schema test and Google's structured data guidance were also re-checked against the 14 October 2026 source checks. Not re-checked: which Rank Math plans include llms.txt, and the Hugo setup estimate.

  • Fern stopped generating llms-full.txt on 12 June 2026, and its pricing is now a free plan plus custom Enterprise, not $400 a month.
  • Google's Search documentation now says Google Search ignores llms.txt, so the page no longer says Google has simply not committed.
  • Shopify has served /llms.txt and /llms-full.txt on every store by default since 28 May 2026, and Yoast's llms.txt on Shopify comes with its paid app at $19 USD per 30 days.
  • Scalar Docs now serves both files automatically, Fumadocs builds them with one CLI command, AIOSEO makes llms-full.txt on Pro, and Read the Docs only serves files you create.
  • Firecrawl's hosted generator is now deprecated, so it is no longer my free pick, and WordLift's $879 a month is the yearly-billed rate ($1,100 billed monthly).
  • The 2x llms-full.txt figure is now dated correctly as a June 2025 sample of 25 companies, the unsupported 1MB limit and Perplexity ingestion claims are gone, and the dead MkDocs plugin link is fixed.
  • The page no longer calls schema a heavier AI lever. In Ahrefs' May 2026 test, adding JSON-LD gave no citation lift in AI Mode or ChatGPT, and a small decline in AI Overviews.
  • Google's July 2026 guide says structured data is not required for its AI features and needs no special markup, so the schema validator entry and the related link now say that.
llms.txt Tools WordPress, docs platforms, static sites, web

Picking an llms.txt tool depends on your stack, not on which is "best".

Quick answer: on WordPress use Yoast or the SEO plugin you already run, on Shopify and upgraded Wix sites the platform already serves one, on hosted docs use Mintlify, GitBook or Scalar, on a static site use your generator's plugin, and for anything else use a free generator such as LLMrefs - then validate at llmstxtvalidator.dev. That covers most sites. The longer answer depends on your stack, which is why this list runs to 22 tools - WP plugins, docs platforms, static-site plugins, developer libraries and web generators - with the one detail most lists skip: whether each ships llms-full.txt as well.

  • Seen in server logs, in small numbers: OpenAI
  • Anthropic
22  tools reviewed 4 stacks  WP / docs / static / web llms-full.txt  flagged per tool
llms_txt_tools_2026.json
"spec""Proposed Sept 2024 by Jeremy Howard"
"status""Not an official W3C standard"
"adoption_2026""Google Search ignores it, AI bot fetches are rare"
"llms_full_fetch_rate""2x llms.txt (2025 sample, 25 companies)"
"recommended_effort""30 minutes, set and forget"
2x
In one 2025 sample, AI agents visited llms-full.txt more than twice as often as llms.txt. The data comes from a June 2025 Mintlify post using Profound AI-traffic analytics: 25 companies, 7 days, a median of 79 visits to llms-full.txt against 14 to llms.txt. Mintlify repeated it in their March 2026 platforms review. Treat it as one old sample, not a rule: Fern dropped llms-full.txt in June 2026 because it saw little use. Use the llms-full.txt column below to filter if you want both files.

Honest framing: llms.txt is currently low-effort, low-confirmed-impact for marketing sites. Documentation, API and large content sites benefit most. Google's Search documentation now says Google Search ignores the file, and Ahrefs found 97% of the llms.txt files it tracked got zero requests in May 2026. Spend 30 minutes generating one, hand-edit to remove noise, validate at llmstxtvalidator.dev, ship it and move on. Do not treat it as a lever big enough to plan a quarter around. Schema is not one either: in Ahrefs' May 2026 test, adding JSON-LD gave no citation lift in AI Mode or ChatGPT, and a small decline in AI Overviews. New to the file itself? Start with what llms.txt is and how the format works.

What changed in 2026
  • Yoast brought llms.txt to Shopify (March 2026) - in its paid Yoast SEO for Shopify app, from $19 USD per 30 days. Then Shopify itself started serving /llms.txt and /llms-full.txt on every store (28 May 2026), both showing the store's agents.md by default and editable with theme templates. WordPress Yoast still ships it free in the regular plugin.
  • Google Search said it ignores llms.txt (June 2026) - its Search documentation says the file neither helps nor harms your visibility in Google Search, including its generative AI features. Keep one for other services if you like.
  • Fern dropped llms-full.txt (June 2026) - saying it saw little use next to llms.txt plus per-page markdown. Fern still serves markdown to detected LLM bots (its own figure is a 90%+ token cut) and breaks analytics down by LLM provider.
  • Site builders added their own options - Wix generates and maintains llms.txt for upgraded sites with a custom domain, Squarespace 7.1 has an llms.txt panel that is off until you add your own text, and Webflow has let you upload one since July 2025.
  • Common Crawl measured the file at scale (August 2026) - in its July 2026 crawl sample, 11.72% of the sampled /llms.txt URLs returned a text body, and 68.27% of the 584,107 files it collected came from templates. Wix alone made 41.34% of all the files.

The 30-second pick

WordPress? AIOSEO or Rank Math if you already run them (trim the output), otherwise Yoast. For both files without paying, the standalone LLMs.txt and LLMs-full.txt Generator plugin. Shopify? Your store already serves one by default; edit it with a theme template, or use Yoast for Shopify if you already pay for it. Wix or Squarespace? Use the built-in setting. Hosted docs? Mintlify if you can move, otherwise stay where you are and check the comparison table. Static site? Pick the plugin for your generator (Docusaurus, Astro, MkDocs, VitePress and Sphinx all have working ones). Custom Laravel / PHP? stolt/llms-txt-php. None of the above? A free generator such as LLMrefs as a starter, then hand-edit. Validate everything at llmstxtvalidator.dev.

// comparison

22 tools, compared at a glance.

ToolCategoryllms-full.txtPricingBest for
AIOSEO llms.txt WordPress Yes, on Pro Free (Lite) + Pro WordPress sites already on AIOSEO
Yoast SEO llms.txt WordPress No Free on WordPress, $19/30 days on Shopify WordPress sites already on Yoast, and Shopify stores already on the Yoast app
Rank Math llms.txt WordPress No Free in Rank Math WordPress sites on Rank Math
WordLift llms.txt WordPress No Free generator, Business+ $879/mo billed yearly A quick free draft built from your site navigation
LLMs.txt and LLMs-full.txt Generator (WP plugin) WordPress Yes Free WordPress sites that need both files and are not on AIOSEO / Yoast / Rank Math
Mintlify Docs platform Yes Free tier + paid Hosted documentation, zero-config setup
Fern Docs platform No Free plan + custom Enterprise API documentation where you need bot-specific delivery
GitBook Docs platform Yes Free tier + paid Teams already on GitBook for docs
ReadMe Docs platform No Free + paid Interactive API docs with basic llms.txt
Redocly Docs platform No Paid OpenAPI-first docs
Scalar Docs platform Yes Free, open source + paid cloud OpenAPI-first teams publishing on Scalar Docs
Fumadocs Docs platform Yes, via CLI Free, open source Next.js docs where you own the code
Docusaurus plugin (docusaurus-plugin-llms) Static site plugin Yes Free, open source Docusaurus-based docs sites
Astro Starlight (starlight-llms-txt) Static site plugin Yes Free, open source Astro Starlight documentation
MkDocs / VitePress plugins Static site plugin Yes Free, open source Python (MkDocs) or Vue (VitePress) docs
Sphinx / Read the Docs (sphinx-llms-txt) Static site plugin Yes Free, open source Python projects documenting with Sphinx
llms-txt-php (Composer package) Developer library Yes Free, MIT Laravel and PHP apps wanting programmatic generation
Firecrawl llms.txt Generator Web generator Yes, opt-in Free to try, API key for full output Quick one-off llms.txt from any URL, if you already use Firecrawl
LLMrefs Free Generator Web generator No Free Quick browser-based draft from a URL
LLMTEXT (Parallel.ai) Web generator Not stated Free, open source Sitemap-driven generation with a built-in validator
llms.txt Validator Validator Validates both Free Catching malformed entries before you deploy
AI Schema Validator (Jason Burns tools) Validator n/a Free Checking the schema and structure of the pages your llms.txt points at

WordPress

Five plugins for WP sites. If you already run AIOSEO, Yoast or Rank Math, use what is in your stack. Switch generator only if you need llms-full.txt and your current SEO plugin does not ship it.

AIOSEO llms.txt Yes, on Pro

Free (Lite) + Pro

Best for: WordPress sites already on AIOSEO

llms.txt generation is built into AIOSEO and switched on by default, including the free Lite version. llms-full.txt and the markdown settings need Pro. Check the output before you rely on it: Common Crawl's study of its July 2026 crawl found AIOSEO files never included the one-line summary (0.00% of 73,136 files) and listed a median of 138 links, so they read more like a sitemap than a curated guide. That is one crawl sample, not a verdict on the plugin.

Yoast SEO llms.txt llms.txt only

Free on WordPress, $19/30 days on Shopify

Best for: WordPress sites already on Yoast, and Shopify stores already on the Yoast app

Free in the regular WordPress plugin, no Premium upgrade needed. Yoast SEO for Shopify added llms.txt in March 2026, but that app is paid: from $19 USD per 30 days ex VAT, with a 14-day trial. Shopify now serves /llms.txt and /llms-full.txt on every store by default (since 28 May 2026), so you no longer need an app just to have the file. In Common Crawl's July 2026 crawl, 82.30% of Yoast files included the one-line summary.

Rank Math llms.txt llms.txt only

Free in Rank Math

Best for: WordPress sites on Rank Math

Equivalent toggle inside the Rank Math plugin. Slightly more configurable than Yoast on which post types feed the file. If Rank Math is already installed, do not bolt on a second generator.

WordLift llms.txt llms.txt only

Free generator, Business+ $879/mo billed yearly

Best for: A quick free draft built from your site navigation

The free generator pulls links from the part of the page you pick (header, nav, footer or all) and gives you a file in seconds. It does not choose your best pages for you, so curate the result. The paid Business+ plan is $879 a month billed yearly or $1,100 billed monthly (UK visitors see EUR 799 and EUR 999 by default). That is only worth it for enterprise content teams.

Best for: WordPress sites that need both files and are not on AIOSEO / Yoast / Rank Math

One of the few WP plugins that ships llms-full.txt as well as llms.txt. Worth knowing if you want both files and your SEO plugin does not make llms-full.txt for free. How much AI agents use llms-full.txt is unclear (see the fetch data above).

Docs platform

Docs platforms and frameworks. Mintlify, Fern, GitBook, ReadMe, Redocly and Scalar Docs generate llms.txt for you; Fumadocs builds the routes with one CLI command. Pick by where the docs already live; do not switch platform just for llms.txt.

Mintlify llms-full.txt

Free tier + paid

Best for: Hosted documentation, zero-config setup

Auto-generates llms.txt, llms-full.txt and a .md version of every page with no config. If your docs are already on Mintlify, there is literally nothing to do. Mintlify also publish the strongest comparison piece on the wider docs-platform landscape.

Fern llms.txt only

Free plan + custom Enterprise

Best for: API documentation where you need bot-specific delivery

Generates llms.txt, detects LLM bot traffic and serves markdown instead of HTML to those bots (Fern's own figure is a 90%+ token cut). Content tags like <llms-only> and <llms-ignore> give per-block control, and its analytics break traffic down by LLM provider. Fern stopped generating llms-full.txt on 12 June 2026, saying it saw little use next to llms.txt plus per-page markdown. Pricing is now a free plan and custom Enterprise, with no $400 tier.

GitBook llms-full.txt

Free tier + paid

Best for: Teams already on GitBook for docs

Publishes both files automatically. No granular content controls, no LLM-specific analytics. Solid low-friction option if GitBook is where the docs already live.

ReadMe llms.txt only

Free + paid

Best for: Interactive API docs with basic llms.txt

On by default for every project and included on every plan. Append .md to any page URL for a markdown version. ReadMe's docs do not mention llms-full.txt, and it offers no AI-specific analytics. Fine if you already use ReadMe; not a reason to switch to it.

Redocly llms.txt only

Paid

Best for: OpenAPI-first docs

Creates llms.txt by default, and you can turn it off. No llms-full.txt. Worth knowing: Redocly have publicly argued llms.txt is overhyped, repeated it in September 2026 after a year's wait, and are putting their effort into MCP server support instead. Picked because of OpenAPI strength, not because of AI features. If AI discoverability is your reason for choosing a docs platform, Mintlify, GitBook or Scalar all do more.

Scalar llms-full.txt

Free, open source + paid cloud

Best for: OpenAPI-first teams publishing on Scalar Docs

Generates interactive API references from OpenAPI specs and has tooling for converting them to LLM-readable markdown. Every published Scalar Docs site now serves /llms.txt and /llms-full.txt automatically. You do not write or configure them.

Fumadocs Yes, via CLI

Free, open source

Best for: Next.js docs where you own the code

Docs framework for Next.js. You can add middleware that detects AI agents and serves markdown. Running npx @fumadocs/cli feature llms now creates the llms.txt, llms-full.txt and per-page markdown routes for you. The code then lives in your project, so you own and maintain it. Full control, much less setup than before.

Static site plugin

Build-time plugins for static-site generators. Install, configure, ship. Stable, free, low ceremony.

Docusaurus plugin (docusaurus-plugin-llms) llms-full.txt

Free, open source

Best for: Docusaurus-based docs sites

Generates llms.txt, llms-full.txt and per-page .md files. Batch processing handles large sites. Install via npm, configure in docusaurus.config.js. The most complete of the three community plugins.

Astro Starlight (starlight-llms-txt) llms-full.txt

Free, open source

Best for: Astro Starlight documentation

Generates llms.txt, llms-full.txt and a llms-small.txt for cheaper token contexts. Per-page .md exposure. Active, well-maintained plugin.

MkDocs / VitePress plugins llms-full.txt

Free, open source

Best for: Python (MkDocs) or Vue (VitePress) docs

mkdocs-llmstxt (llms-full.txt through its full_output setting) and vitepress-plugin-llms both generate llms.txt and llms-full.txt during build. Hugo has no dedicated plugin but its output format system makes it a 30-minute custom config job. Eleventy (eleventy-plugin-llms-txt) and Gatsby (gatsby-plugin-llms-txt) have plugins too, but both are llms.txt only.

Sphinx / Read the Docs (sphinx-llms-txt) llms-full.txt

Free, open source

Best for: Python projects documenting with Sphinx

sphinx-llms-txt generates llms.txt and llms-full.txt during your normal Sphinx build with zero configuration. If the docs are hosted on Read the Docs, the platform will serve those files, but it does not create them, so you still need the plugin or a hand-written file. The lowest-effort option on this whole list for Python docs.

Developer library

Programmatic generation for custom apps and CMS-driven sites where the file needs to update with content.

llms-txt-php (Composer package) llms-full.txt

Free, MIT

Best for: Laravel and PHP apps wanting programmatic generation

stolt/llms-txt-php. Use when llms.txt needs to update on content changes (CMS-driven sites, headless setups) rather than being a static file. It now generates llms-full.txt as well. Stable, well-tested, low ceremony.

Web generator

Browser-based generators for sites not on a supported platform. Use as a starter, then curate.

Firecrawl llms.txt Generator Yes, opt-in

Free to try, API key for full output

Best for: Quick one-off llms.txt from any URL, if you already use Firecrawl

Still online, but deprecated: Firecrawl stopped maintaining it after 30 June 2025 and points people to its main API. The page asks for a Firecrawl API key for full generation. Through the API it costs 1 credit per URL, crawls up to 100 pages (10 by default) and only builds llms-full.txt if you ask for it. Expect to hand-edit the output (auto-crawls always over-include).

LLMrefs Free Generator llms.txt only

Free

Best for: Quick browser-based draft from a URL

No signup, paste a URL, edit in-browser, download. Output is a starter, not a finished file. Use it the same way you would use Firecrawl - draft, then curate.

LLMTEXT (Parallel.ai) Not stated

Free, open source

Best for: Sitemap-driven generation with a built-in validator

Built by Jan Wilmake with Parallel's support. Generates the file from your sitemap rather than a crawl, and bundles a validator plus an MCP converter in the same toolkit. The sitemap approach means it inherits whatever curation your sitemap already has - often a better starting draft than a raw crawl.

Validator

Run any generated llms.txt through a validator before you deploy.

llms.txt Validator llms-full.txt

Free

Best for: Catching malformed entries before you deploy

Independent validator at llmstxtvalidator.dev. Flags unsupported directives, broken absolute URLs, missing required fields. One catch: it currently applies llms.txt rules to llms-full.txt too, so read its warnings on that file with care. Always run a generated file through this before shipping it - especially the WordPress plugin outputs, which drift on edge cases.

AI Schema Validator (Jason Burns tools) n/a

Free

Best for: Checking the schema and structure of the pages your llms.txt points at

Not an llms.txt generator. Validates the schema and structure of the pages your llms.txt points at. Google's July 2026 guide says optimising for AI features in Search is still SEO and needs no special markup. Useful pair with whichever generator you pick.

// questions I get

What clients ask about llms.txt.

What is llms.txt and do I actually need one?

llms.txt is a proposed markdown file at the root of your site that tells AI tools which pages matter and how to read them. Proposed by Jeremy Howard in September 2024. It is not yet an official W3C standard. Documentation sites benefit most. For a marketing site, publish one because the cost is 30 minutes - do not expect a measurable ranking lift from it alone.

What is the difference between llms.txt and llms-full.txt?

llms.txt is the index - page titles, one-line descriptions, URLs. llms-full.txt is the actual content, machine-readable, in a single file. In a June 2025 Mintlify study of 25 companies over 7 days, using Profound data, AI agents visited llms-full.txt more than twice as often as llms.txt (a median of 79 visits against 14). That is one old sample, not a rule, and Fern stopped generating llms-full.txt in June 2026 because it saw little use. Ship both if your tool makes it easy, but do not switch tools just to get llms-full.txt.

Does Google or ChatGPT actually use llms.txt?

Google Search does not. Google's Search documentation, in a clarification added in June 2026, says Google Search ignores llms.txt, including its generative AI features, so the file neither helps nor harms your Search visibility. None of the crawler pages from OpenAI, Anthropic or Perplexity says their crawlers read other sites' llms.txt. Server logs show small numbers of fetches: EZY Research counted 7 reads by OpenAI's crawler and none by PerplexityBot across 83 sites in 12 weeks (Meta's crawler was the exception, with 193 reads), and Ahrefs found 97% of the files it tracked got zero requests in May 2026. Treat it as a low-cost experiment with patchy upside, not a confirmed lever.

Where should I host llms.txt?

At the root of the domain - example.com/llms.txt. The proposal also allows a subpath such as /docs/llms.txt, but the root is the usual place. Use absolute URLs inside the file (relative URLs break when AI tools fetch it from a different context). Same applies to llms-full.txt.

Should I generate llms.txt automatically or hand-write it?

Generate a starter version from any of the tools above, then hand-edit. Auto-generators list every page they crawl. The value of llms.txt is in curation - telling AI systems which pages actually matter. Trimming the auto-generated draft takes 30 minutes and is most of the real work. A 50-page auto-generated dump is worse than a 12-page hand-curated file.

How do I validate my llms.txt before deploying?

Run it through llmstxtvalidator.dev. It catches malformed entries, broken absolute URLs, missing required fields and unsupported directives. Especially worth doing on WordPress plugin output, which drifts on edge cases like multilingual sites and unusual permalink structures.

What is the best free llms.txt generator?

On WordPress, the llms.txt features in Yoast, Rank Math and AIOSEO Lite are free. Shopify serves a default file on every store, and Wix creates one for upgraded sites with a custom domain and indexing switched on. For anything else, LLMrefs and LLMTEXT are free browser-based options. Firecrawl's hosted generator still works, but it is deprecated and asks for an API key for full output. Every free generator produces a draft that needs hand-editing, so pick on convenience, not features.

What is the format of an llms.txt file?

H1 with your brand or project name (required). A blockquote one-sentence summary. Optional description paragraphs. H2 sections grouping related links (Documentation, Tools, Blog, API Reference). Bullet lists of links with titles, URLs and optional descriptions. Plain markdown, no special syntax. The llmstxt.org proposal has the canonical example.

Jason Burns, independent UK SEO, GEO and AI consultant
Written by

Jason Burns

Independent UK SEO, GEO and AI consultant. In search since 2007. Portfolio includes 3M, BlackRock, Unilever and E.ON. Owner of SEO Moves Ltd since 2014.

More about Jason →
// next step

Want a second opinion on whether llms.txt is worth your time?

Quick check-in if you are undecided. For some sites the answer is yes, for most it is "do it once, move on, spend the rest on schema and content". Worth knowing which before you commit a Friday afternoon.

Book a GEO call