Jason Burns / jasonburns.co.uk
Available - taking new work Contact

Updated

Updated What changed on
  • Corrected the heading structure. The summary heading was an h3 sitting directly after the h1, which skipped a level and gave screen readers a broken page outline. No wording changed.
llms.txt Tools WordPress, docs platforms, static sites, web

Picking an llms.txt tool depends on your stack, not on which is "best".

Quick answer: on WordPress use AIOSEO or Yoast, on hosted docs use Mintlify or Fern, on a static site use your generator's plugin, and for anything else use Firecrawl's free generator - then validate at llmstxtvalidator.dev. That covers most sites. The longer answer depends on your stack, which is why this list runs to 22 tools - WP plugins, docs platforms, static-site plugins, developer libraries and web generators - with the one detail most lists skip: whether each ships llms-full.txt as well.

  • Fetched by ChatGPT
  • Claude
  • Gemini
  • Perplexity
22  tools reviewed 4 stacks  WP / docs / static / web llms-full.txt  flagged per tool
llms_txt_tools_2026.json
"spec""Proposed Sept 2024 by Jeremy Howard"
"status""Not an official W3C standard"
"adoption_2026""Patchy across AI engines, docs sites lead"
"llms_full_fetch_rate""2x llms.txt (Profound data)"
"recommended_effort""30 minutes, set and forget"
2x
AI agents fetch llms-full.txt at roughly twice the rate they fetch llms.txt. Data cited by Mintlify in their May 2026 platforms review, sourced from Profound AI-traffic analytics. The practical takeaway: a generator that only ships llms.txt is giving AI engines the index without the book. Use the llms-full.txt column below to filter.

Honest framing: llms.txt is currently low-effort, low-confirmed-impact for marketing sites. Documentation, API and large content sites benefit most. Spend 30 minutes generating one, hand-edit to remove noise, validate at llmstxtvalidator.dev, ship it and move on. Do not treat it as a lever big enough to plan a quarter around - schema is the heavier extraction lever. New to the file itself? Start with what llms.txt is and how the format works.

What changed in 2026
  • Yoast brought llms.txt to Shopify (March 2026) - the main SEO-suite route on Shopify, alongside standalone generator apps in the Shopify App Store. WordPress Yoast still ships it free in the regular plugin.
  • Profound shared llms-full.txt fetch data - AI agents pull llms-full.txt at over 2x the rate of llms.txt, picked up by the Mintlify platforms review. Sites with only llms.txt are leaving the file AI actually wants on the table.
  • Fern published their analytics - serving markdown to detected LLM bots cuts token costs ~90% versus serving HTML. Currently the only docs platform offering analytics broken down by LLM provider.
  • Google has still not officially committed to using llms.txt as of mid-2026. Treat as low-cost experiment, not confirmed signal.

The 30-second pick

WordPress? AIOSEO if you already run it, otherwise Yoast. For both files, the standalone LLMs.txt and LLMs-full.txt Generator plugin. Shopify? Yoast for Shopify. Hosted docs? Mintlify if you can move, otherwise stay where you are and check the comparison table. Static site? Pick the plugin for your generator (Docusaurus, Astro, MkDocs, VitePress and Sphinx all have working ones). Custom Laravel / PHP? stolt/llms-txt-php. None of the above? Firecrawl as a starter, then hand-edit. Validate everything at llmstxtvalidator.dev.

// comparison

22 tools, compared at a glance.

ToolCategoryllms-full.txtPricingBest for
AIOSEO llms.txt WordPress Manual add Free + paid WordPress sites already on AIOSEO
Yoast SEO llms.txt WordPress No Free in Yoast SEO WordPress sites already on Yoast (and Shopify, as of March 2026)
Rank Math llms.txt WordPress No Free in Rank Math WordPress sites on Rank Math
WordLift llms.txt WordPress No Free generator, paid plans from $879/mo Large content libraries that need curation, not just dump
LLMs.txt and LLMs-full.txt Generator (WP plugin) WordPress Yes Free WordPress sites that need both files and are not on AIOSEO / Yoast / Rank Math
Mintlify Docs platform Yes Free tier + paid Hosted documentation, zero-config setup
Fern Docs platform Yes From $400/mo API documentation where you need bot-specific delivery
GitBook Docs platform Yes Free tier + paid Teams already on GitBook for docs
ReadMe Docs platform No Free + paid Interactive API docs with basic llms.txt
Redocly Docs platform No Paid OpenAPI-first docs
Scalar Docs platform Manual Free, open source + paid cloud OpenAPI-first teams happy to wire the file up themselves
Fumadocs Docs platform Manual Free, open source Next.js docs where you own the code
Docusaurus plugin (docusaurus-plugin-llms) Static site plugin Yes Free, open source Docusaurus-based docs sites
Astro Starlight (starlight-llms-txt) Static site plugin Yes Free, open source Astro Starlight documentation
MkDocs / VitePress plugins Static site plugin Yes Free, open source Python (MkDocs) or Vue (VitePress) docs
Sphinx / Read the Docs (sphinx-llms-txt) Static site plugin Yes Free, open source Python projects documenting with Sphinx
llms-txt-php (Composer package) Developer library Manual Free, MIT Laravel and PHP apps wanting programmatic generation
Firecrawl llms.txt Generator Web generator Yes Free Quick one-off llms.txt from any URL
LLMrefs Free Generator Web generator No Free Quick browser-based draft from a URL
LLMTEXT (Parallel.ai) Web generator Not stated Free, open source Sitemap-driven generation with a built-in validator
llms.txt Validator Validator Validates both Free Catching malformed entries before you deploy
AI Schema Validator (Jason Burns tools) Validator n/a Free Confirming the pages your llms.txt points at are actually AI-extractable

WordPress

Five plugins for WP sites. If you already run AIOSEO, Yoast or Rank Math, use what is in your stack. Switch generator only if you need llms-full.txt and your current SEO plugin does not ship it.

AIOSEO llms.txt Manual add

Free + paid

Best for: WordPress sites already on AIOSEO

One-click llms.txt generation inside the AIOSEO plugin. The cleanest WP path for sites already on AIOSEO. Auto-respects existing noindex / nofollow settings, which most standalone WP generators do not.

Yoast SEO llms.txt llms.txt only

Free in Yoast SEO

Best for: WordPress sites already on Yoast (and Shopify, as of March 2026)

Free in the regular Yoast plugin, no Premium upgrade needed. Yoast SEO for Shopify added the same toggle in March 2026 - the main SEO-suite route on Shopify, though standalone llms.txt generator apps also exist in the Shopify App Store.

Rank Math llms.txt llms.txt only

Free in Rank Math

Best for: WordPress sites on Rank Math

Equivalent toggle inside the Rank Math plugin. Slightly more configurable than Yoast on which post types feed the file. If Rank Math is already installed, do not bolt on a second generator.

WordLift llms.txt llms.txt only

Free generator, paid plans from $879/mo

Best for: Large content libraries that need curation, not just dump

WordLift will analyse content and pick the strongest evergreen URLs rather than listing everything. Useful if your site has thousands of posts and you do not want every category page in the file. The free standalone generator is fine; the $879/mo plan is only worth it for enterprise content ops.

Best for: WordPress sites that need both files and are not on AIOSEO / Yoast / Rank Math

One of the few WP plugins that ships llms-full.txt as well as llms.txt. Worth knowing because most WP options skip llms-full.txt entirely and that is the file AI agents fetch more often (see Profound data below).

Docs platform

Docs platforms and frameworks. Mintlify, Fern, GitBook and ReadMe auto-generate; Scalar and Fumadocs make you build the file yourself. Pick by where the docs already live; do not switch platform just for llms.txt.

Mintlify llms-full.txt

Free tier + paid

Best for: Hosted documentation, zero-config setup

Auto-generates llms.txt, llms-full.txt and a .md version of every page with no config. If your docs are already on Mintlify, there is literally nothing to do. Mintlify also publish the strongest comparison piece on the wider docs-platform landscape.

Fern llms-full.txt

From $400/mo

Best for: API documentation where you need bot-specific delivery

Auto-generates both files, detects LLM bot traffic, serves markdown instead of HTML to those bots (Fern claim 90%+ token reduction). Content tags like <llms-only> and <llms-ignore> give per-block control. Heavier price tag, but the only platform offering analytics by LLM provider.

GitBook llms-full.txt

Free tier + paid

Best for: Teams already on GitBook for docs

One-click toggle exposes both files. No granular content controls, no LLM-specific analytics. Solid low-friction option if GitBook is where the docs already live.

ReadMe llms.txt only

Free + paid

Best for: Interactive API docs with basic llms.txt

Toggle on in settings. Append .md to any page URL for a markdown version. Does NOT generate llms-full.txt and offers no AI-specific analytics. Fine if you already use ReadMe; not a reason to switch to it.

Redocly llms.txt only

Paid

Best for: OpenAPI-first docs

Toggle-based llms.txt support. No llms-full.txt. Worth knowing: Redocly have publicly argued llms.txt is overhyped and are putting their effort into MCP server support instead. Picked because of OpenAPI strength, not because of AI features. If AI discoverability is your reason for choosing a docs platform, Mintlify, Fern or GitBook all do more.

Scalar Manual

Free, open source + paid cloud

Best for: OpenAPI-first teams happy to wire the file up themselves

Generates interactive API references from OpenAPI specs and has tooling for converting them to LLM-readable markdown. No automatic llms.txt generation though - you configure the routes and keep the file in sync yourself. Building blocks, not a toggle.

Fumadocs Manual

Free, open source

Best for: Next.js docs where you own the code

Docs framework for Next.js. You can add middleware that detects AI agents and serves markdown, but llms.txt and llms-full.txt need custom route handlers you build and maintain. Full control, zero automation. Fine if that trade suits your team.

Static site plugin

Build-time plugins for static-site generators. Install, configure, ship. Stable, free, low ceremony.

Docusaurus plugin (docusaurus-plugin-llms) llms-full.txt

Free, open source

Best for: Docusaurus-based docs sites

Generates llms.txt, llms-full.txt and per-page .md files. Batch processing handles large sites. Install via npm, configure in docusaurus.config.js. The most complete of the three community plugins.

Astro Starlight (starlight-llms-txt) llms-full.txt

Free, open source

Best for: Astro Starlight documentation

Generates llms.txt, llms-full.txt and a llms-small.txt for cheaper token contexts. Per-page .md exposure. Active, well-maintained plugin.

MkDocs / VitePress plugins llms-full.txt

Free, open source

Best for: Python (MkDocs) or Vue (VitePress) docs

mkdocs-llmstxt and vitepress-plugin-llms both generate llms.txt and llms-full.txt during build. Hugo has no dedicated plugin but its output format system makes it a 30-minute custom config job. Eleventy (eleventy-plugin-llms-txt) and Gatsby (gatsby-plugin-llms-txt) have plugins too, but both are llms.txt only.

Sphinx / Read the Docs (sphinx-llms-txt) llms-full.txt

Free, open source

Best for: Python projects documenting with Sphinx

sphinx-llms-txt generates llms.txt with zero configuration. If the docs are hosted on Read the Docs, the platform also serves llms.txt and llms-full.txt from your default version automatically - no plugin needed. The lowest-effort option on this whole list for Python docs.

Developer library

Programmatic generation for custom apps and CMS-driven sites where the file needs to update with content.

Best for: Laravel and PHP apps wanting programmatic generation

stolt/llms-txt-php. Use when llms.txt needs to update on content changes (CMS-driven sites, headless setups) rather than being a static file. Stable, well-tested, low ceremony.

Web generator

Browser-based generators for sites not on a supported platform. Use as a starter, then curate.

Firecrawl llms.txt Generator llms-full.txt

Free

Best for: Quick one-off llms.txt from any URL

Crawls a domain, uses gpt-4o-mini to extract titles and descriptions, produces both llms.txt and llms-full.txt. Best starter generator for sites not on a platform that auto-builds the file. Expect to hand-edit the output (auto-crawls always over-include).

LLMrefs Free Generator llms.txt only

Free

Best for: Quick browser-based draft from a URL

No signup, paste a URL, edit in-browser, download. Output is a starter, not a finished file. Use it the same way you would use Firecrawl - draft, then curate.

LLMTEXT (Parallel.ai) Not stated

Free, open source

Best for: Sitemap-driven generation with a built-in validator

Generates the file from your sitemap rather than a crawl, and bundles a validator plus an MCP converter in the same toolkit. The sitemap approach means it inherits whatever curation your sitemap already has - often a better starting draft than a raw crawl.

Validator

Run any generated llms.txt through a validator before you deploy.

llms.txt Validator llms-full.txt

Free

Best for: Catching malformed entries before you deploy

Independent validator at llmstxtvalidator.dev. Flags unsupported directives, broken absolute URLs, missing required fields. Always run a generated file through this before shipping it - especially the WordPress plugin outputs, which drift on edge cases.

AI Schema Validator (Jason Burns tools) n/a

Free

Best for: Confirming the pages your llms.txt points at are actually AI-extractable

Not an llms.txt generator. Validates whether the pages your llms.txt curates have the schema and structure AI engines can extract from. Useful pair with whichever generator you pick - a tidy llms.txt pointing at extraction-hostile pages is wasted effort.

// questions I get

What clients ask about llms.txt.

What is llms.txt and do I actually need one?

llms.txt is a proposed markdown file at the root of your site that tells AI tools which pages matter and how to read them. Proposed by Jeremy Howard in September 2024. It is not yet an official W3C standard. Documentation sites benefit most. For a marketing site, publish one because the cost is 30 minutes - do not expect a measurable ranking lift from it alone.

What is the difference between llms.txt and llms-full.txt?

llms.txt is the index - page titles, one-line descriptions, URLs. llms-full.txt is the actual content, machine-readable, in a single file. Data shared by Profound (cited in the May 2026 Mintlify comparison) shows AI agents fetch llms-full.txt at over twice the rate of llms.txt. If your tool only ships llms.txt, you are giving AI engines the table of contents but not the book.

Does Google or ChatGPT actually use llms.txt?

Adoption is uneven. As of mid-2026, Google has not officially committed to using llms.txt as a ranking or extraction signal. Anthropic (Claude) and OpenAI (ChatGPT) do fetch it in some agentic contexts, particularly for documentation queries. Perplexity references llms.txt as part of its source ingestion. Treat it as a low-cost experiment with patchy upside, not a confirmed lever.

Where should I host llms.txt?

Always at the root of the domain - example.com/llms.txt. Some specs allow alternative paths but the root is where AI systems check first. Use absolute URLs inside the file (relative URLs break when AI tools fetch it from a different context). Keep the file under 1MB to ensure full ingestion. Same applies to llms-full.txt.

Should I generate llms.txt automatically or hand-write it?

Generate a starter version from any of the tools above, then hand-edit. Auto-generators list every page they crawl. The value of llms.txt is in curation - telling AI systems which pages actually matter. Trimming the auto-generated draft takes 30 minutes and is most of the real work. A 50-page auto-generated dump is worse than a 12-page hand-curated file.

How do I validate my llms.txt before deploying?

Run it through llmstxtvalidator.dev. It catches malformed entries, broken absolute URLs, missing required fields and unsupported directives. Especially worth doing on WordPress plugin output, which drifts on edge cases like multilingual sites and unusual permalink structures.

What is the best free llms.txt generator?

Firecrawl's generator is the best free starting point for any site - it crawls the domain and produces both llms.txt and llms-full.txt. On WordPress, the llms.txt toggles in Yoast, Rank Math and AIOSEO are free. LLMrefs and LLMTEXT are also free browser-based options. Every free generator produces a draft that needs hand-editing, so pick on convenience, not features.

What is the format of an llms.txt file?

H1 with your brand or project name (required). A blockquote one-sentence summary. Optional description paragraphs. H2 sections grouping related links (Documentation, Tools, Blog, API Reference). Bullet lists of links with titles, URLs and optional descriptions. Plain markdown, no special syntax. The llmstxt.org proposal has the canonical example.

Jason Burns, independent UK SEO, GEO and AI consultant
Written by

Jason Burns

Independent UK SEO, GEO and AI consultant. 17 years in search. Portfolio includes 3M, BlackRock, Unilever and E.ON. Owner of SEO Moves Ltd since 2014.

More about Jason →
// next step

Want a second opinion on whether llms.txt is worth your time?

Quick check-in if you are undecided. For some sites the answer is yes, for most it is "do it once, move on, spend the rest on schema and content". Worth knowing which before you commit a Friday afternoon.

Book a GEO call