Plugins Plugin hub Backup SEO Caching Security Forms WooCommerce Images Best backup plugins
Hosting Hosting directory Shared Managed Cloud India
Themes & builders Compare Rank Math vs Yoast
Tools All tools Hosting finder Plugin stack builder Cost calculator Salt generator Theme detector Who is hosting this? Speed test Headline analyzer robots.txt generator Redirect generator Uptime calculator Blog name generator
Best lists Best backup plugins Deals
Guides All guides Speed up WordPress Choose hosting Back up WordPress
How we test

Explainers · Explainer

What Is llms.txt? A Plain Explanation

Short answer

llms.txt is a small Markdown file placed at your site root, such as yourdomain.com/llms.txt, that gives AI tools a short summary of your site and links to its most useful pages. It was proposed in September 2024 as a way to hand AI tools clean, short context instead of full HTML pages. It is a proposal, not a formal standard, and Google Search does not use it.

Key takeaways

  • llms.txt is a Markdown file at /llms.txt that sums up a site and links to its key pages for AI tools.
  • Only the H1 with the site name is required; the summary, detail sections, and link lists are all optional.
  • Google Search does not use llms.txt, and the file is not needed for AI Overviews or AI Mode.
  • No major AI company has said its tools look for llms.txt on other sites, as of November 2026.
  • Yoast SEO added an llms.txt generator in version 25.3 on June 10, 2025, and WordPress plugins can also build the file.
  • A file covers the pages under its own path, so /docs/llms.txt covers only the docs section.

What is llms.txt?

llms.txt is a small Markdown file at your site root that gives AI tools a short summary of your site and links to its key pages.

The idea comes from a proposal by Jeremy Howard, first written in September 2024 and revised as version 2 after two years of use. The llmstxt.org proposal says thousands of sites now publish the file.

Think of it as a short guide for a visitor that reads code, not pages. It points that visitor to the pages that matter, with a one-line note on each link.

It is a proposal, not a formal standard, so no site has to publish one and no tool has to read one.

What does an llms.txt file look like?

It starts with one H1 line for the site name, then an optional short summary in a blockquote, then H2 sections with lists of links.

The llmstxt.org format guide lists the parts in a fixed order, and only the H1 is required.

PartRequired?What it does
H1 with the site nameYes, the only required partNames the site or project
Blockquote summaryNo, but recommendedSays what the site is and who it serves
Detail paragraphs or listsNoAdds facts an agent needs to read the links well
H2 sections with link listsNoGroups links by topic, each with a short note
Optional sectionNoHolds links an agent can skip when context is short

Each link uses Markdown, with a short note after a colon when it helps. The file stays short, and the full detail lives on the linked pages.

# Example Bakery
> A family bakery in Austin that sells bread, cakes, and classes.
## Products
- [Sourdough loaf](https://example.com/bread/sourdough/): Our daily loaf, baked each morning
- [Cake orders](https://example.com/cakes/): Sizes, flavours, and lead times
## Optional
- [Our story](https://example.com/about/): How the bakery started

A section named Optional holds links an agent can skip when it needs a shorter read. Put background reading there, and keep common questions in the main sections.

How does llms.txt work?

An AI tool fetches the file, reads the summary and link list, then follows only the links it needs for the task at hand.

The proposal also asks pages to offer a clean Markdown version at the same address, with .md added or the ending swapped for .md. A page at /docs/guide.html could offer /docs/guide.html.md, while an address with no file name would offer index.html.md or index.md.

Sites can point tools to these files with standard link relations. The llmstxt.org proposal recommends rel="alternate" with type text/markdown for the Markdown page, and rel="describedby" for the llms.txt file that covers it.

A file covers the pages under its own path, and the most exact file wins when more than one applies. A file at /docs/llms.txt covers the docs, while a file at the root covers the whole site.

The proposal says agents use the file most for software docs, where coding tools follow it to API pages and guides. The same shape also fits a shop listing its key policies, or a school listing its course pages.

How is llms.txt different from robots.txt and sitemap.xml?

They do three separate jobs: llms.txt suggests what to read, robots.txt sets crawl access, and sitemap.xml lists pages for search engines.

FileJobWho reads itDoes it block anything?
llms.txtShort summary plus key links for AI toolsAI tools and agents that look for itNo
robots.txtRules on which paths crawlers may fetchSearch and AI crawlers that follow the rulesYes, for crawlers that comply
sitemap.xmlFull list of pages for search enginesSearch enginesNo

Robots.txt is the only one that can keep a well-behaved crawler out of a path. Google Search Central notes that Google may find and index many file types, but that does not give llms.txt any special role in Search.

A sitemap can list thousands of pages, far more than an AI tool can read in one pass. The llmstxt.org proposal lists three gaps: a sitemap often lacks Markdown page versions, leaves out outside links, and covers too much at once.

If you want to stop an AI crawler from fetching your pages, that choice lives in robots.txt, not in llms.txt. Our guide to whether you should block GPTBot explains the trade-off between training and search crawlers.

Does Google use llms.txt?

No, Google Search does not use llms.txt, and you do not need the file to appear in Google Search, AI Overviews, or AI Mode.

Google's own guide puts llms.txt files and other special markup in a myth-busting list. Google Search Central states that you do not need new machine-readable files, AI text files, markup, or Markdown to appear in Google Search.

Adding the file will not lift a page in Google results, and leaving it out will not hold a page back, as of November 2026.

Google's view of AI-written pages is a separate question from this file. See does Google penalize AI content for what Google actually says about AI text on a page.

Do AI assistants actually read llms.txt?

No major AI company has said its assistant or crawler looks for llms.txt on other sites, as of November 2026.

The WordPress.org page for Project LLMs.txt states the same point in plain terms: no major search engine or LLM provider has officially announced that it seeks out llms.txt files.

Still, the format has real users in docs. The llmstxt.org proposal notes that OpenAI, Anthropic, and Gemini publish llms.txt files for their own developer docs, and Mintlify and GitBook build the file for the docs sites they host.

Chrome also checks for the file. A Lighthouse audit updated May 5, 2026 flags a page only when fetching llms.txt causes a server error, and marks the check Not Applicable when the file is missing with a 404.

The file may help a docs reader or a browsing agent today, and it may help more tools later, but no one can promise it will change how often AI answers cite your site.

If citations are your goal, the file is only one small step. Our guide on how to see if ChatGPT cites your site shows how to check what is actually happening.

Should a WordPress site publish an llms.txt file?

For most small WordPress sites, it is a low-cost optional file, not a must-have, so add it only after your main content is in good shape.

The case for it is simple: it costs little, it cannot hurt your Google rankings, and it gives any tool that looks for the file a clean path into your site. The case against it is simple too: it takes time to keep fresh, and no major AI company has promised to read it.

A docs-heavy site, a shop with clear product pages, or a site that AI tools already visit has the strongest reason to add one. A small blog with 10 posts gains less, since an AI tool can already read the whole site from its normal pages.

Think of the file as one part of being easy for AI tools to read, not as a shortcut to mentions. Our guide to how to get your brand mentioned in ChatGPT covers the wider steps that matter more.

How do you add llms.txt to WordPress?

You can add it by hand as a file in your site root, or let an SEO plugin or a dedicated plugin build it for you.

  1. Hand method: write the file in a text editor, save it as llms.txt, and upload it to the folder that holds wp-config.php.
  2. Yoast method: Yoast SEO added llms.txt support in version 25.3 on June 10, 2025, and the free plugin can build and serve the file for you.
  3. Dedicated plugin method: install Project LLMs.txt from Plugins, then Add New, then open its settings and click Generate Now.
  4. Check the result at yourdomain.com/llms.txt and confirm the H1, summary, and links look right.

Project LLMs.txt needs WordPress 6.4 or higher and PHP 8.1 or higher, and WooCommerce 7.0 or higher if you want product support. Its WordPress.org plugin page notes that files are written to the same folder as wp-config.php, or served live when the root is not writable.

Keep the file fresh. Project LLMs.txt keeps the 5 most recent copies before each rebuild, and its Pro version rebuilds within about a minute of a publish.

A new file can also add a little work for crawlers that fetch it, so watch your traffic after launch. Our guide on how AI crawlers affect WordPress bandwidth explains what to look for in your logs.

How do you check llms.txt on your site?

Open yourdomain.com/llms.txt in a browser and check that it loads, shows your site name, and links to live pages.

  1. Visit the address and read the H1 and summary.
  2. Click 3 or 4 links and confirm each one opens a live page.
  3. Run curl -I https://yourdomain.com/llms.txt in a terminal and look for a 200 status.
  4. Run a Lighthouse check and look for the llms.txt audit under agentic browsing.

A 404 means no file is there, which is fine, since the file is optional. A 500 error means the server failed to serve it, and that is the case Lighthouse flags.

Check the file again after big edits. Links go stale when pages move, and dead links tell an AI tool less than no file at all.

What are common myths about llms.txt?

The biggest myth is that llms.txt controls crawlers or lifts rankings, but it does neither of those things.

  • Myth: llms.txt blocks AI training. Fact: only robots.txt can ask a well-behaved crawler to stay out, and llms.txt grants or blocks nothing.
  • Myth: Google needs llms.txt for AI Overviews. Fact: Google Search Central says the file is not needed and not used for Search.
  • Myth: the file must list every page. Fact: it is a short list of key pages, and the Optional section holds the rest.
  • Myth: publishing the file guarantees AI citations. Fact: no major AI company has said it uses the file to pick sources.

A related myth is that the file replaces a sitemap. It does not: a sitemap lists pages for search engines, while llms.txt gives AI tools a short, hand-picked path.

What mistakes should you avoid?

Avoid stuffing the file with every page, stale links, or secret content, since each of those makes the file less useful.

  • Listing every post: keep the list short and link only to pages that answer real questions.
  • Leaving dead links: check links after you move or delete a page.
  • Adding private content: the file is public, so never put draft, admin, or customer details in it.
  • Forgetting updates: rebuild the file when your key pages change, or it will describe a site that no longer exists.
  • Copying another site's file: write your own summary, since a borrowed file points tools at the wrong pages.

A small, fresh file beats a long, stale one. Review it once a quarter, and treat it as a map you keep current.

Frequently asked questions

Do I need llms.txt for Google Search?

No. Google Search does not use the file, and you do not need it to appear in Search results, AI Overviews, or AI Mode. Your normal pages, clear headings, and good content decide how Google treats your site. Adding the file will not help or hurt your Google rankings.

Can llms.txt stop AI tools from using my content?

No. The file only suggests what an AI tool should read, and it grants or blocks nothing. If you want to ask crawlers to stay away from parts of your site, use robots.txt, which is the file crawlers are built to respect. Even then, only well-behaved crawlers follow the rules.

Does llms.txt replace my sitemap?

No. A sitemap lists pages for search engines, while llms.txt gives AI tools a short, hand-picked list of key pages with notes. The two files serve different readers and different jobs, so a site can publish both. Keep the sitemap full and the llms.txt file short.

How often should I update llms.txt?

Update it whenever your key pages change, such as after a redesign, a new service, or a moved guide. A stale file points AI tools at dead links or old facts, which is worse than no file at all. A quick check once a quarter is enough for most small sites.

What should I put in the Optional section?

Put background reading there, such as extra guides, older posts, or reference pages that help in some cases but are not central. AI tools short on context can skip that section, so keep your most useful pages in the main sections above it.

Is llms.txt the same as llms-full.txt?

No. The llms.txt file is a short index of links, while llms-full.txt holds the full text of your pages in one file. Some WordPress plugins build both, so an AI tool can read the short index first and fetch the full file only when it needs the detail.

Sources

  1. The /llms.txt file, v2 llmstxt.org
  2. Google's Guide to Optimizing for Generative AI Features on Google Search Google Search Central
  3. Yoast SEO 25.3 changelog Yoast
  4. llms.txt | Lighthouse Chrome for Developers
  5. Project LLMs.txt – AI SEO & llms.txt for WordPress & WooCommerce WordPress.org

Is your product missing, or something out of date?

Tell us what to add or correct. We read every note and reply when we need a source. A message does not buy a ranking.

About the editors

WPLegible editors

Researched from the primary sources listed above and checked against our editorial rules. About the site · How we test