Will an llms.txt File Help Your SEO?

So the real question is narrower than most guides admit. For classic SEO, the answer is settled. For AI search, no engine has said it reads the file, and server logs show its crawlers rarely ask for it. For agents that help developers, the file does get used. Our complete guide to getting indexed by LLMs with an llms.txt file covers the whole topic; this post sticks to the SEO value.

Below: what Google and the AI vendors say, what the log studies show, what the file costs you, and a decision table for who should add one. New to the file? Start with what an llms.txt file is. For the format itself, read the llms.txt standard, explained line by line.

What Google Says About llms.txt and Rankings

Google's position sits in its own documentation, not in a conference quote. The AI optimization guide on Search Central, last updated 10 July 2026, lists llms.txt under things "you can ignore for Google Search." It says you don't need "new machine readable files, AI text files, markup, or Markdown to appear in Google Search (including its generative AI capabilities), as Google Search itself doesn't use them."

The same passage adds a line many summaries skip: "It's completely fine if you decide to create and maintain LLMS.txt files (or other similar files) for other services or systems that use these files." So Google isn't warning you off. It's telling you the file sits outside Search.

AI Overviews and AI Mode follow the same rules

Google's AI features draw on its normal Search index. Its AI features page says a page must be "indexed and eligible to be shown in Google Search with a snippet" to appear as a supporting link, and that "there are no additional technical requirements." An llms.txt file isn't one of them.

John Mueller, a Search Advocate at Google, made the skeptic's case in April 2025. He called the file "comparable to the keywords meta tag": a site owner's claim about the site, which a search engine would check against the pages anyway.

Why a Lighthouse audit isn't a ranking signal

Chrome's Lighthouse does look for the file. Its Agentic Browsing category, added to the default config in Lighthouse 13.3.0 in May 2026, includes an llms.txt audit. That's a developer tool, not Search. Chrome's scoring notes call the category experimental and say it "does not have a weighted average score from 0 to 100." The audit page marks a missing file "Not Applicable," since "providing the file is optional at the moment."

A passing audit tells you the file exists and isn't broken. It says nothing about rankings.

What the Evidence Shows for AI Search

SEO in 2026 often means AI search too: being named and cited by ChatGPT, Claude, Perplexity and Gemini. Here the file has no confirmed effect either.

The vendors are silent on it

Each vendor's crawler page covers robots.txt rules and IP lists, not llms.txt. OpenAI's crawler overview and Perplexity's crawler page both point readers to their own llms.txt documentation index. Neither says its bots read yours. Anthropic's crawler article, updated 7 April 2026, covers ClaudeBot, Claude-User and Claude-SearchBot without a word about the file.

The logs show AI search bots rarely ask for it

Ahrefs looked at request data across 137,210 domains for May 2026. Of the sites that published an llms.txt file, 97% saw no requests for it at all. AI retrieval bots such as OAI-SearchBot and PerplexityBot made 1.1% of the requests that did occur. Claude-Code, Anthropic's coding agent, fetched the files more often than any AI retrieval bot.

Correlation studies point the same way. SE Ranking modelled AI citations across about 300,000 domains in November 2025 and found no link to having the file. Removing llms.txt from its model "actually improved its accuracy."

Our report on the state of llms.txt adoption sets these log studies next to Rankbox's own crawl. That crawl found the file on 31.3% of the 16,784 sites that answered on 28 September 2026, and on 44.5% of software companies. With a third of the sites in that sample already publishing one, an llms.txt file is unlikely to set you apart, even if an engine started reading it tomorrow.

Where the file does get read

The spec's authors say the file is "used most heavily for software documentation, where coding agents follow them", and the v2 changes page says "coding agents use them reliably." That's their own claim, but it fits the Ahrefs data. Ahrefs also saw zero AI bot requests for files that didn't exist, and concluded that AI tools fetch llms.txt "when a link, an index, or a user instruction tells them it exists."

Put simply, an agent sent to your docs may read the file. A search crawler building its index almost never does.

What an llms.txt File Costs You

The money cost is nil and the time cost is small. Several platforms now make the file for you:

• Shopify stores serve /llms.txt by default, pointing it at a store agents.md, per Shopify's 28 May 2026 changelog.
• Wix "automatically generates and maintains your llms.txt file" for upgraded sites with a custom domain, per its help page.
• Yoast SEO and AIOSEO add a generator to WordPress. Yoast's feature page says it builds the file "automatically with a click."
• Docs platforms such as Mintlify make one for every site they host.

By hand, a curated file of 10 to 30 links takes about an hour. The risks are small but real:

1. Stale facts. The file often repeats prices and plan names. When those change and the file doesn't, an agent reads the old version. On Wix, editing the file by hand stops its automatic updates.
2. A fake file. Some sites answer /llms.txt with their homepage and a 200 status. Rankbox's crawl counted HTML pages at that path on 7.4% of sites. An agent that expects Markdown gets markup instead; our llms.txt guide shows how to make missing files return a real 404.
3. The file showing up in search. Google can index text files. Mueller said a noindex header could make sense "as sites might link to it and it could otherwise become indexed."
4. Edits you didn't make. Ahrefs advises treating the file "like code": keep it in version control, limit who can change it and review anything a plugin writes, since agents act on what it says.
5. Opportunity cost. An hour on llms.txt is an hour not spent on crawler access, rendering or content, which do move AI visibility.

None of these is an SEO penalty. Google says the file can't hurt rankings, and a stale file takes minutes to fix.

The llms.txt Payoff Matrix: Who Should Add One

The value depends on who reaches your site through agents. The llms.txt Payoff Matrix sorts common kinds of site by who is likely to read the file, then gives a verdict. It's Rankbox's rule of thumb from the evidence above, not a vendor rule.

Three questions make the call for most sites:

1. Do developers or agents use your docs? If yes, add the file.
2. Does your platform make one anyway? If yes, spend ten minutes checking that it's accurate.
3. Can AI search crawlers reach your pages? If not, the file is the wrong fix.

If you said no to the first two and yes to the third, the file is optional. Adding it won't hurt, and skipping it won't cost you rankings. Local businesses get more from consistent listings; see our guide to optimizing a business for AI search engines.

What Moves SEO More Than llms.txt

If the goal is Google rankings or AI citations, spend the hour on these first:

• Crawler access. Allow Googlebot, Bingbot, OAI-SearchBot, Claude-SearchBot and PerplexityBot in robots.txt and at your CDN. Our robots.txt tester checks each token, and our post on getting indexed by an LLM through llms.txt walks through each engine's route in.
• Server-rendered pages. Crawlers that don't run JavaScript see an empty shell.
• Answer-first content. Pages that answer buyers' questions with facts and sources are what AI answers quote. See how to optimize content for AI search.

If you do publish an llms.txt file, look at your server logs a month later. The free AI crawler log analyzer shows which bots fetched it. A file nobody requests is harmless, and that's the honest baseline to expect.

Rankbox works on the third item. Its Citation-Ready Writer researches the live web and writes source-backed articles that answer the questions your buyers ask AI. Rankbox doesn't create or manage llms.txt files for you, though the free llms.txt generator writes one from a form, and it doesn't track AI citations today. Plans are on the pricing page.