2026 Guide
10 min read
If someone has told you that your website needs an llms.txt file to show up in ChatGPT, Google’s AI Overviews or other AI answers, you’re not alone. It’s become one of the most talked-about “AI SEO” tactics of the past two years. The reality is more modest, and Google has now said plainly what the file does and doesn’t do for its own search results.
llms.txt is a proposed Markdown file placed at the root of a website (yoursite.com/llms.txt) that gives AI tools a short, curated guide to your most important pages. It is a community proposal, not an official standard. Google says Google Search, including AI Overviews and AI Mode, doesn’t use it, so it won’t help or hurt your Google rankings. Most business websites don’t need one; it’s most useful for documentation and developer-focused sites.
This guide explains what llms.txt is, where it came from, what the file looks like, what Google and the available usage data say, who might genuinely benefit, and what to focus on instead if your real goal is appearing in AI answers.
What Is llms.txt?
llms.txt was proposed by Jeremy Howard in September 2024. The proposal, published at llmstxt.org, describes it as a way “to provide information to help agents use a website.” The idea is that large language models (LLMs) and AI agents struggle with full web pages full of navigation, scripts and ads, so a site can offer a clean, short summary that points them to the content that matters.
Three points about its status are worth being clear on:
- It’s a proposal: the site itself calls it an informal overview and says the specification is “open for community input.”
- It’s not like robots.txt: robots.txt tells crawlers what they may access. llms.txt doesn’t control access at all; it only offers a reading guide.
- Nothing forces AI tools to read it: whether any system uses the file is up to that system.
What Does an llms.txt File Look Like?
According to the proposal, the file is written in Markdown and placed at /llms.txt (or at a subpath such as /docs/llms.txt). It follows a simple order:
- An H1 with the site or project name, the only required part
- A blockquote with a short summary
- Optional notes in plain Markdown (no headings)
- H2 sections listing links, each as
[name](url): short note - An “Optional” H2 section for secondary links an AI tool can skip
Example llms.txt for a fictional dental clinic
# Example Dental Clinic > Family and cosmetic dental clinic. Services, prices, booking and patient guides. ## Services - [Teeth whitening](https://example.com/teeth-whitening/): in-clinic treatment, cost and aftercare - [Dental implants](https://example.com/dental-implants/): process, recovery time and pricing ## Patient guides - [What to expect at your first visit](https://example.com/first-visit/) ## Optional - [About our team](https://example.com/about/)
The proposal also suggests offering clean Markdown copies of important pages (for example page.html.md). You may also see llms-full.txt mentioned online; that’s a related convention for a single file containing full page text, but it isn’t part of the core proposal page.
Does llms.txt Help You Rank in Google or AI Overviews?
No. Google answered this directly in its official guide to optimizing for generative AI features on Google Search, published in May 2026. Under “what you don’t need to do,” Google lists llms.txt and other “special” markup, saying you don’t need new machine-readable files, AI text files, markup or Markdown to appear in Google Search, including its generative AI features, because Google Search itself doesn’t use them.
Google also makes clear it isn’t against the file. It says it’s completely fine to create and maintain one for other services that use it, and that doing so will neither harm nor help your visibility or rankings in Google Search, because Google Search ignores it.
What About ChatGPT, Claude and Other AI Tools?
This is less clear, because most AI companies haven’t published a firm position. Industry reporting so far suggests the file is rarely read by AI systems in practice.
A July 2026 report by PPC Land, summarizing data from Originality.ai and Ahrefs, found that:
| Finding | Reported Figure | Data Source (as reported) |
|---|---|---|
| Sites with llms.txt | Grew from 4,088 (June 2025) to 36,120 (May 2026) | Originality.ai, 3M+ sites tracked |
| Files receiving zero requests | 97% in May 2026 | Ahrefs server logs, 137,000 domains |
| Requests from AI retrieval bots | 1.1% of requests to llms.txt files | Ahrefs server logs |
The same report notes that OpenAI’s and Anthropic’s crawler documentation points site owners to robots.txt for managing crawlers, not llms.txt. Treat these figures as industry findings rather than official statements: they come from third-party log data, and AI companies can change how their tools behave at any time.
Does Your Website Need an llms.txt File?
| Type of Website | Worth Adding? | Why |
|---|---|---|
| Software, API or developer documentation | Often yes | Coding assistants and agents may use it to find the right docs |
| Large knowledge base or help center | Optional | Low cost if your CMS can generate and update it automatically |
| Local service business | Usually not a priority | No Google benefit; little evidence of AI tools reading it |
| E-commerce store | Usually not a priority | Product feeds, Merchant Center and structured data matter far more |
| Blog or content site | Optional, low impact | Harmless, but won’t replace good content and clean site structure |
If you do add one, keep it accurate. A file that lists deleted pages or old prices is worse than no file. Ideally have your CMS generate it, so it updates whenever your pages change.
How to Add an llms.txt File (If You Decide To)
Services, key guides, pricing, contact. Keep the list short; the point is curation.
Follow the order above: H1 name, blockquote summary, H2 link sections, an Optional section.
It should load at yoursite.com/llms.txt. If your CMS or SEO plugin offers to generate it, review the output before relying on it.
Review it whenever you add, remove or rename important pages.
Your hosting logs show whether any bot actually requests the file. That’s the only reliable way to know it’s being used on your site.
What to Focus on Instead for AI Visibility
If the real goal is showing up in AI answers, Google’s guide points to the same foundations as regular SEO:
- Crawlable, indexed pages: a page must be indexed and eligible for a normal snippet to appear in Google’s AI features.
- Non-commodity content: first-hand experience and expert insight that goes beyond common knowledge.
- Clear structure: paragraphs, sections and headings written for people.
- Good page experience: fast, mobile-friendly, easy to tell main content from everything else.
- Accurate business details: Google Business Profile and Merchant Center where relevant.
For more on this, read what makes content rank in AI answers and how AI Overviews are changing SEO.
Common llms.txt Mistakes
- Expecting Google ranking gains, which Google says won’t happen
- Confusing it with robots.txt, since llms.txt can’t block or allow any crawler
- Paying for it as a standalone “AI SEO” service instead of fixing content and site structure
- Letting it go stale, with links to deleted or outdated pages
- Listing every page on the site, which defeats the purpose of a short, curated guide
- Putting claims in it that aren’t on your site, since it should summarize real pages, not add new promises
Want to Show Up in AI Answers?
Serpistan focuses on what Google’s guidance says actually matters for AI search: crawlable pages, clear structure, and content worth citing.
Frequently Asked Questions
Is llms.txt an official web standard?
No. It’s a community proposal first published in September 2024. The proposal page describes it as an informal overview that’s open for community input.
Does Google use llms.txt?
No. Google says Google Search, including AI Overviews and AI Mode, ignores llms.txt and similar AI files. Having one won’t help or hurt your rankings.
What’s the difference between llms.txt and robots.txt?
robots.txt tells crawlers which parts of your site they may access. llms.txt only offers AI tools a summary of your key pages; it doesn’t allow or block anything.
Can llms.txt stop AI companies from using my content?
No. To manage AI crawlers, use robots.txt rules for the specific crawler names each AI company publishes in its own documentation.
Does ChatGPT read llms.txt?
OpenAI hasn’t published a commitment to use it for search. Third-party log data reported in 2026 shows OpenAI’s crawler occasionally requesting the file, but rarely, and that isn’t evidence it affects answers.
Can adding llms.txt hurt my website?
Not in Google Search, according to Google. The main risk is an outdated file pointing AI tools to wrong or deleted information, so keep it accurate if you add one.
What is llms-full.txt?
A related convention where a site publishes the full text of its key pages in one file, rather than just links. It’s far less common than llms.txt and carries the same caveats.
Sources / References
- Google Search Central, “Optimizing your website for generative AI features on Google Search”
- Jeremy Howard, “The /llms.txt file”, llmstxt.org
- PPC Land, “llms.txt adoption rises 8.8x but 97% of files get zero AI requests”, July 2026 (industry report)