Tools

llms.txt: the AI sitemap, explained

llms.txt is a proposed standard that lets website owners give AI assistants a structured guide to their content. Here's the format, who supports it, and whether it matters.

By AEO Scanner··5 min read·Updated May 6, 2026

llms.txt is a proposed file format that gives AI assistants a structured summary of your website's content. Think robots.txt for crawl rules, sitemap.xml for URL discovery, llms.txt for AI summarization. It's not yet a hard standard, but it costs nothing to ship and several AI providers are starting to honor it.

The format

Markdown file served at /llms.txt. First line is an H1 with your site title. Then a blockquote with a one-paragraph description. Then sections with bulleted links to key URLs and one-line descriptions.

# Acme

> Acme builds [thing] for [audience]. Founded in [year], headquartered in [place].

## Product
- [Pricing](https://acme.com/pricing): three tiers, $39 / $99 / $299 per month
- [Docs](https://docs.acme.com): full API and integration documentation

## Resources
- [Blog](https://acme.com/blog): tactical guides on [category]

Who honors it

As of mid-2026: Anthropic's Claude and Perplexity have both publicly said they respect llms.txt for context discovery. OpenAI hasn't formally endorsed it but their crawler appears to fetch it. Independent indices and AI-focused search engines increasingly use it as a structured signal.

Should you ship one?

Yes. It costs 30 minutes to write and serves three purposes:

  • Some AI crawlers actually use it.
  • You're forced to articulate what your site actually offers in a few hundred words, which is a useful exercise.
  • If the standard catches on, you're ahead.

The companion file

Many sites also publish /llms-full.txt — a longer markdown document with the full canonical content of the site, optimized for AI consumption. Useful for docs sites in particular: it gives the LLM one URL to fetch instead of dozens.

What it isn't

llms.txt is not a magic visibility booster. If your brand isn't in the citation sources LLMs trust, llms.txt won't fix that. It's a hygiene file, not a strategy.

Tags:llms.txtstandardstools
Run your own scan

Find out where you stand in ChatGPT and Claude.

AEO Scanner runs ~30 buyer queries against ChatGPT and Claude with live web search, then hands you a concrete fix list. 3-day free trial.

llms.txt: the AI sitemap, explained · AEO Scanner