LLMs.txt — definition
LLMs.txt is an emerging web standard file (located at `/llms.txt`) that provides a concise, Markdown-formatted directory of a website's most authoritative pages and facts specifically tailored for LLM scrapers.
Expanded Explanation
Proposed as a companion to `robots.txt` and `sitemap.xml`, `llms.txt` offers clean, token-efficient Markdown summaries and links, allowing AI search crawlers to index key company information without parsing heavy HTML/JS layouts.
Analogy & Mental Model
LLMs.txt is like handing a speed-reader an executive cheat sheet with direct links to core chapters rather than making them skim a 500-page catalog.
Why It Matters & Where It's Used
Adopting `llms.txt` reduces crawler parsing noise and increases the accuracy and frequency of AI search citations across ChatGPT, Perplexity, and Claude.
Concrete Real-World Application
A SaaS platform hosting `/llms.txt` containing direct Markdown summaries of its API documentation, pricing tiers, and product comparison guides.
LLMs.txt vs sitemap.xml
`sitemap.xml` lists raw URLs for traditional search indexing, whereas `llms.txt` provides rich, LLM-ready Markdown summaries optimized for RAG context extraction.
How It Works & Key Components
Served as plain text at the root directory of a domain.
1Root File Placement
Hosting plain text Markdown at `https://yourdomain.com/llms.txt`.
2Structured Header & Summary
Providing a brief H1 title, project description, and core factual statements.
3Curated Resource Links
Linking to high-value documentation, research reports, and product pages with descriptive anchor copy.
Frequently Asked Questions
Q:Should every website create an llms.txt file?
Yes, implementing `/llms.txt` is one of the fastest, lowest-effort technical AEO wins for improving AI search discovery.
Q:What is the difference between llms.txt and llms-full.txt?
`/llms.txt` contains a curated index of links with short summaries, while `/llms-full.txt` contains the full text of all core documentation concatenated into a single Markdown file.
llmstxt.org Specification
The community standard defining Markdown proposal structures for LLM web ingestion.
Get cited across ChatGPT, Perplexity & Gemini with citedby
Optimize your brand ’s AI visibility score, track Share of Model across buyer prompts, and turn zero-click search into your highest-converting pipeline source.
Explore citedby Platform