llms.txt is a simple Markdown file you place at the root of your domain (yourdomain.com/llms.txt) that points AI engines and large language models to your most important, citable content — written in clean, easy-to-parse text. Think of it as the AI-era companion to robots.txt and sitemap.xml: where robots.txt says what crawlers may access and sitemap.xml lists every URL, llms.txt curates the handful of pages you most want an AI to read and understand.
Here's what it is, what goes in it, whether it's worth your time, and a template you can copy today.
It's not a fringe topic, either. "llms.txt" pulls roughly 5,400 US searches/mo (difficulty 50) and "llms.txt generator" about 590/mo (difficulty 30) — live keyword data (May 2026) from our Keyword Research module. When we ran the full keyword pool through our AI clustering, the demand split into clear themes: definition & spec, generators & tools, platform setup (Shopify, WordPress, Webflow, Wix, Squarespace, Vercel), and comparisons (vs robots.txt, sitemap.xml, agents.md, MCP). We cover each below.
What problem does llms.txt solve?
When an AI engine visits your site, it faces messy HTML — navigation, ads, scripts, and boilerplate wrapped around the actual content. Parsing that to find the substance is lossy and expensive. The llms.txt proposal (introduced by Jeremy Howard of Answer.AI in 2024) offers a clean, curated, Markdown summary of your site so a model can grasp what you're about and where your best content lives — without wading through page clutter.
llms.txt vs robots.txt vs sitemap.xml
| File | Audience | Purpose |
|---|---|---|
robots.txt | All crawlers | Access rules — what may or may not be crawled |
sitemap.xml | Search crawlers | A complete machine list of every URL |
llms.txt | AI engines / LLMs | A curated, readable guide to your best content |
They're complementary. Keep robots.txt permissive to AI crawlers (see how to rank on ChatGPT), keep your sitemap complete, and add llms.txt as the curated layer on top.
What goes in an llms.txt file
The format is intentionally simple Markdown:
- An H1 with your site or company name.
- A blockquote one-line summary of what you do.
- Optional short context paragraphs.
- H2 sections grouping links (e.g. "Core docs," "Guides," "Products"), each a Markdown link with a short description.
- An optional "Optional" section for lower-priority links an engine can skip when short on context.
A copy-paste llms.txt template
Start from this and swap in your own pages:
# Your Company
> One sentence on what you do and who it's for.
Brief context: what your product is, the main problems it solves, and anything
an AI should know to describe you accurately.
## Core pages
- [Home](https://yourdomain.com/): what the product is
- [Pricing](https://yourdomain.com/pricing): plans and what's included
- [How it works](https://yourdomain.com/how-it-works): the workflow in steps
## Guides
- [Complete guide to X](https://yourdomain.com/blog/x): the pillar explainer
- [How to do Y](https://yourdomain.com/blog/y): step-by-step
## Optional
- [About](https://yourdomain.com/about): company background
- [Changelog](https://yourdomain.com/changelog): recent updates
Save it as llms.txt and serve it at your domain root with a text/plain or text/markdown content type. (Outerank publishes its own at outerank.com/llms.txt if you want a real-world reference.)
How to add llms.txt to your CMS
The mechanics differ by platform, but the goal is identical everywhere: serve a plain-text Markdown file at yourdomain.com/llms.txt (HTTP 200, content-type text/plain or text/markdown).
- WordPress: upload the file to your site root via SFTP or a file-manager plugin, or use an SEO plugin that supports custom files. Avoid pasting it into a post — it must live at the root path, not a page URL.
- Shopify: Shopify locks the root directory, so use a redirect/route or an app that can serve a root-level file; alternatively host it on a subdomain or proxy. Confirm it returns plain text, not your theme's HTML.
- Webflow: add it as a hosted asset or use a reverse proxy (e.g. Cloudflare Worker) to serve
/llms.txtat the root, since Webflow doesn't expose arbitrary root files directly. - Wix & Squarespace: both restrict root-level files; the reliable route is a Cloudflare (or similar) proxy rule that serves the file at
/llms.txt. - Next.js / Vercel: the cleanest of all — drop
llms.txtinto yourpublic/folder (or add a route) and it's served at the root automatically. (That's exactly how Outerank ships its own.)
Whatever the platform, the test is the same: open yourdomain.com/llms.txt in a browser and confirm you see clean Markdown, not a styled web page.
Is llms.txt worth it? An honest assessment
Here's the balanced truth: llms.txt is a proposed standard with growing but not universal adoption. The major engines have not all publicly committed to consuming it, and there's no guarantee a given model reads yours today. So treat it as low-cost insurance and good hygiene, not a magic citation switch.
The case for doing it: it takes minutes, it can't hurt you, it forces you to clarify your most important pages (useful regardless), and if adoption grows you're already positioned. The case for not over-investing: it won't substitute for the things that actually drive citations today — ranking, crawlability, answer-first content, entity coverage, and authority. Do those first; add llms.txt as a finishing touch.
How to create your llms.txt (step by step)
- List your 10-20 most important URLs — the pages you'd most want an AI to understand and cite.
- Write a one-line summary of your site for the blockquote.
- Group the links under clear H2 sections with a short description each.
- Move lower-priority links into an "Optional" section.
- Save as
llms.txtand deploy it at your domain root. - Validate it loads at
yourdomain.com/llms.txtas plain text.
Some teams also publish llms-full.txt with the full text of key docs inlined, for engines that want the content directly. Start with the basic curated file; add the full version only if you maintain documentation worth inlining.
llms.txt is one signal, not the strategy
Ship llms.txt, but keep it in perspective: it's a helpful pointer, not the engine of AI visibility. The fundamentals do the heavy lifting — be crawlable, rank well, write answer-first content, cover your entities, and build authority. llms.txt just makes it a little easier for an AI to find and understand the great content you've already built.
Put it alongside the rest of your AI-search program: the foundations in our complete GEO guide, the engine playbooks for ChatGPT and Perplexity, and the answer-first habit in Answer Engine Optimization. Start free.