A useful llms.txt file is short, clear, and focused on your most important resources.
Create llms.txt by adding a plain text file at your site root with a short site summary and links to important pages, docs, and AI-readable resources.
llms.txt helps AI agents identify authoritative website resources. It should include concise descriptions, relevant links, and optional Markdown indexes.
Main Explanation
Start with a short description of what your website does. Then list the pages an AI agent should understand first.
Avoid turning it into a full sitemap. The goal is guidance, not volume.
Practical Steps
- Create /llms.txt at the root.
- Add a site summary.
- List key pages with short labels.
- Add Markdown or docs links.
- Expose it with a Link header if possible.
FAQ
What format should I use?
Plain text or Markdown-style lists are common and easy to parse.
Can I automate it?
Yes, but review it manually so it stays useful.
Should it include private URLs?
No. Only include public resources you want agents to find.
Editorial methodology
TruboRankAI publishes practical guidance from observable website signals, reproducible checks, and cited primary or first-party references when platform behavior or measured claims can change. Crawler access, indexing, search visibility, mentions, citations, referral visits, and conversions are treated as separate signals. Readers should verify time-sensitive settings and policies against the linked official documentation.