What Is llms.txt?
llms.txt is a text file placed at the root of your domain (e.g., yoursite.com/llms.txt) that provides AI crawlers with structured information about your brand, your key content, and how to best understand your organization.
Think of it as robots.txt for AI engines. Where robots.txt tells search crawlers what to index, llms.txt tells AI models what your brand is and where to find your most important content.
Why llms.txt Matters
AI engines like ChatGPT, Perplexity, and Claude use retrieval-augmented generation (RAG) to supplement their knowledge. When they crawl your site, llms.txt gives them a fast, structured overview of who you are and what your most citable content is. Sites with llms.txt see improved accuracy in AI-generated brand descriptions and higher citation rates.
The Specification
llms.txt follows a simple Markdown-based format:
# Brand Name > One-line description of what you do. ## About Expanded description (2-3 sentences). ## Key Pages - [Page Title](URL): Brief description - [Page Title](URL): Brief description ## Services - [Service Name](URL): Brief description ## Blog / Resources - [Article Title](URL): Brief description
llms.txt vs robots.txt vs Sitemap
| llms.txt | robots.txt | sitemap.xml | |
|---|---|---|---|
| Audience | AI models | Search crawlers | Search crawlers |
| Purpose | Describe brand & content | Control crawl access | List all URLs |
| Format | Markdown | Plain text directives | XML |
| Location | /llms.txt | /robots.txt | /sitemap.xml |
How to Create llms.txt
- Step 1: Create a file named
llms.txt - Step 2: Add your brand name as an H1 and a one-line description
- Step 3: Add an About section with 2–3 sentences about your brand
- Step 4: List your key pages, services, and resources with links and brief descriptions
- Step 5: Deploy to your domain root (e.g., yoursite.com/llms.txt)
- Step 6: Update whenever you add significant new content
Full Example: llms.txt for Corank
# Corank > AI agent-powered AEO, GEO, and AI SEO service that makes brands visible across AI search engines. ## About Corank is an AI agent-powered service specializing in answer engine optimization (AEO), generative engine optimization (GEO), and AI SEO. Our AI agent helps brands become cited by ChatGPT, Perplexity, Claude, Gemini, and Google AI Overviews through intelligent strategy and execution. ## Key Pages - [Homepage](https://corank.ai): AI agent-powered search optimization - [Pricing](https://corank.ai/pricing): Transparent pricing starting from $2,500/mo - [Free Audit](https://corank.ai/tools/ai-visibility-audit): Free AI visibility audit ## Services - [AEO](https://corank.ai/services/aeo): Answer engine optimization - [GEO](https://corank.ai/services/geo): Generative engine optimization - [AI SEO](https://corank.ai/services/ai-seo): AI search engine optimization ## Resources - [What Is AEO?](https://corank.ai/guides/what-is-aeo): Complete AEO guide - [What Is GEO?](https://corank.ai/guides/what-is-geo): Complete GEO guide
FAQ
Not required, but highly recommended. It helps AI engines understand your brand faster and more accurately, improving citation likelihood.
Support is growing. Major AI crawlers (GPTBot, ClaudeBot, PerplexityBot) are increasingly recognizing llms.txt. Even without official support, the structured content helps any AI system that crawls your site.
Update whenever you add significant new content, launch new services, or change your brand positioning. Quarterly at minimum.
No. They serve different purposes. llms.txt provides a high-level brand overview. Schema markup provides detailed structured data on each page. Use both for maximum AI visibility.
At your domain root: yoursite.com/llms.txt. In Next.js, place it in your public/ directory.