---
title: "How to Make Your Website Accessible to AI with llms.txt"
url: https://wpvibes.com/blog/make-website-accessible-ai-tools-using-llms-txt/
date: 2026-08-27
modified: 2026-10-14
author: "Rashi"
description: "A simple guide to llms.txt: what it does, why it isn't the same as robots.txt, and how to add it in WordPress with a plugin or manually."
categories:
  - "General"
tags:
  - "AI SEO"
  - "AIOSEO"
  - "GEO"
  - "llms.txt"
  - "Rank Math"
  - "robots.txt"
  - "Yoast SEO"
image: https://wpvibes.com/wp-content/uploads/2026/08/llms-txt-wordpress-ai-tools-1024x538.png
word_count: 1446
---

# How to Make Your Website Accessible to AI with llms.txt

llms.txt is a plain text file that gives AI tools like ChatGPT and Claude a short, curated guide to your best content. It’s quick to add to WordPress, usually with a single toggle in your SEO plugin.

It’s also widely misunderstood. llms.txt is not an AI version of robots.txt, and it can’t block or control AI crawlers. This guide explains what llms.txt actually does, whether your site needs one, and how to add it with a plugin or by hand.

## What Is an llms.txt File?

An llms.txt file is a Markdown file at the root of your website (`yoursite.com/llms.txt`) that tells AI tools what your site is about and where your most important content lives. Instead of guessing from menus and page layouts, an AI tool gets a clean list of your best pages.

llms.txt was proposed by Jeremy Howard in September 2024. It’s an open convention, not an official web standard, and you can read the full [llms.txt specification](https://llmstxt.org).

![How llms.txt helps AI tools understand WordPress website content](https://wpvibes.com/wp-content/uploads/2026/08/how-llms-txt.works-wordpress.png)How llms.txt helps AI tools understand WordPress website content

### What’s the Difference Between llms.txt and llms-full.txt?

llms.txt is the short version: a summary with links to your key pages.

-> llms-full.txt contains your actual content combined into one Markdown file.

-> llms-full.txt isn’t part of the original proposal, but many tools now generate both. A small site usually only needs llms.txt; a large documentation site benefits from both.

## Is llms.txt the Same as robots.txt?

No. robots.txt controls which pages bots are allowed to crawl and can block them. llms.txt can’t block anything; it’s a reading guide for AI tools that are already free to visit your site. Both are plain text files in your site’s root folder, which is where the confusion comes from.

| File | Purpose | Can it block AI bots? | Who reads it |
| ---- | ------- | --------------------- | ------------ |
| robots.txt | Sets crawling permissions | Yes | Search engine and AI crawlers |
| llms.txt | Curated guide to your best content | No | AI tools that choose to read it |
| sitemap.xml | Lists all pages you want indexed | No | Search engines |

If you want to block or allow AI crawlers like GPTBot or ClaudeBot, that’s still robots.txt’s job. It’s worth checking that your robots.txt isn’t blocking them by accident. That check is part of the bigger picture of [SEO, AEO, and GEO](https://wpvibes.com/blog/seo-vs-aeo-vs-geo/).

![Difference between robots.txt, sitemap.xml, and llms.txt](https://wpvibes.com/wp-content/uploads/2026/08/robots-txt-llms-txt-sitemap-wordpress.png)Difference between robots.txt, sitemap.xml, and llms.txt

## Do You Actually Need an llms.txt File?

No, llms.txt is optional. It doesn’t affect your Google rankings, and Google says you don’t need [special AI text files](https://developers.google.com/search/docs/appearance/ai-features) to appear in AI Overviews. Adding one also doesn’t guarantee that ChatGPT or any other AI tool will cite you.

What it can do is help AI tools that choose to read it represent your site accurately, at almost no cost. It won’t change what visitors see or affect your Core Web Vitals, and it works alongside your SEO plugin.

**Worth adding:** documentation sites, plugin knowledge bases, and business sites where accurate AI answers matter to you, especially if your SEO plugin can generate it in one click.

**Low priority:** small brochure sites with a handful of pages. It won’t hurt, but stronger content and basic SEO come first.

## What Does an llms.txt File Look Like?

An llms.txt file has a site name, a one-line summary, and sections of links with short descriptions. Here’s a simple example:

# WPVibes

> WPVibes builds practical WordPress plugins for content management, WooCommerce, and the Elementor and Bricks page builders.

## Plugins

- [Content Lifecycle Manager](https://wpvibes.com/plugin/content-lifecycle-manager/): Track content ownership and review dates.
- [Frontend Product Editor](https://wpvibes.com/plugin/frontend-product-editor-for-woocommerce/): Edit WooCommerce products from the frontend.

## Guides

- [How to Add llms.txt to WordPress](https://wpvibes.com/blog/make-website-accessible-ai-tools-using-llms-txt/): What llms.txt is and how to set it up.
- [SEO vs AEO vs GEO](https://wpvibes.com/blog/seo-vs-aeo-vs-geo/): How search and AI optimization fit together.

## Optional

- [About Us](https://wpvibes.com/about-us/): Company background and team.

`#` is your site name, the only required line.

`>` is a one- or two-sentence summary.

Each `##` heading starts a section of links, with a short description after the colon.

`## Optional` marks links an AI tool can skip if it needs to save space.

**Important:** Don’t list private content in llms.txt, such as password-protected pages, account or checkout pages, or anything behind a login. llms.txt can’t restrict access, so anything you list is treated as fair game.

## How Do You Check Whether Your Site Already Has llms.txt?

Open `https://yoursite.com/llms.txt` in your browser, replacing `yoursite.com` with your domain. If a file appears, a plugin is probably already generating it; check your SEO plugin’s settings before adding another one.

## How Do You Add llms.txt to WordPress Using a Plugin?

WordPress can’t serve a file at your site’s root on its own, so most site owners use a plugin. Yoast SEO, Rank Math, and All in One SEO all have llms.txt built in, and a few dedicated AI SEO plugins go further.

● Option 1 of 4

### Yoast SEO

Go to **Yoast SEO > Settings > Site features**, find **llms.txt** under **AI tools**, switch it on, and click **Save changes**. [Yoast](https://yoast.com/help/enable-llmstxt/) keeps the file updated automatically, and you can hand-pick which pages it includes. llms.txt isn’t available on multisite installs.

![Enable llms.txt in Yoast SEO](https://wpvibes.com/wp-content/uploads/2026/08/enable-llms-txt-yoast-wordpress.jpg)Enable llms.txt in Yoast SEO

● Option 2 of 4

### Rank Math

Go to **Rank Math SEO > Dashboard** and turn on the **LLMS Txt** module. Then open **Rank Math SEO > General Settings > Edit llms.txt** to choose post types and taxonomies. [Rank Math](https://rankmath.com/kb/llms-txt/) leaves out noindexed content and lists up to 100 items by default.

**Note:** Rank Math’s file stays empty until you choose what to include, so don’t skip the settings step.

![Enable llms.txt in Rank Math SEO](https://wpvibes.com/wp-content/uploads/2026/08/enable-llms-txt-rankmath-wordpress.jpg)Enable llms.txt in Rank Math SEO

● Option 3 of 4

### All in One SEO (AIOSEO)

[AIOSEO](https://aioseo.com/docs/how-to-create-an-llms-txt-using-all-in-one-seo/) turns llms.txt on by default. To review it, go to **All in One SEO > Sitemaps** and open the **LLMs.txt** tab. There you can exclude specific posts, pages, or terms, and generate an llms-full.txt file.

![Enable llms.txt in All in One SEO](https://wpvibes.com/wp-content/uploads/2026/08/enable-llms-txt-aioseo-wordpress.jpg)Enable llms.txt in All in One SEO

● Option 4 of 4

### RankReady

[RankReady](https://wordpress.org/plugins/rankready-ai-llm-seo/) is a free plugin dedicated to AI search, built to run alongside Yoast, Rank Math, or AIOSEO. It generates llms.txt and llms-full.txt, and serves a clean Markdown version of every post at its own URL (`/post-slug.md`). It’s newer and smaller than the other three, with around 400 active installs.

![Enable llms.txt in RankReady](https://wpvibes.com/wp-content/uploads/2026/08/enable-llms-txt-rankready-wordpress.jpg)Enable llms.txt in RankReady

## How Do You Add llms.txt to WordPress Manually?

Write the file in a plain text editor using the structure above, and save it as `llms.txt`. Then upload it with FTP or your host’s **File Manager** to your site’s root folder, the one that contains **wp-config.php**, not **wp-content** or a theme folder. A manual file doesn’t update itself, so edit it whenever you publish something important.

Where llms.txt goes in a manual upload: in the site's root folder (public_html), next to wp-admin, wp-content, wp-includes, index.php, and wp-config.php. Not inside wp-content or a theme folder. Once uploaded, the file opens at yoursite.com/llms.txt and shows the site name, a one-line summary, and sections of links

**Important:** If your SEO plugin already generates llms.txt, turn that feature off first. Two versions conflict, and only one will be served.

If you get a 404 error after uploading, clear your site’s cache. That fixes it in most cases.

## How Do You Get the Most Out of Your llms.txt File?

List your best content, not everything. A short, focused list works better than a long one.

Write a real description for each link, not a repeated keyword.

Keep it current. Remove outdated pages and add important new ones.

Remember that llms.txt can’t fix thin or outdated content. It only points AI tools to what’s already there.

## Frequently Asked Questions

### Can llms.txt block AI bots?
No. llms.txt can’t block or restrict any bot. To block specific AI crawlers such as GPTBot or ClaudeBot, add rules to your robots.txt file instead.
### Does Google use llms.txt?
Google says you don’t need AI text files or special markup to appear in AI Overviews or AI Mode, so llms.txt won’t help your Google rankings. It’s aimed at other AI tools that choose to read it.
### Do I need llms.txt if I already have a sitemap?
They do different jobs. A sitemap lists every page you want search engines to index. llms.txt is a short, curated guide for AI tools. Having both is fine, and most SEO plugins can generate both.
### Is llms.txt required for WordPress SEO?
No. It’s entirely optional, and your site will rank normally without one. It’s a low-effort extra for AI visibility, not part of standard SEO.

## Conclusion

llms.txt is a short guide that points AI tools to your best content. It can’t block crawlers, and it isn’t required, but it takes minutes to set up with Yoast, Rank Math, AIOSEO, or a manual upload.

llms.txt only points AI tools to your content; it can’t keep that content correct. [Content Lifecycle Manager](https://wpvibes.com/plugin/content-lifecycle-manager/) gives every post an owner and a review date, so the pages you point AI tools to stay worth citing.