AI & Websites 6 min read

What is llms.txt, and does your website need one?

A proposed file for AI tools. What it does, who uses it, and whether it is worth adding.

On this page 9 sections

Every few months a new file or tag is promoted as the way to get your website noticed by AI assistants. The one discussed most often is llms.txt, a plain-text file placed at the root of a site to help large language models understand its content.

It sounds like something every site should have. The reality is more modest. This guide explains what llms.txt is, how it differs from files you already have, who actually reads it, and how to decide whether it is worth the effort for a business website.

The short answer

llms.txt is a proposed standard: a Markdown file at /llms.txt that summarises a site and links to its most useful pages, written for AI tools rather than people. It was proposed in 2024 and is published at llmstxt.org.

At the time of writing (October 2026), it is not an official web standard, and the major search engines do not need it. Google’s guidance on AI features and your website says there are no special requirements or extra files needed to appear in its AI experiences. For most business websites, llms.txt is optional, cheap to add and unlikely to change much on its own.

What llms.txt is meant to do

Large language models work best with clean, concise text. Web pages contain navigation, scripts, cookie banners and layout code that make the useful content harder to extract. The idea behind llms.txt is to give AI tools a short, curated map of a site:

  • a title and one-paragraph summary of what the site or business is;
  • sections listing key pages with a short description of each;
  • optional links to clean Markdown versions of important pages.

Some sites also publish a companion file, often called llms-full.txt, that contains the full text of their documentation in one place.

A minimal example looks like this:

# Example Co

> Example Co designs and maintains websites for service businesses.

## Services

- [Website design](https://example.com/services/design/): new websites, from brief to launch
- [Maintenance](https://example.com/services/maintenance/): monthly updates and monitoring

## Guides

- [Website costs](https://example.com/guides/costs/): what affects the price of a website

How it differs from robots.txt and sitemaps

These three files are easy to confuse, but they do different jobs:

File Purpose Who reads it
robots.txt Tells crawlers which parts of a site they may fetch Search engines and most reputable crawlers, including many AI crawlers
sitemap.xml Lists the URLs you want indexed, with dates Search engines
llms.txt Summarises a site and points AI tools to key content Some AI tools and developer products, when they choose to

The important difference is control. robots.txt is the long-established way to allow or block crawlers, including AI crawlers. llms.txt doesn’t block or allow anything; it only offers a summary. If you want to decide whether AI companies may use your content, our guide on whether to block AI crawlers covers the options.

Who actually reads llms.txt

Adoption so far has been strongest in software documentation. Developer tools and coding assistants can use a project’s llms.txt to load accurate, up-to-date documentation into a conversation. That is a real benefit for software companies with large documentation sites.

For general web search and AI answers, the picture is less clear. Search engines and AI assistants generally rely on their own crawlers and indexes, and the main providers have not said that llms.txt affects whether or how often a site is cited. Check the current documentation of any AI product you care about before assuming it reads the file.

You can also look at your own server logs. If requests for /llms.txt appear, note which user agents make them. If none appear after several months, that tells you how much the file is being used on your site. Keep in mind that a request is not the same as a citation: a tool may read the file and still answer from other sources.

Should your business website have one?

Ask three questions:

  1. Do developers or technical users rely on your content? If you publish documentation, an API or technical guides, llms.txt can help AI coding tools use it correctly. Adding one is sensible.
  2. Is your site simple and well structured already? A clear site with good headings, plain HTML and a sitemap is easy for any tool to read. llms.txt adds little on top.
  3. Do you have time for it? The file needs updating when your services or key pages change. An outdated summary is worse than none.

For a typical service business, the honest answer is that llms.txt is a small, optional extra. It won’t hurt if it is accurate, and it won’t replace the work that makes a site visible in search and AI answers.

What matters more than llms.txt

If your goal is to be understood and cited by AI assistants, these fundamentals matter far more:

  • Clear, specific content that answers real questions, written by people who know the subject.
  • Plain, crawlable HTML. Content that only appears after heavy scripts run is harder for any crawler to read.
  • Good structure: descriptive headings, short sections and lists where they help.
  • Accurate structured data for your business, services and FAQs. Our guide to schema markup explains the basics.
  • A sensible robots.txt that doesn’t accidentally block crawlers you want.
  • Consistent information about your business across your site and other reputable sources.

These are the same qualities that help in traditional search. Our guide to generative engine optimisation covers them in more depth.

How to add llms.txt if you decide to

  1. Write a one-paragraph summary of your business in plain language.
  2. List your key pages: services, pricing, contact and your most useful guides, each with a one-line description.
  3. Save it as llms.txt in Markdown and upload it to the root of your domain.
  4. Check it loads at yourdomain.com/llms.txt as plain text.
  5. Add a reminder to review it whenever your services or main pages change.

On a multilingual site, list the main pages in each language or link to each language’s home page, so tools can find the right version.

Frequently asked questions

Will llms.txt improve my Google rankings?

There is no evidence that it does. Google says no special files are needed for its AI features, and llms.txt is not a ranking factor in Google Search.

Can llms.txt stop AI companies using my content?

No. It only offers a summary. To allow or block specific crawlers, use robots.txt, and check each AI company’s published crawler names and policies.

Is llms.txt the same as an AI sitemap?

They are similar in spirit, but llms.txt is written in Markdown for language models and is curated by hand, while an XML sitemap is a machine-readable list of every URL you want indexed.

What to do next

Before adding new files, check the basics: your robots.txt, your sitemap and whether your key service pages answer real questions clearly. Those changes help people, search engines and AI tools at the same time.

If your site’s structure or content is holding it back, our website redesign service rebuilds it on clean, crawlable foundations. To see where your current site stands, request a free website audit and we will tell you which basics need attention first.

Written by the PORVIX team

The people who design, build and maintain websites for growing businesses. We write about the questions that come up on real projects, in plain language, and update articles when the advice changes.

Published

How we work

Is your current site costing you enquiries?

A free, plain-language audit, by email within 2 business days.

Get a free audit
Get a free audit

Keep reading

More plain-language guides.

More on AI and websites first, then other guides worth reading next.

All insights

Start here

Let’s build a website that brings in business.

Tell us about your project. You’ll hear back from a real person within one business day, with honest advice either way.

  • Free consultation
  • Fixed written quote
  • Your details stay private