llms.txt explained, what it is and how to make one

Published

Contents

Action points

  • Open yourdomain.com/llms.txt in your browser and check whether a file is already there.
  • Write a list of your most important pages with one sentence of explanation per page.
  • Ask your web developer to put the file as plain text in the root folder of your site.
  • Schedule a call with Dominic about outsourcing GEO for pages that AI can read and cite.
Reading type0 min

Prefer to outsource?

Outsource GEO →

Your web developer, a LinkedIn post or a newsletter mentioned llms.txt and now you want to know whether your site needs one. Here you can read exactly what the file is, where its limits lie and how to make one yourself.

What is llms.txt?

llms.txt is a proposal from 2024 for a Markdown file in the root folder of your site. That file gives AI systems an overview of your most important pages, with a link and a short explanation for each page. It is still a proposal by Jeremy Howard and has yet to become an established standard.

Markdown is a simple way to format text with ordinary characters. A hash at the start of a line turns it into a heading, a dash turns it into a list item. To people, such a file reads as a tidy list and software handles it easily.

Howard, who is affiliated with Answer.AI, published his idea on llmstxt.org on 3 September 2024. The goal is stated at the top of that page. Websites put a standard file in place with information that helps AI agents use a site.

An AI agent is an AI program that carries out tasks on its own, such as looking up, reading and summarising pages. A full web page with menus, banners and scripts is hard for such a program to process. The idea behind llms.txt is that a plain-text overview gets the agent on its way faster.

The page on llmstxt.org has since reached version 2, last changed on 10 August 2026. That version also allows a different path, such as /docs/llms.txt. For an SME site, the root folder remains the logical place.

llms.txt is a proposal that is still waiting for standard status.

Why you suddenly hear about llms.txt

Sound familiar? Your web developer puts llms.txt on the list of improvements or a colleague shares an enthusiastic post about it. The topic is coming up at a time when AI is part of the daily work in more and more businesses.

In 2024, 22.7% of Dutch businesses with 10 or more employees used one or more AI technologies, reports Statistics Netherlands (CBS). In 2021 that share was 13.1%, in 2022 it was 15.8% and in 2023 it was 14%. The figures for 2022, 2023 and 2024 are provisional.

Company size plays a part too. Among businesses with 500 or more employees the figure was 59.2%, among businesses with 10 to 19 employees it was 17.8%, according to the same CBS report. Businesses with fewer than 10 people fall outside this count.

CBS counts AI in a broad sense, covering seven types of technology. So these figures say little about llms.txt. They do show the wider shift that is putting this question on the table for business owners.

How an llms.txt is structured

The specification on llmstxt.org describes a fixed order of parts. Everything is plain Markdown, so a simple text editor on your computer is all you need.

An H1 with your site's name

At the top is a single heading with the name of your site or project. According to the specification, that is the only required part. So a file with just that heading already meets the proposal. The rest is what makes the file truly useful.

A short summary as a quote

Directly below the heading comes a blockquote, a quote block that starts with the > character. In it, you put a short summary with the key information that the reader needs to understand the rest of the file.

After that, a piece of ordinary explanation can follow in paragraphs or lists. Think of what your business does, who you work for and how the site is organised. Save headings for the next part.

H2 sections with lists of links

Then come zero or more sections under H2 headings, each with a list of links to pages with more detail. An H2 is a heading with two hashes. Each line in the list is a Markdown link, optionally followed by a colon and a short note.

The Optional section for extras

By convention, the last group is called Optional. It holds links an AI agent may skip when space is tight. Think of job vacancies, a news archive or a detailed history of your business.

Compare it to the small print at the bottom of a menu. It belongs there and anyone in a hurry skims past it.

A finger skimming quickly over the small print at the bottom of a menu on a café table

One heading is required, the rest helps the reader along.

Markdown versions of your pages

The proposal goes beyond a single overview. According to llmstxt.org, pages with information that agents may need should preferably get a clean Markdown version at the same URL.

You can do this in two ways. You add .md to the existing address, such as page.html.md. Or you replace the extension with .md, such as page.md.

Clean here means the text itself, with the menus, buttons and cookie notices stripped out. An agent that requests such a version gets the content separate from the design.

For a small site, this is a second step. Start with the llms.txt itself and then see whether a handful of key pages deserve an .md version.

What llms.txt does for your site

Picture a garden centre with a large floor plan at the entrance. Anyone who walks in sees straight away where the plants, the pots and the till are.

Garden centre owner at the entrance showing a customer the way to the plants, pots and till

An llms.txt does the same for AI agents and coding assistants that request the file. Coding assistants are AI assistants that help developers write code. Such a program gets a quick map of your site in one file, with the pages that matter and a short explanation per page.

Who already publishes such a file? According to its creator, OpenAI, Anthropic and Google publish an llms.txt with their own developer documentation, in Google's case for Gemini. That is his own claim.

Google is also keeping an eye on it from the technical side. A technical check by Google for websites in the Chrome browser calls llms.txt an emerging convention. If the file is missing, that check marks the item as N/A, because adding it is optional for now.

That check belongs to Chrome and is separate from Google Search.

llms.txt is a map for those who ask for it.

Where the limits of llms.txt lie

Publishing a file is one thing, being read is another.

On llmstxt.org there is no list of which AI systems read the file. That OpenAI, Anthropic and Google publish one themselves says something about who makes such a file. It says little about who reads it.

Google is clear about this. Its documentation on AI features and your website states in plain language that you need no new machine-readable files, AI text files or extra markup to appear in those features. By those features, Google means AI Overviews and AI Mode.

The same page also says there are zero extra requirements or special optimisations for appearing in AI Overviews or AI Mode. llms.txt is not named anywhere on that page. The sentence is about AI text files in general.

So if you want to appear in AI Overviews, your work is mainly on the pages themselves. You can read how that works in practice on our page about becoming visible in AI Overviews.

llms.txt and robots.txt, the difference

The names look alike and both files often sit in the same folder. Still, each has its own job. llmstxt.org also says the two files serve different purposes.

robots.txt gives rules to crawlers, programs that visit websites automatically. According to Google, the file tells crawlers which URLs they may visit and mainly serves to keep your site from being overloaded. Google says that keeping a page out of Google takes a different method.

What is more, robots.txt is an established internet standard. The IETF, the organisation that sets agreements for the internet, published the RFC 9309 standard in September 2022. It builds on a method Martijn Koster came up with in 1994.

The standard openly adds that the rules are an agreement, which makes them something different from access control.

In short, robots.txt hangs on the door like house rules for visiting programs. llms.txt is more like the leaflet rack at the entrance, with an overview of what is on offer.

Glass shop door with a sticker full of house rules and a leaflet rack with overview leaflets beside it

robots.txt sets rules, llms.txt shows the way.

Making an llms.txt in eight steps

Want to try it yourself? Making an llms.txt mainly takes a clear picture of your own site. You need a text editor and access to the root folder of your website. If your web developer has that access, they can put the file online for you.

Step 1. Choose your most important pages

Write down the pages that help a new customer understand your business in a few minutes. Think of your services, how you work, your frequently asked questions and your contact page. Approach it the way a bicycle repairer arranges his shop window, with the bikes that say the most about the business at the front.

Bicycle repairer from Brabant wheeling four different bikes into his shop window and leaving the rest at the back

Step 2. Put your site's name in the H1

Start the file with a hash, a space and the name of your business or site. That is the required heading.

Step 3. Write a short summary

On the next line, type the > character followed by a summary of one or two sentences. Who are you, what do you do and who for?

Step 4. Add your key facts

Below the summary, add a few key facts in plain sentences. Think of where you are based, the area you cover and your specialism. Keep each fact short and make sure it can also be found on your site itself.

Step 5. Create H2 groups with links

Group your pages under headings with two hashes, such as Services, About us or Knowledge. Put a list under each heading. Each line contains a Markdown link, a colon and a short description of what the reader will find on that page.

Step 6. Put extras under Optional

Finish with the heading Optional. This is where links go that are useful but carry less weight, such as job vacancies, a news archive or your terms and conditions.

Step 7. Put the file online and check it

Save the file as plain text named llms.txt and place it in the root folder of your site. Then open yourdomain.com/llms.txt in your browser. If you see your text displayed neatly, the file is in the right place.

Step 8. Keep the file up to date

A map showing streets that disappeared long ago sends everyone the wrong way. If you add a service, remove a page or change an address, update your llms.txt straight away.

An llms.txt example from our own site

We also put an llms.txt online for zoekmachinespecialist.com. You can view the full file at /llms.txt. Below is a shortened extract.

# Zoekmachinespecialist.com

> Nederlands online-marketingbureau uit Tilburg voor het MKB. Wij maken bedrijven vindbaar in Google én in AI-antwoorden van ChatGPT, Gemini, Perplexity, Copilot en Google AI-overzichten. (...)

## GEO en AI-zichtbaarheid

- [GEO uitbesteden](https://www.zoekmachinespecialist.com/geo-uitbesteden): zorgen dat ChatGPT, Gemini, Perplexity en Google AI-overzichten jouw merk als bron noemen.
- [Zichtbaar in Google AI-overzichten](https://www.zoekmachinespecialist.com/zichtbaar-in-ai-overzichten): de bron worden die de AI van Google citeert.
- [AI-zichtbaarheid meten](https://www.zoekmachinespecialist.com/ai-zichtbaarheid-meten): elke maand een rapport over hoe vaak AI je noemt.

## Optional

- [Vacatures](https://www.zoekmachinespecialist.com/vacatures): werken en stage lopen in Tilburg.

You will recognise the parts from this guide. At the top is the H1 with the name of the site, with the summary as a quote below it. Then come H2 groups with links, each with a short description. The Optional section rounds it all off.

Each description says in a few words what the reader will find on the page.

A good llms.txt reads like a table of contents in plain language.

A small test alongside the real work

See llms.txt as a small, low-cost test. Making it takes little time and the file sits neatly alongside what you already have.

Chocolatier from Brabant offering a small taster next to the trays of handmade chocolates

The real work lies in clear pages that AI systems can read and cite. Think of clear answers to your customers' questions, up-to-date facts and a business name that appears the same way everywhere.

Want to know where you stand first? With the AI visibility scan you can see whether AI answers mention your business. If ChatGPT is your main concern, read how to become visible in ChatGPT.

GEO stands for making your business visible in the answers of AI systems. Our Outsource GEO service makes sure AI answer engines name your business as a source. llms.txt is at most a small part of that. Want to know what suits your site? Schedule a call with Dominic.

Frequently asked questions about llms.txt (FAQ)

What is llms.txt?

llms.txt is a proposal from 2024 for a Markdown file in the root folder of your site. It gives AI systems an overview of your most important pages, with a short description per link. Jeremy Howard proposed it on llmstxt.org and it has yet to become an established standard.

Do I need llms.txt to appear in AI Overviews?

No. Google writes that you need no new machine-readable files, AI text files or extra markup to appear in AI Overviews and AI Mode. So put your energy into clear pages with good answers first. Alongside that, you can add llms.txt as a small test.

How do I make an llms.txt?

Start with an H1 with the name of your site and a short summary after the > character. Below that, add H2 groups with links and a short description per link. Finish with the Optional section, save the file as plain text and place it in the root folder of your site.

What is the difference between llms.txt and robots.txt?

robots.txt gives crawlers rules about which URLs they may visit and has been an established internet standard since 2022. llms.txt is a proposal for an overview of your most important pages for AI agents. So the two files each have their own purpose.

What is llms-full.txt?

You will come across that name in conversations about this topic. The proposal on llmstxt.org asks for one llms.txt as a map and for clean .md versions of individual pages. If your web developer suggests an extra file, ask what goes in it and who keeps it up to date.

Does ChatGPT read my llms.txt?

llmstxt.org does not list anywhere which AI systems read the file. According to its creator, OpenAI publishes an llms.txt with its own developer documentation. That says something about who makes such a file and little about who reads it.

Conclusion

llms.txt is a proposal from 2024 for a Markdown file that gives AI agents a map of your site. An H1 with the name of your site is required. A summary, H2 groups with links and an Optional section make it complete. According to Google, AI Overviews need no new files. So feel free to add it as a small test and put most of your energy into clear pages that AI can read and cite.

The next step

How we tackle this together

Discover your biggest growth opportunities with a free opportunity analysis (worth €416) — a tailor-made report, free of charge and with no obligation.

1Analysis
2Action plan
3Proposal
Schedule a call
Dominic Pietersz

About the author

Dominic Pietersz

Your dedicated point of contact

Dominic helps SMEs grow through Google and other channels. With his international experience, he turns challenges into concrete growth.

Follow Dominic on LinkedIn

Inspiration · Next to the doorbell of my studio hangs a card that points couriers towards the parcel box. Anyone who reads it walks straight on and anyone who misses it simply rings the bell.