top of page

Do You Need an llms.txt File for Your Small Business Website?

  • 6 days ago
  • 8 min read

Updated: 2 days ago

By Editorial Team · Updated September 2, 2026 · 11 min read

 

No, a small-business website doesn't need an llms.txt file to appear in AI answers, because Ahrefs measured 97% of published files getting zero requests in May 2026 across 137,210 domains. Spend the hour on a visible last-updated date and the first sentence under the heading instead.

 

An llms.txt file is a markdown index at the site root that lists important pages for machines. It isn't robots.txt, it blocks nothing, and it ranks nothing. RedFork has built more than 500 websites since 2014 as a Wix Certified studio, and the honest position after reading the data is simple: we'll add the file in ten minutes if a Partner insists, and we'll also tell them it does nothing measurable for ChatGPT, Perplexity, or AI Overviews.

 

Key Takeaways

 

  • Skip llms.txt as a visibility play. Ahrefs found 97% of valid files unread in May 2026, across the roughly 38,000 domains that published one.

  • Google Search Central says you don't need new machine-readable AI text files or markup to appear in AI Overviews or AI Mode.

  • Of the 3% of files that saw any traffic, AI retrieval bots accounted for about 1.1% of requests, and SEO audit tools out-fetched them.

  • Zero AI bots went looking for files that didn't exist, so publishing one doesn't put you on any radar.

  • Seer Interactive found three in four AI-cited pages had been updated within a year, across 7,683 pages and 47,097 citations. That hour belongs there.

 

The Short Version

 

Skip the file. If a platform writes one for free, leave it alone and don't sell it as GEO. Spend the hour on a visible last-updated date, the profile fields a spoken answer recites, and a 20-to-25-word first sentence.

 

If you spend 1 hour

What usually happens

Why

Add llms.txt

Usually unread

Hygiene, not a lever

Refresh last-updated dates

75% of cites are under 1 year

Seer, Mar to Jun 2026

Fix the profile fields

Spoken in AI answers

Highest local return

Write a 25-word capsule

Passage, not page

Extraction unit

 

In This Article

 

 

The Honest Skip

 

The honest skip is RedFork's researched position: don't implement llms.txt for a small-business site, and don't buy it as a paid deliverable. The file is a solution looking for a reader.

 

Ahrefs used its Web Analytics and Bot Analytics on 137,210 domains that received traffic in May 2026, and about 28% of them published a valid file, which Ahrefs treats as a ceiling because its customers skew technical. Of those roughly 38,000 files, 97% saw no requests at all, and the remaining 3%, about 1,100 domains, absorbed every fetch in the study. That's the base rate you're betting against: a 97% chance of zero readership. We'll add the file for a Partner who insists, and we'll say plainly that it won't move ChatGPT, Perplexity, or AI Overviews.

 

What Is an llms.txt File, in One Sentence?

 

An llms.txt file is a short markdown index at a site's root that lists key pages, so machines can orient themselves without crawling everything. Jeremy Howard proposed it in 2024, and the "AI visibility" sales story came later, attached to a file that was never designed to do that job.

 

The file isn't a robots.txt rule: it allows nothing and blocks nothing, and it isn't a markdown copy of every page either. Adoption in Ahrefs' technical-skewed sample hit 28%, which they treat as a ceiling rather than a web-wide rate. If a sales deck calls this "the GEO layer," the deck is wrong. Schema is hygiene for rich results, and this file is optional decoration on top of that, not a lever that earns a citation.

 

Who Fetches These Files?

 

The bots that fetch llms.txt are mostly not the AI search bots a shop owner was sold, so the file's real readers are audit tools. Ahrefs classified every user agent that hit the files with any traffic, and the breakdown is the whole story.

 

Ninety-six percent of those requests came from bots and only about 4% from humans. SEO audit tools took the largest share at roughly 21.7%, named AI tools as a group took about 19.5%, and inside that AI bucket the agents and coding tools led while the AI retrieval bots that actually build live answers, like OAI-SearchBot and PerplexityBot, sat at only about 1.1%. Slackbot out-fetched PerplexityBot. Roughly one in eight requests came from GEO auditors and llms.txt scanners, which means a good chunk of the traffic is the industry checking whether the industry has the file. The search bots barely showed up.

 

Google Already Told You to Skip It

 

Google already told site owners to skip new AI text files if the goal is appearing in AI Overviews or AI Mode. For a local shop, that official line is the one that settles the question.

 

Google Search Central, in a section that reads like mythbusting, says you don't need new machine-readable files, AI text files, or markup to appear in those features. John Mueller, quoted in the Ahrefs study, called llms.txt "not done for search" and a temporary crutch to save some tokens for coding tools, and compared its self-declared nature to the old keywords meta tag. Chrome's Lighthouse later added an experimental check that produced roughly one in a thousand of the fetches in Ahrefs' data. No major AI company, from OpenAI and Anthropic to Google, Meta, Perplexity, and Mistral, has publicly committed to consuming the file in production search, so no one has asked your barber shop for a root markdown index.

 

The Hour Reallocation

 

The hour reallocation is the point: spend the time where logs already move, because adding llms.txt usually produces exactly zero requests. Refreshing a visible last-updated date, by contrast, sits on a measured freshness pattern. Put the hour into these three, in order:

 

  1. Add a visible last-updated date to the money pages, and make the update a real content change, not just a date bump.

  2. Fill the Google Business Profile fields a spoken answer recites, since those show up directly in local AI answers.

  3. Rewrite the first sentence under each main heading into a complete 20-to-25-word answer a neighbor would say.

 

Seer Interactive dated 7,683 cited pages carrying 47,097 citations across ChatGPT, Gemini, and Perplexity from March to June 2026, and three in four had been updated within a year, with more than half touched in the previous three months. Judged by last update, 72% looked fresh; judged by original publish date, only 42% did, which tells you the freshness engines reward is manufactured by real updates. Ahrefs' larger analysis of about 17 million citations found AI-cited content runs roughly 25.7% fresher than traditional search results. Unserious Marketing is a playbook for standing out as a human business, not a third file format, so it doesn't change this math either.

 

When Would You Still Add One?

 

You'd still add an llms.txt file if coding agents use your docs, or if a platform writes it free and you leave the default. Those are the only honest cases, and neither describes a one-location service site.

 

Ahrefs' own verdict is that the closest real audience is coding agents, and Claude's coding agent out-fetched every AI retrieval bot in their table. A documentation site, an API reference, or a product that agents already hit can justify the file, while a plumber or salon site cannot. If Wix, Framer, or another builder emits the file automatically, leave it in place, but don't pay an agency to "do GEO" by adding one, and don't treat a Lighthouse checkbox as a citation lever. If a Partner asks RedFork to add it anyway, we can, and we won't put it on the invoice as visibility work.

 

Wix, Root Files, and Why This Is a Bad Project

 

Wix doesn't make arbitrary root-file uploads easy, so a true llms.txt on a Wix site is an engineering detour around a platform limit. That detour is a bad project when 97% of existing files sit unread and the file changes nothing about how you get cited.

 

Both Express websites on curated Wix templates and Pro custom Wix work with the full marketing mix already ship crawlable, server-rendered pages, and neither tier includes llms.txt as a visibility SKU. There's also a small safety reason to avoid it: Ahrefs flagged a crawler already studying these files as a prompt-injection risk, and because agents are built to trust file contents, a stale or hijacked file can mislead every agent that reads it. That's one more reason not to invent a root file you'll forget to maintain. If you want the wider picture of how these jobs fit together, see AEO vs GEO vs SEO for a small business.

 

If the Skip Is Clear, Spend the Hour on Dates

 

Leave the file, touch the pages people and models already fetch, and write the sentence a neighbor would say. That's the whole recommendation, and it's cheaper than any GEO add-on that starts with a root file.

 

If you want that hour scoped on a Wix site, we'll spend it on work that shows up in your logs. Express if you need a template and ads, Pro if you need the full mix, and we won't invoice you for an unread root file.

 

 

Frequently Asked Questions

 

Will skipping llms.txt hurt my AI Overviews?

 

No. Google says you don't need AI text files to appear in AI Overviews or AI Mode, and Ahrefs found no AI retrieval bot hunting for files that were missing. The engines build answers from crawlable pages they already index, so a missing root file costs you nothing, while an unread one you built costs you the hour you spent on it.

 

Is llms.txt the same as robots.txt?

 

No. robots.txt allows or blocks crawlers and is honored by every major bot, while llms.txt is an optional markdown index that controls nothing and that no major engine has committed to reading. Confusing the two is exactly how a sales deck inflates the file's importance, so treat them as unrelated: one is enforced access control, the other is a self-description.

 

Wix offered to generate one. Should I turn it on?

 

If it's free and automatic, leave the default in place, but don't pay extra for it and don't call it GEO. Check your own server logs before investing any further, because a 97% chance of zero readership is the base rate you're working against. If the toggle costs nothing and requires no maintenance, it's harmless; the moment it costs money or hours, skip it.

 

What should I do with the hour instead?

 

Put a visible last-updated date on the money pages with a real content change, rewrite the first sentence under each main heading into a complete answer, and fill the Google Business Profile fields a spoken answer recites. Those three jobs have measured readers and measured effects, which is more than the file can claim, so the hour goes much further there.

 

Can RedFork add the file if I still want it?

 

Yes, we can add it in about ten minutes. We won't sell it as a citation lever, and we won't promise ChatGPT will fetch it, because the data says it very likely won't. If a platform default already created one, we'll leave it; if you specifically want one authored, we'll do it and tell you honestly what it will and won't do.

 

How We Researched This

 

We checked the live sources for this topic on September 2, 2026.

 

We read Ahrefs' study of 137,210 domains (97% of valid llms.txt files unread in May 2026, with the user-agent breakdown showing AI retrieval bots at about 1.1% of requests), Google Search Central's guidance that AI features need no special files or markup, John Mueller's quoted comparison of the file to the keywords meta tag, and Seer Interactive's content-recency study (7,683 cited pages, 47,097 citations across ChatGPT, Gemini, and Perplexity, with three in four updated within a year) alongside Ahrefs' larger freshness analysis.

 

Company figures (500-plus websites, Wix Certified, 134 Marketplace projects, founded 2014) are RedFork-reported. This is a decision page, not an install guide.

 

Latest Updates

 

  • September 2, 2026: Refreshed. Ahrefs, Google, and Seer figures re-verified against sources read September 2, 2026, and a byline, read time, and standard section order added.

 

References

 

  1. Ahrefs, "We Analyzed 137K Sites: 97% of llms.txt Files Never Get Read." https://ahrefs.com/blog/llmstxt-study/

  2. Google Search Central, "AI Features and Your Website." https://developers.google.com/search/docs/appearance/ai-features

  3. Seer Interactive, "Content Recency's Impact on AI Visibility in 2026." https://www.seerinteractive.com/insights/study-content-recencys-impact-on-ai-visibility-in-2026

  4. Search Engine Journal, "97% of llms.txt Files Got No Requests, Ahrefs Data Shows." https://www.searchenginejournal.com/97-of-llms-txt-files-got-no-requests-ahrefs-data-shows/579478/

 

Disclaimer

 

This article is educational. RedFork doesn't guarantee rankings, citations, traffic, or revenue. Statistics were current as of September 2, 2026 and should be re-checked on refresh.

 
 
 

Comments


Latest Tips to Your Inbox

Get the latest info on small business marketing, design, sales tips, guides, and industry best practices. 

Thanks for subscribing!

bottom of page