What Is llms.txt? Does Your Malaysian Business Website Need One?

Every few months, a new “must-have” SEO trick goes viral. Right now, it’s llms.txt. Some people call it the robots.txt for AI, while others say it’s a waste of time.

So who’s right? And more importantly, does your Malaysian business website actually need one?

In this guide, you’ll learn what this file is, what Google really says about it, and how to add one to WordPress in five minutes. You’ll also see where it fits in a real AI search strategy, so you don’t waste effort on the wrong things.

What Is llms.txt?

llms.txt is a plain text file that sits at the root of your website, for example yoursite.com/llms.txt. It gives large language models (LLMs) such as ChatGPT, Gemini and Claude a short summary of your site. It also lists links to your most important pages.

Think of it as a cheat sheet for AI. Instead of making a chatbot dig through menus, pop-ups and scripts, you hand it a clean map of your best content.

Who Created It?

Jeremy Howard, co-founder of Answer.AI, proposed the standard in September 2024. The official llms.txt proposal explains the idea and the format in detail.

However, keep one thing in mind. It’s a proposal, not an official web standard. As a result, no search engine or AI company has to follow it.

What the File Looks Like

The format uses Markdown, so it’s easy to read. According to the spec, only the H1 title is required. Still, most files follow this simple structure:

• First, an H1 with your business or website name.
• Then, a short summary in a blockquote (a line that starts with “>”).
• Next, optional notes about your business.
• Finally, H2 sections that list your key pages as links, each with a one-line description.

Here’s a simple example for a fictional Kuala Lumpur bakery:

# Kedai Kek Mawar

> Halal bakery in Kuala Lumpur selling custom birthday and wedding cakes, with same-day delivery in the Klang Valley.

## Key pages
- [Birthday cakes](https://example.com/birthday-cakes/): Designs, sizes and prices
- [Delivery areas](https://example.com/delivery/): Areas and delivery fees
- [FAQ](https://example.com/faq/): Ordering, payment and halal certification

That’s it. There’s no special code, and you don’t need a developer to understand it.

llms.txt vs robots.txt vs sitemap.xml

People often confuse these three files. Here’s the difference in plain English:

• robots.txt tells crawlers what they can and can’t access. In short, it controls access.
• sitemap.xml lists all the URLs you want search engines to find. So it helps with discovery.
• llms.txt summarises your site and points AI tools to your best pages. Therefore, it offers guidance.

In other words, the new file doesn’t block or allow anything. Also, it doesn’t replace your sitemap. Instead, it simply adds context on top.

Does Google Use llms.txt?

Here’s the part most “AI SEO” posts leave out. Google doesn’t use it for Search.

In fact, Google’s John Mueller compared llms.txt to the old keywords meta tag. He also noted that, as far as he knew, none of the AI services had said they were using it.

Google’s own documentation is even clearer. Its guide to AI features and your website states that you don’t need to create new machine-readable files, AI text files or markup to appear in AI Overviews or AI Mode.

So if someone promises that this file will get you into Google’s AI Overviews, be careful. That claim doesn’t match what Google says.

So Should Your Business Add One?

Our honest answer: yes, because it’s quick and free. But don’t expect it to move your rankings.

Why It Can Still Be Worth Adding

First, it costs almost nothing. On WordPress, you can switch it on with one toggle.

Second, some AI tools and coding assistants do read the file when a user points them to a site. So it can help those tools describe your business correctly.

Third, it forces a useful exercise. When you write one, you have to decide which pages matter most. That clarity also helps your whole SEO strategy.

When to Put It Lower on Your List

If your site has technical issues, thin service pages or no reviews, fix those first. After all, a text file won’t rescue a weak website.

Similarly, don’t pay an agency extra for “llms.txt optimisation.” It’s a five-minute task, not a service package.

How to Add llms.txt to a WordPress Website

Most Malaysian SMEs run on WordPress, so let’s focus there. You have two options.

Option 1: Use Yoast SEO (Easiest)

Yoast SEO can generate the file for you, and the feature is free. Follow Yoast’s setup guide or use these steps:

• Go to Yoast SEO, then Settings.
• Next, open Site features and find the AI tools section.
• Then switch the feature on and click Save changes.
• Optionally, choose “Manual page selection” to pick the pages you want to feature.

We use this on our own site, and you can view the result at creativesite.com.my/llms.txt. Because Yoast keeps it updated, you don’t have to edit anything by hand.

Option 2: Create the File Manually

Don’t use Yoast? No problem. Write your file in a text editor using the format above. Then save it with the exact name and upload it to your website’s root folder through your hosting file manager or FTP.

Also, keep it short. List only your most useful pages, such as services, pricing, locations, case studies and FAQs.

Test That It Works

Finally, open the file’s URL in your browser. If you see your text, it’s live. If you get a 404 error, however, check the file location or ask your developer.

Check What AI Tools Say About You

Once the file is live, run a quick reality check. Ask ChatGPT, Gemini or Perplexity simple questions about your business, such as “What does [your brand] offer in Johor Bahru?”

Then compare the answers with your real services, prices and locations. If the AI gets something wrong, update the matching page on your site first. After that, make sure your file links to that corrected page.

Repeat this every few months. AI answers change over time, so a regular check helps you catch mistakes early.

Common Mistakes to Avoid

Setting this up is easy. Even so, we often see the same small mistakes on Malaysian business sites.

• Listing every page. The file should highlight your best pages, not copy your sitemap.
• Using vague descriptions. For example, “Services” tells AI nothing, while “Aircond servicing in Shah Alam, from RM80” tells it a lot.
• Linking to outdated pages. If your prices or services changed, update the links too.
• Forgetting your key trust pages. Add your About page, reviews and case studies so AI tools see proof, not just promises.
• Blocking AI crawlers by accident. If your robots.txt or firewall blocks them, the file can’t help at all.

Most of these take minutes to fix. Still, they make the difference between a helpful summary and a useless one.

What Actually Helps You Get Cited in AI Search

The file is a small extra. The real work that gets your brand into AI answers is still solid SEO.

Google’s AI features guide recommends the same basics that help normal rankings. Here’s where to focus:

• Let crawlers in. Check that robots.txt and your hosting don’t block Googlebot or the AI crawlers you want to allow.
• Write clear, helpful pages. Answer real customer questions in plain text, not just inside images.
• Use internal links so every important page is easy to find.
• Add structured data that matches what’s visible on the page. Our guide to schema markup for SEO explains what actually helps.
• Keep your Google Business Profile accurate and active, especially for local searches.

For Malaysian businesses, there’s one more thing to consider. Many customers search in English, Bahasa Malaysia or a mix of both. So if your buyers use BM, publish key pages in BM too. AI tools can only cite content that actually exists on your site.

Beyond that, AI tools favour brands that other trusted sites mention. For a deeper plan, read our generative engine optimization guide and our tips on how to rank in AI search.

Conclusion: Add llms.txt, Then Focus on What Matters

This file is simple, free and harmless. So go ahead and add one, especially if you already use Yoast.

However, keep your expectations realistic. Google has said it doesn’t need special AI files, and no major AI company has confirmed it relies on them. Your content, site health and reputation still do the heavy lifting.

Not sure whether your website is ready for AI search? Get a free SEO audit and we’ll show you what to fix first. You can also see real results in our case studies, or explore our SEO services in Malaysia.

Frequently Asked Questions

Is llms.txt the same as robots.txt?

No. robots.txt controls which pages crawlers can access. In contrast, this file only describes your site and points AI tools to key pages, so it can’t block anything.

Does llms.txt improve Google rankings?

Not directly. Google has said it doesn’t use it, and you don’t need special AI files to appear in AI Overviews or AI Mode.

Is it free to set up?

Yes. You can write one by hand, and Yoast SEO also generates it for free on WordPress.

Where should I put my llms.txt file?

Put it in your website’s root folder so it loads at yourdomain.com/llms.txt.

Can it hurt my SEO?

Not in any way we know of. It’s a plain text file that search engines ignore for ranking. Just make sure it lists accurate, up-to-date pages.