Is your site ready for AI search? Check access, llms.txt and page structure
This free AI readiness checker reads the robots.txt, llms.txt and page HTML you paste and lists every check as passed, a gap or information: crawler access, llms.txt format, page delivery, answers and identity. There is no single score, and nothing you paste leaves your browser.
Part 1
Use the tool
Everything runs in your browser. Nothing you paste is sent anywhere.
1. What can you paste for a check?
Paste any of the three: robots.txt, llms.txt and a page's HTML. Each pasted item is checked and listed as passed, a gap or information. Each check uses one of your free tool runs.
Part 2
How it works, how to read it, and its limits
The method, what the result means, how it differs from other tools, and what it cannot do.
2. What does "AI readiness" mean here?
It means whether AI search tools can reach your pages, read them and tell who stands behind them, which is the part you control before any platform chooses a source.
- Access: whether search and answer crawlers are blocked from the site
- llms.txt: whether the optional file follows the llmstxt.org format
- Delivery and content: whether the page shows its main text, a clear title, headings, answers and evidence in the HTML
- Identity: whether structured data names the entity and matches the visible text
Confirmed Google says generative AI search is still search: ordinary crawl, index and quality practices apply, and no special markup or AI text file is needed. Google Search does not use llms.txt.
Readiness is a precondition, not a result. A page can pass every check and still not be named by an assistant, so pair this with a weekly record of real answers.
3. How is this different from other AI readiness checkers?
It lists checks as passed, a gap or information, with no single score, and it works from text you paste, so nothing leaves your browser.
| Question | Many other free checkers | This checker |
|---|---|---|
| Result | Often one overall score or grade | Pass, gap or information for every check, counted per area |
| Your data | A URL or domain is submitted to a service, and some ask for a work email | Pasted text stays in your browser |
| Evidence | A score with a short summary | What was found, and the fix for a gap |
| What it claims | Some describe the score as AI visibility | States it checks access and structure only and cannot show whether any platform cites you |
Directional Based on a review of several vendor-run free checkers on 2 November 2026; features change, and I did not open every tool.
A score hides which check failed, so two sites with the same score can need different work. That is why each check is reported by itself.
4. How do you read the result?
Fix gaps in Access first, because nothing else matters if crawlers cannot reach the page, then work down the other areas.
| Result | Meaning | What to do |
|---|---|---|
| Pass | The pasted text meets the check | Nothing. Recheck after site changes. |
| Gap | Something that usually blocks or weakens the page was found | Fix it, then paste again. |
| Information | A choice or a note, such as blocking training crawlers | Decide on purpose. |
Blocking training crawlers is a separate choice from blocking search crawlers. The checker reports them separately so you can keep one without losing the other.
A. Worked example: how to read and fix a gap
A gap names the check, shows what was found and says what to change, so you can fix it and paste again.
Suppose the Access area reports: Blocked from the whole site: OAI-SearchBot. The pasted robots.txt contains a group like this:
User-agent: OAI-SearchBot
Disallow: /That rule blocks the whole site for that crawler. If you want that service to find your pages, delete the group, or replace the rule with an allow:
User-agent: OAI-SearchBot
Allow: /Paste the file again and the check should pass. This example is illustrative and not taken from a real site.
B. Common problems and how to fix them
Most gaps come from a handful of causes, each with a short fix.
| Problem | Why it matters | Fix |
|---|---|---|
| A blanket Disallow for a search crawler | The crawler cannot fetch any page | Remove the rule or allow the paths you want found |
| No sitemap line in robots.txt | Crawlers have one fewer pointer to your key pages | Add a Sitemap line with the full address |
| Main text appears only after script runs | The raw HTML looks empty to a reader that does not run script | Serve the key text in the HTML, or check the rendered page |
| llms.txt returns an HTML page | It is not a Markdown file, and a status of 200 hides the problem | Serve a real text file, or return a clean 404 |
| A very long llms.txt | Thousands of links make it a sitemap, not a guide | Keep the pages a newcomer needs and leave the rest to the sitemap |
| Markup that names facts the page does not show | Structured data should describe visible content | Remove claims the page does not make |
Server rules, firewalls and bot walls can block crawlers even when robots.txt allows them. The checker cannot see those, so test with a fetch from outside your network too.
5. Questions about AI readiness
Short answers on what the checker reads, what it cannot see and what to do next.
What is an AI readiness checker?
A tool that checks whether AI search tools can reach and read your pages. This one reads the robots.txt, llms.txt and page HTML you paste and lists each check as passed, a gap or information.
Does it give me a score?
No. Each check is shown on its own, with counts per area. A single score hides which check failed.
Does it fetch my site?
No. A browser tool cannot read another site's files, so you paste them. Nothing is uploaded.
Do I need an llms.txt to be ready?
No. Google says Google Search does not use llms.txt. The section is optional, and only checks the format if you paste a file.
Will passing every check get me cited by ChatGPT or Perplexity?
No. The checks cover access and structure. Whether an assistant names or cites you depends on its own choices, which this tool cannot see.
Which crawlers does it check?
The 28 search, user-fetch, training and other crawlers in the robots.txt checker's list, grouped by what they do.
6. What can this checker not do?
It checks pasted text. It does not crawl, render script or see how any platform chose its sources.
- A page that builds its text with script can look empty in the pasted HTML, so check the rendered page too.
- It checks one page at a time. Paste the HTML of each template that matters.
- It cannot see server rules, firewalls or bot walls that block crawlers outside robots.txt.
- It cannot show whether any assistant names or cites you; record real answers for that.
Next: take the 15-question mini-audit → track real AI answers → see all the free tools →