Technical Readiness
Technical readiness assesses whether AI crawlers can access and reliably process the website. It contributes 15% to the GEO score.
Composition
The technical score consists of three parts:
- Crawler access, 50%: Important AI crawlers are evaluated against robots.txt rules. Higher-priority crawlers carry more weight.
- Page technology, 35%: The average technical score across all analyzed URLs.
- llms.txt, 15%: The structure and completeness of an available llms.txt file.
A missing robots.txt means that access is unrestricted under the web standard. It therefore does not automatically reduce the score.
The tier of an AI crawler
The crawler table in the report lists a tier for every crawler. It states how strongly a block affects visibility:
- Tier 1 - feeds AI search products where people actively look for answers, such as GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot and PerplexityBot. Blocking these costs the most.
- Tier 2 - belongs to the wider AI ecosystem, such as Google-Extended, Applebot-Extended or Amazonbot. Access has an indirect effect.
- Tier 3 - pure training crawlers such as CCBot or Bytespider. They collect material for future models but do not answer questions. Blocking these barely costs visibility.
In the score, tier 1 counts triple, tier 2 double and tier 3 once. The crawler access value is the share of allowed crawlers weighted this way. So excluding training crawlers for legal reasons costs little - unlike a blanket block for all AI systems.
Technical page checks
Each page starts at 100. Deductions include:
- HTTP errors,
noindexor almost no content in the raw HTML - strong dependence on JavaScript for visible content
- very little page content
- a missing title, H1, canonical link, language declaration or meta description
- multiple H1 headings
llms.txt
The audit checks the title, description, useful sections, absolute URLs, entry descriptions, key facts and contact information. llms.txt is a supporting signal and does not replace accessible web pages or structured data.
How to improve the score
- Allow required AI crawlers to access relevant content.
- Provide essential content in the delivered HTML.
- Resolve HTTP errors and unintended
noindexdirectives. - Add clear titles, H1 headings, canonical links and language declarations.
- Maintain an accurate and current llms.txt file.