www.asos.com

48/100

AI agent readiness for https://www.asos.com/?, checked 2026-10-01 05:12 UTC.

Fail AI assistants may open this page (0/20)

robots.txt did not load (status 520). Well-behaved crawlers then assume the whole site is blocked.

How to fix

Make /robots.txt return status 200, or 404 if you have no rules.

Fail AI search engines may index this page (0/15)

robots.txt did not load (status 520). Well-behaved crawlers then assume the whole site is blocked.

How to fix

Make /robots.txt return status 200, or 404 if you have no rules.

Pass The firewall lets AI agents in (20/20)

Requests that identify as ChatGPT-User, Claude-User, Perplexity-User, OAI-SearchBot, PerplexityBot all got the page.

Pass Content is readable without JavaScript (15/15)

The raw page has about 3 words of text before any JavaScript runs.

How to fix

Most AI crawlers do not run JavaScript. Render the main content on the server (server-side rendering or pre-rendering).

Fail Structured data (JSON-LD) (0/10)

No JSON-LD found.

How to fix

Add JSON-LD from schema.org: Organization and WebSite on the home page, Product with an Offer (price and availability) on product pages.

Needs work Title, description and language (3/5)

Missing: title, meta description, html lang.

How to fix

Add a <title>, a <meta name="description"> and <html lang="...">.

Fail Sitemap (0/5)

No sitemap at /sitemap.xml or in robots.txt.

How to fix

Publish /sitemap.xml and list it in robots.txt with "Sitemap: https://.../sitemap.xml".

Pass Fast first response (5/5)

The page took 57 ms to load.

Pass Uses HTTPS (5/5)

The page is served over HTTPS.

Info llms.txt

No /llms.txt. Major AI agents do not rely on it yet, but it is cheap to add.

Info AI training crawlers

robots.txt blocks GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, CCBot, meta-externalagent. That is a valid choice: it stops AI training, not AI answers.

Each AI agent

Agent	Type	robots.txt	Live request
ChatGPT-User (OpenAI)	Assistant (fetches pages for a user)	Blocked	error (520)
Claude-User (Anthropic)	Assistant (fetches pages for a user)	Blocked	error (520)
Perplexity-User (Perplexity)	Assistant (fetches pages for a user)	Blocked	error (520)
OAI-SearchBot (OpenAI)	AI search index	Blocked	error (520)
Claude-SearchBot (Anthropic)	AI search index	Blocked	not tested
PerplexityBot (Perplexity)	AI search index	Blocked	error (520)
GPTBot (OpenAI)	AI training	Blocked	not tested
ClaudeBot (Anthropic)	AI training	Blocked	not tested
Google-Extended (Google)	AI training	Blocked	not tested
Applebot-Extended (Apple)	AI training	Blocked	not tested
CCBot (Common Crawl)	AI training	Blocked	not tested
meta-externalagent (Meta)	AI training	Blocked	not tested

Share this result

https://agentready.agentready.workers.dev/r/2cSwcZyh

Badge for your site:

<a href="https://agentready.agentready.workers.dev/r/2cSwcZyh"><img src="https://agentready.agentready.workers.dev/badge/2cSwcZyh.svg" alt="AI agent readiness 48/100"></a>

This report as JSON

Get told when this breaks

A firewall update or a new robots.txt rule can block AI agents overnight, and nobody notices. Weekly monitoring with alerts: $9 per month. It launches soon. Join the waitlist (free, no card) and we will tell you when it is ready.