AI agent readiness for https://www.sephora.com/, checked 2026-11-12 05:19 UTC.
Your firewall or bot protection (for example Cloudflare, Akamai or DataDome) blocks these agents. Allow verified AI assistant and AI search bots in its settings. Note: our test uses the agent names from our own server. If your firewall also checks where a request comes from ("verified bots"), the real agents may still get in. Check your firewall logs to be sure.Most AI crawlers do not run JavaScript. Render the main content on the server (server-side rendering or pre-rendering).
| Agent | Type | robots.txt | Live request |
|---|---|---|---|
| ChatGPT-User (OpenAI) | Assistant (fetches pages for a user) | Allowed | blocked (403) |
| Claude-User (Anthropic) | Assistant (fetches pages for a user) | Allowed | blocked (403) |
| Perplexity-User (Perplexity) | Assistant (fetches pages for a user) | Allowed | blocked (403) |
| OAI-SearchBot (OpenAI) | AI search index | Allowed | blocked (403) |
| Claude-SearchBot (Anthropic) | AI search index | Allowed | not tested |
| PerplexityBot (Perplexity) | AI search index | Allowed | blocked (403) |
| GPTBot (OpenAI) | AI training | Allowed | not tested |
| ClaudeBot (Anthropic) | AI training | Allowed | not tested |
| Google-Extended (Google) | AI training | Allowed | not tested |
| Applebot-Extended (Apple) | AI training | Allowed | not tested |
| CCBot (Common Crawl) | AI training | Allowed | not tested |
| meta-externalagent (Meta) | AI training | Allowed | not tested |
https://agentready.agentready.workers.dev/r/Wf-Oy3o2
Badge for your site:
<a href="https://agentready.agentready.workers.dev/r/Wf-Oy3o2"><img src="https://agentready.agentready.workers.dev/badge/Wf-Oy3o2.svg" alt="AI agent readiness 73/100"></a>
A firewall update or a new robots.txt rule can block AI agents overnight, and nobody notices. Weekly monitoring with alerts: $9 per month. It launches soon. Join the waitlist (free, no card) and we will tell you when it is ready.