AI agent readiness for https://www.airbnb.com/, checked 2026-10-01 04:25 UTC.
Your firewall or bot protection (for example Cloudflare, Akamai or DataDome) blocks these agents. Allow verified AI assistant and AI search bots in its settings. Note: our test uses the agent names from our own server. If your firewall also checks where a request comes from ("verified bots"), the real agents may still get in. Check your firewall logs to be sure.Most AI crawlers do not run JavaScript. Render the main content on the server (server-side rendering or pre-rendering).
Add JSON-LD from schema.org: Organization and WebSite on the home page, Product with an Offer (price and availability) on product pages.
Add a <title>, a <meta name="description"> and <html lang="...">.
Publish /sitemap.xml and list it in robots.txt with "Sitemap: https://.../sitemap.xml".
| Agent | Type | robots.txt | Live request |
|---|---|---|---|
| ChatGPT-User (OpenAI) | Assistant (fetches pages for a user) | Allowed | blocked (403) |
| Claude-User (Anthropic) | Assistant (fetches pages for a user) | Allowed | blocked (403) |
| Perplexity-User (Perplexity) | Assistant (fetches pages for a user) | Allowed | blocked (403) |
| OAI-SearchBot (OpenAI) | AI search index | Allowed | blocked (403) |
| Claude-SearchBot (Anthropic) | AI search index | Allowed | not tested |
| PerplexityBot (Perplexity) | AI search index | Allowed | blocked (403) |
| GPTBot (OpenAI) | AI training | Allowed | not tested |
| ClaudeBot (Anthropic) | AI training | Allowed | not tested |
| Google-Extended (Google) | AI training | Allowed | not tested |
| Applebot-Extended (Apple) | AI training | Allowed | not tested |
| CCBot (Common Crawl) | AI training | Allowed | not tested |
| meta-externalagent (Meta) | AI training | Allowed | not tested |
https://agentready.agentready.workers.dev/r/1Pp8A3UQ
Badge for your site:
<a href="https://agentready.agentready.workers.dev/r/1Pp8A3UQ"><img src="https://agentready.agentready.workers.dev/badge/1Pp8A3UQ.svg" alt="AI agent readiness 63/100"></a>
A firewall update or a new robots.txt rule can block AI agents overnight, and nobody notices. Weekly monitoring with alerts: $9 per month. It launches soon. Join the waitlist (free, no card) and we will tell you when it is ready.