# VOQUA.AI — robots.txt # # We explicitly welcome AI crawlers. The product is discovered today # almost entirely through AI-engine answers (Perplexity, ChatGPT, Claude, # Gemini, Copilot, Google AI Overviews). Blocking those crawlers would # remove us from the discovery surface buyers actually use. # # Authentication-gated routes (/api, /admin, /onboarding, /auth) are # disallowed so crawlers don't waste budget on pages they cannot index. # ─── AI crawlers — explicit allow (public pages only) ───────────────── # These crawlers are explicitly welcomed. /api/ is excluded because it # returns JSON for the app, not indexable content. User-agent: GPTBot Allow: / Disallow: /api/ User-agent: ChatGPT-User Allow: / Disallow: /api/ User-agent: OAI-SearchBot Allow: / Disallow: /api/ User-agent: ClaudeBot Allow: / Disallow: /api/ User-agent: Claude-Web Allow: / Disallow: /api/ User-agent: anthropic-ai Allow: / Disallow: /api/ User-agent: PerplexityBot Allow: / Disallow: /api/ User-agent: Perplexity-User Allow: / Disallow: /api/ User-agent: Google-Extended Allow: / Disallow: /api/ User-agent: Bingbot Allow: / Disallow: /api/ User-agent: Applebot Allow: / Disallow: /api/ User-agent: Applebot-Extended Allow: / Disallow: /api/ User-agent: Meta-ExternalAgent Allow: / Disallow: /api/ User-agent: Bytespider Allow: / Disallow: /api/ User-agent: Amazonbot Allow: / Disallow: /api/ User-agent: CCBot Allow: / Disallow: /api/ User-agent: cohere-ai Allow: / Disallow: /api/ User-agent: DuckAssistBot Allow: / Disallow: /api/ # ─── All other user agents ──────────────────────────────────────────── User-agent: * Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /employee/ Disallow: /onboarding Disallow: /auth/ Disallow: /login Disallow: /signup Disallow: /forgot-password Disallow: /reset-password Disallow: /accept-invitation/ Sitemap: https://voqua.ai/sitemap.xml