# Loupe — robots.txt # Posture: # - Search engines (Google, Bing, DuckDuckGo): index landing pages only. # The /vs/*, /alternatives/*, /docs/*, /articles/*, /glossary.md and # keyword-anchor .md files are blocked so they never surface as # separate Google results. # - AI search assistants (ChatGPT-User, PerplexityBot, ClaudeBot, etc.): # full access — they read llms.txt, llms-full.txt, and the .md files # when grounding answers about Loupe. # - AI training crawlers (GPTBot, CCBot, Google-Extended, etc.): # blocked entirely. # --- Search engines: landing pages only --- User-agent: Googlebot Allow: / Disallow: /onboarding/ Disallow: /vs/ Disallow: /alternatives/ Disallow: /alternatives.md Disallow: /compare.md Disallow: /docs/ Disallow: /articles/ Disallow: /glossary.md Disallow: /investment-research-platform.md Disallow: /hedge-fund-research-software.md Disallow: /research-management-platform.md Disallow: /broker-research-aggregation.md Disallow: /ai-financial-copilot.md Disallow: /about.md Disallow: /contact.md Disallow: /auth.md Disallow: /index.md Disallow: /manifesto.md User-agent: Bingbot Allow: / Disallow: /onboarding/ Disallow: /vs/ Disallow: /alternatives/ Disallow: /alternatives.md Disallow: /compare.md Disallow: /docs/ Disallow: /articles/ Disallow: /glossary.md Disallow: /investment-research-platform.md Disallow: /hedge-fund-research-software.md Disallow: /research-management-platform.md Disallow: /broker-research-aggregation.md Disallow: /ai-financial-copilot.md Disallow: /about.md Disallow: /contact.md Disallow: /auth.md Disallow: /index.md Disallow: /manifesto.md User-agent: DuckDuckBot Allow: / Disallow: /onboarding/ Disallow: /vs/ Disallow: /alternatives/ Disallow: /alternatives.md Disallow: /compare.md Disallow: /docs/ Disallow: /articles/ Disallow: /glossary.md Disallow: /investment-research-platform.md Disallow: /hedge-fund-research-software.md Disallow: /research-management-platform.md Disallow: /broker-research-aggregation.md Disallow: /ai-financial-copilot.md Disallow: /about.md Disallow: /contact.md Disallow: /auth.md Disallow: /index.md Disallow: /manifesto.md # --- Social preview --- User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: LinkedInBot Allow: / User-agent: Slackbot Allow: / # --- AI search / assistant crawlers (user-initiated, allow full access) --- User-agent: ChatGPT-User Allow: / Disallow: /onboarding/ User-agent: OAI-SearchBot Allow: / Disallow: /onboarding/ User-agent: PerplexityBot Allow: / Disallow: /onboarding/ User-agent: Perplexity-User Allow: / Disallow: /onboarding/ User-agent: ClaudeBot Allow: / Disallow: /onboarding/ User-agent: Claude-User Allow: / Disallow: /onboarding/ User-agent: Claude-SearchBot Allow: / Disallow: /onboarding/ User-agent: Applebot Allow: / Disallow: /onboarding/ User-agent: Applebot-Extended Allow: / Disallow: /onboarding/ User-agent: ora-agent Allow: / # --- AI training crawlers (disallow) --- User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: Omgilibot Disallow: / User-agent: Diffbot Disallow: / # --- Default: landing pages only (matches search-engine posture) --- User-agent: * Allow: / Disallow: /onboarding/ Disallow: /vs/ Disallow: /alternatives/ Disallow: /alternatives.md Disallow: /compare.md Disallow: /docs/ Disallow: /articles/ Disallow: /glossary.md Disallow: /investment-research-platform.md Disallow: /hedge-fund-research-software.md Disallow: /research-management-platform.md Disallow: /broker-research-aggregation.md Disallow: /ai-financial-copilot.md Disallow: /about.md Disallow: /contact.md Disallow: /auth.md Disallow: /index.md Disallow: /manifesto.md # Content Signals (purpose-based crawl permissions) Content-Signal: search=yes, ai-input=yes, ai-train=no Sitemap: https://louperesearch.com/sitemap.xml Schemamap: https://louperesearch.com/schemamap.xml