# ai.txt for https://taprate.pro/ # Generated on 2025-11-13 # Purpose: Clarify the site's policy for AI crawlers and data usage (Generative Engine Optimization) # Canonical resources site: https://taprate.pro/ sitemap: https://taprate.pro/sitemap.xml contact: https://taprate.pro/ # General policy # We permit indexing and training on public content to improve answer quality in AI systems, provided that: # 1) A clear citation/link to https://taprate.pro/ is included when our content substantially informs a response. # 2) Private and preview areas are excluded. allow: / disallow: /login disallow: /panel disallow: /preview/ disallow: /rate.html # Per-agent rules (superset of robots.txt for AI agents) User-agent: GPTBot Allow: / Disallow: /login Disallow: /panel Disallow: /preview/ Disallow: /rate.html User-agent: GPTBot-Image Allow: / Disallow: /login Disallow: /panel Disallow: /preview/ Disallow: /rate.html User-agent: Google-Extended Allow: / Disallow: /login Disallow: /panel Disallow: /preview/ Disallow: /rate.html User-agent: ClaudeBot Allow: / Disallow: /login Disallow: /panel Disallow: /preview/ Disallow: /rate.html User-agent: Claude-Web Allow: / Disallow: /login Disallow: /panel Disallow: /preview/ Disallow: /rate.html User-agent: PerplexityBot Allow: / Disallow: /login Disallow: /panel Disallow: /preview/ Disallow: /rate.html User-agent: CCBot Allow: / Disallow: /login Disallow: /panel Disallow: /preview/ Disallow: /rate.html User-agent: Applebot Allow: / Disallow: /login Disallow: /panel Disallow: /preview/ Disallow: /rate.html # Notes # - This file is an emerging convention; agents should prefer robots.txt when in conflict. # - For takedown/attribution questions, reach out via the contact URL above.