Resources

Guides for blocking AI crawlers, generating robots.txt, and configuring popular CMS platforms.

• How to block GPTBot (OpenAI)
• How to block ClaudeBot (Anthropic)
• How to block PerplexityBot
• How to block Google‑Extended
• How to block Bytespider
• How to block CCBot (Common Crawl)
• How to block Amazonbot
• robots.txt for WordPress
• robots.txt for Shopify
• robots.txt for Webflow