Robots.txt & AI Bot Checker
See whether Googlebot, Bingbot, GPTBot, ClaudeBot, Google-Extended, and other crawlers are allowed to access a specific page.
Free, no signup. Rate-limited per visitor to keep this fast for everyone.
See whether Googlebot, Bingbot, GPTBot, ClaudeBot, Google-Extended, and other crawlers are allowed to access a specific page.
Free, no signup. Rate-limited per visitor to keep this fast for everyone.