ExactSiteBot

What it is

ExactSiteBot reads a business’s website when someone asks ExactSite for a free audit of it, or when a customer asks us to rescan their own site. It does not crawl the web at large.

How it behaves

• It identifies itself as ExactSiteBot/0.1 with a link to this page.
• It reads robots.txt first and follows it. If robots.txt disallows ExactSiteBot, it reads nothing.
• It makes one request a second and reads at most 25 pages per scan.
• It sends one request each with the GPTBot, ClaudeBot and PerplexityBot user agents to your home page, to check whether your hosting blocks AI assistants. We tell the business the result.

How to block it

Add this to your robots.txt:

User-agent: ExactSiteBot
Disallow: /