DeclarifyBot

DeclarifyBot reads the public pages of a website when someone asks Declarify to scan it, and states that the website is their own business's site.

• It honours robots.txt for the user agent DeclarifyBot, including Crawl-delay.
• It fetches at most one page per second and at most 200 pages per scan.
• It stays on the website it was given and never crawls job boards or social networks.
• It does not run scripts, fill forms or log in.

To keep it out, add to your robots.txt:

User-agent: DeclarifyBot
Disallow: /