Knowledge Base

How do I configure Cloudflare to allow the Claritybot user agent to crawl my site?


Please note that the following settings are part of the Cloudflare platform and could be changed by them without notice.
  1. In https://dash.cloudflare.com,/ select the domain name that will be the crawl target
  2. Navigate to the “Firewall” tab and click “Firewall Rules”
  3. Click "Create Firewall rule"
  4. Input: a Rule name, for example “Allow Claritybot”
    Field: User Agent
    Operator: equals
    Value: {select a user agent string from below}
  5. Choose an action: Allow
Desktop User-Agent String:  
     Mozilla/5.0 (compatible; ClarityBot/9.0; +https://www.seoclarity.net/bot.html)
Mobile User-Agent String:
      Mozilla/5.0 (Linux; Android 9; SM-G960F Build/PPR1.180610.011; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0
      Chrome/74.0.3729.157 Mobile Safari/537.36 (compatible; ClarityBot/9.0; +https://www.seoclarity.net/bot.html)

Compare your page to the diagram below. When you are happy, click "Deploy". 




    • Related Articles

    • Adobe Analytics Partner Exchange Integration

      Overview For Adobe Analytics integration, this article outlines the steps needed to run through in order to grant seoClarity access to your account. Adobe eVars (Conversion Variables) are not needed for the Partner Exchange integration. In the Adobe ...