How do I configure Cloudflare to allow the Claritybot user agent to crawl my site?
How do I configure Cloudflare to allow the Claritybot user agent to crawl my site?
Please note that the following settings are part of the Cloudflare platform and could be changed by them without notice.
In
https://dash.cloudflare.com,/
select the domain name that will be the crawl target
Navigate to the “Firewall” tab and click “Firewall Rules”
Click "Create Firewall rule"
Input: a Rule name, for example “Allow Claritybot”
Field: User Agent
Operator: equals
Value: {select a user agent string from below}
Choose an action: Allow
Desktop User-Agent String:
Mozilla/5.0 (compatible; ClarityBot/9.0; +
https://www.seoclarity.net/bot.html)
Mobile User-Agent String:
Mozilla/5.0 (Linux; Android 9; SM-G960F Build/PPR1.180610.011; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0
Chrome/74.0.3729.157 Mobile Safari/537.36 (compatible; ClarityBot/9.0; +
https://www.seoclarity.net/bot.html)
Compare your page to the diagram below. When you are happy, click "Deploy".