Customize Resources Crawled in JavaScript Crawls

Customize Resources Crawled in JavaScript Crawls

Running Javascript-enabled Site Audits requires each page to be rendered before crawling. This includes loading all the resources (CSS, JavaScript etc) on the page.

The seoClarity Clarity Audit crawler is configured to automatically block some common resources that pertain to analytics and some popular ad services in order to make sure reporting in those systems are not inflated by the Clarity Audit crawler.

However, there may be some instances when you may want to block specific additional resources from loading and firing impressions beyond the ones we automatically exclude. This can be achieved by entering the resource url you would like blocked into the Block Resources field and our Javascript crawler will not load that resource when rendering the page. 

Here are some examples of different exclusion patterns you can enter in the Block Resources field
Pattern of urls you want blocked while Rendering JS Sample URL that this should block What should be entered in the Block Resources Field
All urls starting with https://www.example.net/sample/ https://www.example.net/sample/path/path/test.js https://www.example.net/sample/
All urls that contain the /sample/ subfolder https://www.example.net/sample/path/path/test.js /sample/
All urls from example.net domain https://www.example.net/test.js example.net

Below is a screenshot of where the Block Resources field can be set while setting up a new crawl: