What type of crawl should I set up, Standard or Javascript?

What type of crawl should I set up, Standard or Javascript?

Javascript vs Standard Crawls

How to check which crawler option to use:
  1. Open the url in the browser
  2. Disable Javascript 
       See below for steps to disable Javascript
  3. Load/re-load the page
If you cannot see the links populate, it means that the content/links are generated via Javascript, which means the crawler type selected should be Javascript.



How to Disable Javascript In A Browser



Steps
Use the inspect option for the URL in a browser, like Chrome, and right click the page or use Ctrl+Shift+I



  1. Click on the menu for more options, then select Run command or use Ctrl+Shift+P


  1. The Panel will open


  1. Search for Javascript in the Panel and select Disable Javascript


    • Related Articles

    • Customize Resources Crawled in JavaScript Crawls

      Running Javascript-enabled Site Audits requires each page to be rendered before crawling. This includes loading all the resources (CSS, JavaScript etc) on the page. The seoClarity Clarity Audit crawler is configured to automatically block some common ...

    • Why did my crawl return an error?

      Crawl Error Video Malformed or Incorrect URL Check that the starting URL is correct and is accessible (200 response) to the user agent setup for the crawl. User Agent We recommend adding our crawler as an allowed crawler based on the user agent name, ...

    • Setting up a Site Audit

      Overview A Site Audit will crawl pages on your site and return a summary report of the audit results through Site Audit Reports along with a detailed analysis of of pages crawled, redirect chain analysis, audits for duplicate content, canonical, ...

    • Site Audit Projects

      Site Audit Projects Overview The Site Audit Projects List gives you a high level view of the different crawls that have been setup for the domain. Watch the video below: "How to Create a Clarity Audit Project" Background & Requirements Some sites ...

    • Allowing The seoClarity Crawler To Crawl Your Site

      Overview The seoClarity crawler can only crawl your site if you allow it to. With the volume of bad bots increasing day by day, most sites are enhancing their security to block unknown bots from accessing their site. In that respect, it is important ...