What type of crawl should I set up, Standard or Javascript?

What type of crawl should I set up, Standard or Javascript?

Javascript vs Standard Crawls

How to check which crawler option to use:
  1. Open the url in the browser
  2. Disable Javascript 
       See below for steps to disable Javascript
  3. Load/re-load the page
If you cannot see the links populate, it means that the content/links are generated via Javascript, which means the crawler type selected should be Javascript.



How to Disable Javascript In A Browser



Steps
Use the inspect option for the URL in a browser, like Chrome, and right click the page or use Ctrl+Shift+I



  1. Click on the menu for more options, then select Run command or use Ctrl+Shift+P


  1. The Panel will open


  1. Search for Javascript in the Panel and select Disable Javascript