Site Health: View Details of all Resource Urls rendered in Javascript crawls

Site Health: View Details of all Resource Urls rendered in Javascript crawls


With the rise in usage of Javascript frameworks, such as React, Vue, Angular etc in Websites of today, crawling requires all the code and resource urls on the page to be processed and rendered. 


Having resource urls that are not accessible or returning the incorrect response could mean that crawlers would not be able to render the page as intended which may impact how users view the page and cause inaccurate indexing by search engine crawlers.  


This makes it important to audit these resource urls to confirm that all resources are returning the correct response. An additional use case this could be used for is to ensure that resources pertaining to paid apis, google ads and analytics are blocked while crawling.  


Our latest update to the capability of our Javascript crawler and the performance tab of our Site Health 3.0 UI allows you to capture, view and download the resource urls details for all Javascript crawls. These details include the count of resource urls found per page along with the resource url, the status, whether it was cached, the request type and the resource type. 


This information is captured for all Javascript crawls and is visible in the Performance Tab. Simply click on the number of resources loaded per url to view the details. 


 



    • Related Articles

    • Site Audit Details

      Site Audit Details Overview Site Audit Details is a new version of Site Health. The UI is designed with a similar look and feel of the earlier Site Health but it has been rebuilt using our Clarity Grid Infrastructure. This page provides a variety of ...
    • Customize Resources Crawled in JavaScript Crawls

      Running Javascript-enabled Site Audits requires each page to be rendered before crawling. This includes loading all the resources (CSS, JavaScript etc) on the page. The seoClarity Clarity Audit crawler is configured to automatically block some common ...
    • Setting up a Site Audit

      Overview A Site Audit will crawl pages on your site and return a summary report of the audit results through Site Audit Reports along with a detailed analysis of of pages crawled, redirect chain analysis, audits for duplicate content, canonical, ...
    • Site Audit Projects

      Site Audit Projects Overview The Site Audit Projects List gives you a high level view of the different crawls that have been setup for the domain. Watch the video below: "How to Create a Clarity Audit Project" Background & Requirements Some sites ...
    • Site Audit Report

      Site Audit Report Overview This overview will help you understand exactly what Site Audit Reports displays, which is a summary of the most recently completed crawls. It contains a summarized view of site health scores of crawls run within a project, ...