Why does a completed crawl show a different number of pages crawled versus when it was running?

Why does a completed crawl show a different number of pages crawled versus when it was running?

While a crawl is running, the Site Health report will display every single URL that has been encountered during the crawl so far. Once the crawl is completed, the Audit reports are processed and duplicates are removed which can lead to a difference in the number of URLs crawled from the time the crawl was running.  


An example of when this occurs is If multiple URLs redirect to the same URL, that URL is counted multiple times in the count of pages crawled.


    • Related Articles

    • Site Audit Report

      Site Audit Report Overview This overview will help you understand exactly what Site Audit Reports displays, which is a summary of the most recently completed crawls. It contains a summarized view of site health scores of crawls run within a project, ...
    • Page Tags

      Page Tags Overview This walkthrough will take you through the process of adding, editing, and deleting Page Tags in the seoClarity platform. This is a high-level overview of the Page Tags basics which will get you started in the tool. After going ...
    • Allowing The seoClarity Crawler To Crawl Your Site

      Overview The seoClarity crawler can only crawl your site if you allow it to. With the volume of bad bots increasing day by day, most sites are enhancing their security to block unknown bots from accessing their site. In that respect, it is important ...
    • Site Audit Projects

      Site Audit Projects Overview The Site Audit Projects List gives you a high level view of the different crawls that have been setup for the domain. Watch the video below: "How to Create a Clarity Audit Project" Background & Requirements Some sites ...
    • Internal Links Analysis

      Internal Links Analysis Overview Internal Links Analysis is a summary of the internal (own domain) linking data based on a Site Audit crawl. Internal Links data takes up to 24 hours to process once a crawl is completed and is based on indexable (200 ...