Why did my crawl get paused?
Sometimes crawl frequencies and schedules conflict and your crawl will be paused.
When setting up
a new crawl there are 2 different sections in the “Start Audit” tab that can
conflict.
They are the Frequency options and the Schedule set up for days and times.
- If a crawl Frequency
is set to run on specific dates but those dates land on days of the week the
crawl Schedule section is not set up for,
then the crawl will end up with a status of paused. - The crawl will
kick off based on the automated recurring crawl setup in the Frequency section,
but the status of your crawl will be changed to paused.
The crawl will automatically start back up once it no longer conflicts with the days assigned in the Schedule section.
Related Articles
Why did my crawl return an error?
Crawl Error Video Malformed or Incorrect URL Check that the starting URL is correct and is accessible (200 response) to the user agent setup for the crawl. User Agent We recommend adding our crawler as an allowed crawler based on the user agent name, ...Allowing The seoClarity Crawler To Crawl Your Site
Overview The seoClarity crawler can only crawl your site if you allow it to. With the volume of bad bots increasing day by day, most sites are enhancing their security to block unknown bots from accessing their site. In that respect, it is important ...Why isn't metadata showing in the Site Audit crawl?
If URLs from the crawl don’t have a 2xx status (meaning they're not fully accessible), metadata won’t show up for those pages. Since our crawler works similarly to Google’s, if we can’t access these URLs, it’s likely Google also can’t. This could ...What type of crawl should I set up, Standard or Javascript?
Javascript vs Standard Crawls How to check which crawler option to use: Open the url in the browser Disable Javascript See below for steps to disable Javascript Load/re-load the page If you cannot see the links populate, it means that the ...Why Isn't my Internal Link Analysis data Showing after a Site Audit Crawl?
If you've completed a Site Audit crawl and your Internal Link Analysis data isn't appearing, don't worry! Here's what you need to know: Internal Links data can take up to 24 hours to process after a crawl is completed; the analysis is based on pages ...