Page Crawler settings

Overview

Page Crawler settings allow you to specify custom content to be tracked for your managed pages in Page Clarity. To set up email alerts for Page Crawler settings see Setting Up Email Alerts in Page Clarity. Managed elements can utilize the on-page content that is crawled here for dynamic tagging. 

Page Crawler settings

Select the + Add more button to input additional on-page content to be crawled. 

Crawl this content: Select a page element that is available via XPath, CSS, Div_ID, or Div_Class from the dropdown and input the specific text corresponding to that page element in the textbox.

For pages that meet this criteria: Input a name for the page element in the textbox and select whether this element is available on All pages or a certain set using Contains, Equals or a Regular Expression (RegExp) via the dropdown. For non-All selections, input the corresponding URL pattern that the page element is found on. 

• Related Articles

• Allowing The seoClarity Crawler To Crawl Your Site

  Overview The seoClarity crawler can only crawl your site if you allow it to. With the volume of bad bots increasing day by day, most sites are enhancing their security to block unknown bots from accessing their site. In that respect, it is important ...

• Page Tag Detail

  Page Tag Detail Overview Page Tag Detail page provides an in-depth look into all of the data relating to the Page Tag groups that have been set up in this profile. Page Tag Detail Use Cases Organize all of your managed URLs into specified groups ...

• Page Clarity Managed Pages

  Page Clarity Overview This overview provides an easy understanding of the Page Clarity tool. It was designed to enable you to monitor and manage your Target URLs at any level you choose. This guide will walk you through the process of adding URLs, ...

• Content Guard and Content Guard Plus (enabled feature)

  Content Guard Overview Content Guard is available to all users with a Core level subscription or higher. It provides a webpage change monitoring system by running on seoClarity’s existing global scale crawl infrastructure. Content Guard Plus enables ...

• URL Parameter settings

  OverviewCustomize how ClarityBot crawls your site. The URL Parameters Setting gives users the ability to instruct the seoClarity crawler bot with customizable crawl settings for your website, as well as setup pattern matching rules for managed pages ...