AI Discovery (enabled feature)

AI Discovery (enabled feature)

AI Discovery Overview

The AI Discovery report allows you to monitor how AI search engine bots, like ChatGPT and Perplexity, are interacting with your site based on how they are crawling and retrieving data. By analyzing the bot activity, you can gain understanding into what is potentially used for model training or answer generation. This feature collectively provides a comprehensive view of AI bot interactions with your site, enabling strategic content management and search optimization.

Background & Requirements for AI Discovery

A subscription to AI Discovery is required for access to this feature. The Server Log integration must be completed for data to be present in this report. Send us an email at support@seoclarity.net, and we’ll help you find a solution that fits your needs.

AI Discovery Use Cases

  1. Content Tracking: Determine how much of your content is being picked up or referenced by AI bots
  2. Gap Analysis: Identify which pages on your site are not accessed by AI bots at all
  3. Error Detection: Discover if bots are accessing non-existent URLs that result in 4xx errors, indicating possible hallucinations by the AI.

AI Discovery


AI Discovery filters
Engines: Filter for all or specific AI engines to display data for just those AI Bots.
Page Status: Filter by page response code status grouped by 200 OK, 3xx Redirects, 4xx Errors, or 5xx Errors.
Content Type: Filter for all or specific content types to display data for just those URL patterns.
Date Range: Select the date range for which the report should be based on with options for relative date ranges that can be applied. Select the Compare checkbox to change to a comparison view for two date ranges. 

AI Discovery summaries
Bot Requests: Displays the count of bot requests from AI engines for the selected date range. 
Unique Pages: Displays the unique count of pages that have been visited by AI engines for the selected date range. 

AI Discovery charts
Pages: Displays the count of new and existing pages that have been visited by AI engines. New pages are those that bot logs show have not been visited by an AI engine. 
Content Types: Displays the AI bot requests broken down by Content Type. View options include: requests for all pages, requests for new pages, requests for existing pages, the count of all pages, the count of new pages, the count of existing pages, or the count of unique pages. 
Bots:  Displays the AI bot requests broken down by Bot name or Bot Group.  

AI Discovery Pages table
URL: Displays the URLs that have been visited by an AI engine for the selected the date range. 
Bot Requests: Displays the count of bot requests for the corresponding URL. 
Response Codes: Displays a breakdown of response codes returned to the AI engine split by 2xx and non-2xx responses. 

AI Discovery Content Types table


Content Type: Displays the Content Types that have been visited by an AI engine for the selected the date range. 
Bot Requests: Displays the count of bot requests for the corresponding Content Type. 
Response Codes: Displays a breakdown of response codes returned to the AI engine split by 2xx and non-2xx responses. 
Unique Pages: Displays the unique count of pages that have been visited by an AI engine that belong to the corresponding Content Type.

AI Discovery Bots table


Bot: Displays the name of the AI Bot that has the site for the selected the date range. 
Bot Requests: Displays the count of bot requests from the corresponding Bot. 
Avg Requests: Displays the average number of bot requests from the corresponding Bot. 
Unique IPs: Displays the count of unique IPs used by the corresponding Bot. 
Last Crawl Date: Displays the date of the last crawl for the corresponding Bot. 
Response Codes: Displays a breakdown of response codes returned to the AI engine split by 2xx, 3xx, 4xx and 5xx responses. 

    • Related Articles

    • AI Performance

      AI Performance Overview AI Performance provides you with a comprehensive view of how AI-driven traffic influences your site's performance. With clear insights into which AI platforms—such as ChatGPT, Perplexity, and Gemini—are driving traffic, you ...

    • Google Business Profile (enabled feature)

      Google Business Profile Overview Google My Business, now known as Google Business Profile, is an enabled feature that uses the Local Clarity integration to view data for GBP. Google Business Profile Use Cases Optimize your Google Business Profile ...

    • Google Jobs (enabled feature)

      Google Jobs Overview Google Jobs is a rank checking add-on feature that can be enabled by contacting support@seoclarity.net. With Google Jobs you can view the entire set of ranking data for jobs results as displayed in Googles Job Listing engine ...

    • Google Maps (enabled feature)

      Google Maps Overview seoClarity's Google Maps sheds light into an aspect of local SEO, by providing performance metrics within Google's local business listings. Google's results are increasingly geo-localized and the inclusion of Google Local ...

    • Schema Optimizer (enabled feature)

      Schema Optimizer Overview Schema Optimizer enables the the ability to add multiple schema types to any set pages across a site. How to add FAQ Schema using Schema Optimizer video: Background & Requirements Once this feature is enabled for an account, ...