Tracking AI Responses

TRACKING YOUR VISIBILITY IN AI RESPONSES

In June 2025, Google updated Search Console to track when a website shows up in Google AI Overviews (AIOs) and AI Mode responses only.

Tracking from within Google AI Overviews

We know that Google AI Overviews (AIO) usually appear at the very top of search results (87% of the time at number one). Inside an AIO, Google typically recommends multiple medical practices in a single response (if the user types a search term that indicates they’re looking for a medical provider). In Search Console, all the practices listed within the AI Overview are counted as ranking in the same position.

So, let’s say a user types “The best pizza place in Chicago,” and an AIO appears at the very top.

  • Within that AI Overview, “Jane’s Pizza” shows up, and that result points directly to Jane’s Pizza website. Google Search Console will credit Jane’s Pizza website as ranking position 1.
  • However, Sam’s Pizza and Chicago Pizza Central are also listed within the same AI Overview response, and both link back to their relevant business website. This means the websites for Jane’s Pizza, Sam’s Pizza, and Chicago Pizza Central are all credited with ranking in position 01.

When it comes to traffic, we have to remember that AI Overview responses include all the information the user could want to see, meaning the user is less likely to click on a link. However, the very few that do click on a link via AI Overview (and if that link points back to the website), then the visit is categorized as organic traffic in Google Analytics.

Tracking from within Google AI Mode

In AI Mode, rankings are tracked a bit differently. Rather than displaying an AI response within the traditional search results page, AI Mode functions as a separate search tab. Here, users enter a prompt, and (if the user types a prompt that indicates they’re looking for a medical provider), the response may recommend up to several medical practices in blocks, cards, or carousels. Each one of these elements is assigned its own ranking position, which means Google Search Console also assigns a different ranking position to each recommended practice within the AI Mode response.

Again, let’s assume a user types “The best pizza place in Chicago,” in AI Mode.

  • Within the AI Mode response, “Jane’s Pizza” shows up as the first recommended pizzeria in a list of several. In this case, Google Search Console records that Jane’s Pizza website is ranking in position 01.
  • However, Sam’s Pizza and Chicago Pizza Central are also listed as the second and third recommended pizzerias. In this instance, Google Search Console records that Sam’s Pizza ranked in position 02, and Chicago Pizza Central ranked at position 03.

When it comes to traffic, AI Mode works a bit differently from AI Overviews, but the impact on traffic is the same. Because the experience in AI Mode is more conversational, users really don’t need to click on links to learn more; they can simply ask follow-up questions about a recommended practice and get the required information. The very few users who click on a link (and if that link points back to the website), then the visit is categorized as organic traffic in Google Analytics.

Though Google Search Console can track rankings and Google Analytics can track traffic coming from AIs, there is no option to filter or segment the data. This means that rankings, impressions, clicks, traffic, etc., from Organic, AI Overviews, and AI Mode are all grouped as one, with no option to separate them.

Tracking from within ChatGPT, Preplexcity, Gemini,

When it comes to ChatGPT, Preplexcity, Gemini, etc., we can only track if the user clicks on a link from an AI response (and if that link points back to the website) then the visit is categorized as referral or direct in Google Analytics. Again, it’s important to remember that recommended practices listed in any AI responses do not always point back to the website. They could point back to a Yelp profile or a GMB profile. In such cases, if the user clicks on the link, the traffic will not be credited to the website, nor can Google Analytics track it.

There is no concept of ranking as such when it comes to ChatGPT, Preplexcity, Gemini, etc., and there is no report that can give insights into whether your practice appears in these AI responses or what search prompts users are typing within them.

SO WHAT CAN EKWA DO TO TRACK WHAT’S GOING ON IN CHATGPT, PREPLEXCITY, GEMINI, ETC?

Quarterly, the teams will simulate search prompts a user could type into these AI platforms and then determine if your practice appears within the AI response. The search prompts we use are real-world medium and long-tail search terms that we see users enter in Google Search. We would programmatically feed these search prompts into these AIs, review the responses, and generate a report based on that and share it with you quarterly.

Sources:
https://support.google.com/webmasters/answer/7042828
https://www.searchenginejournal.com/google-adds-ai-mode-traffic-to-search-console-reports/549089/
https://searchengineland.com/google-ai-mode-traffic-data-search-console-457076