Contact me

Generative AI / LLM Search Console

Created an integrated generative AI tracker and search console to monitor how LLMs utilize site content; track brand and competitive visibility; report website engagement; and analyze query fan-outs for directional and optimization insights.

The Problem

Several clients needed to know how different generative AI platforms utilized their content, how visible they were, if popular LLMs were sending them traffic, and what visitors did once they reached their websites.

The Solution

  • Built an integrated AI Search Console utilizing Looker Studio and BigQuery to combine large-scale datasets, visualizing key performance indicators including indexation, bot crawls, visibility tracking, and website engagement.
  • Integrated a generative AI-focused server access log database to create a maintained historical record of content access by LLMs and paired with log analysis to understand which content is utilized and favored.
  • Created a generative AI tracker in Python, Google Colab, and Google BigQuery to track probable mentions and citations across ChatGPT, Perplexity, Gemini, AI Overviews, and AI Mode for directional insights.
  • Constructed a benchmarking framework to monitor brand and competitor citations and share-of-voice, as well as industry citations and share-of-voice for indirect visibility, traffic, and leads.
  • Included query fan-out analysis to derive directional insights for GEO, optimizing content for citation preference and AI-driven discovery.

The Results

Bot Crawls

Bot crawl stats for server access logs
Source: Server access logs

In the screenshot above, the server access logs are displayed, which can be filtered by platform and bot type. The kinds of content and the corresponding categories that the bots crawled during that time frame are broken down as well.

Brand Mentions

Screenshots and descriptions coming soon.

Competitor Mentions

Screenshots and descriptions coming soon.

Brand Citations

Screenshots and descriptions coming soon.

Competitor Citations

Screenshots and descriptions coming soon.

Third-Party Recommendations / Directory Mentions and Citations

Shows generative AI mentions of legal directories and the share of voice of legal directory citations
Source: ChatGPT responses (for a given practice area)

For local service area business clients, the AI search console is capable of monitoring the influence of third-party sources and directories in generative AI responses on a platform-by-platform basis. In the above screenshot, when asking for attorney recommendations across a given practice area for different focuses, ChatGPT was most likely to mention that users should cross-reference Super Lawyers and Avvo for ratings and reviews on attorneys in any given response.

Across the citations linked to, category pages from Super Lawyers and Avvo were most often included, amounting to 70+% of citations across all prompts, with a smaller share accorded to non-directory websites (like law firm sites).   

Generative AI legal directory citations from responses
Source: ChatGPT responses (for a given practice area)

This is an alternative graph of the above, except it includes non-directory citations and measures how much a given sources was cited out of all citations made that day.

Tracked Traffic from Google AI Overviews and AI Mode

Tracked traffic in Google Analytics from clicks on AI Overviews and AI Mode
Source: Google Analytics

The AI search console now features traffic from Google AI Overviews and AI Mode, featuring my recently discovered tracking setup. 

Ready to grow?

Get in touch with me below.