AI SpeedForce

Measuring visibility in AI answers: what you can track

There is no search console for AI answers. You can still track three honest signals: referral visits from assistants, AI crawler activity in your logs, and a fixed panel of test questions.

You cannot measure your visibility in AI answers precisely, because no assistant reports how often it cites you. You can track three honest signals: visits referred from assistant sites, AI crawler activity in your server logs, and the results of a fixed panel of test questions you run each month. Together they show a trend, which is what you need to judge whether your work is paying off.

This post explains each signal, what it can and cannot tell you, and a simple routine to run.

Why measurement is hard

Classic search gives you impressions, clicks and positions through tools such as Google Search Console. AI answers do not have an equivalent for most assistants. Answers are generated per request, vary with the wording of the question, and often satisfy the reader without a click. There is no public log of who asked what and which sources were used.

So be wary of any report that claims an exact share of AI answers for your brand. It is a sample of prompts someone chose, taken at one moment. It can still be useful, as long as you read it as a sample.

Can measureCannot measure reliably
TrafficVisits referred from assistant sitesAnswers that mention you with no click
CrawlingWhich AI crawlers fetch which pagesHow a fetched page was used
AnswersWhat a fixed set of test prompts returns todayWhat every user sees, every time
ShareYour own trend over timeA precise market share of AI answers
What you can and cannot measure

Signal one: referral visits from assistants

When a user clicks a cited link in an assistant, the visit often arrives with the assistant's domain as the referrer. In your analytics, create a segment for known assistant and AI search domains and watch it over time.

  • What it tells you: that you are being cited and that the citation is useful enough to click. Which pages earn those clicks is especially valuable.
  • What it misses: every answer that cites or paraphrases you without a click, and visits where the referrer is stripped, for example from some apps.

Treat the number as a floor. A rise usually means real gains; a flat line does not prove nothing is happening.

Signal two: AI crawler activity in your logs

Your server access logs record the user agent of every request. AI providers publish the names of their crawlers, so you can filter for them: for example GPTBot, OAI-SearchBot and ChatGPT-User from OpenAI, ClaudeBot and Claude-User from Anthropic, and PerplexityBot from Perplexity. Our guide to robots.txt for AI crawlers lists the main ones and what each is for.

  • What it tells you: which pages AI systems fetch, how often, and whether a user-initiated fetcher visited a page. That last one is a direct sign that someone asked an assistant about content on your site.
  • What it misses: how the page was used afterwards. A fetch is not a citation.

User agent strings can be faked, so for decisions that matter, check the provider's published IP ranges where they offer them. Also check your own rules: a crawler you block in robots.txt should stop appearing, which confirms your policy works.

Signal three: a fixed prompt panel

Write a list of 20 to 30 questions your customers really ask, the kind your pages are meant to answer. Once a month, ask each question in the assistants that matter to you and record three things: whether you are cited, whether you are mentioned, and which competitors appear.

  • Keep the questions and wording fixed, so months are comparable.
  • Use a clean session, and note the date, the assistant and your location.
  • Record facts, not impressions: cited yes or no, position of the citation, the linked page.

This is manual, and that is the point. It is cheap, it is transparent, and it shows you exactly what a customer would see. It also surfaces content gaps: a question where a competitor is always cited is a page you should write or improve. See how to write content AI assistants quote.

A monthly visibility routineLogs then Referrals then Panel then Compare then ActA MONTHLY VISIBILITY ROUTINELogscount AI crawler fetchesReferralscheck assistant trafficPanelrun the fixed promptsCompareagainst last monthActfix gaps you found
A monthly visibility routine

Reading the signals together

Each signal is weak on its own. Together they tell a story. Suppose your prompt panel shows you are now cited for a question about delivery times. In the same month your logs show more user-initiated fetches of your delivery page, and analytics shows a small rise in assistant referrals landing on it. Three independent signals point the same way, so you can be fairly confident the change you made to that page worked.

The reverse is useful too. If AI search crawlers fetch a page often but you never see it cited in your panel, the page is being read but not chosen. That usually points to the content: the answer is buried, unclear or contradicted elsewhere. If the crawlers never fetch it at all, the problem is access or discovery, such as a robots.txt rule, a missing link, or text that only appears after JavaScript runs.

What to report, and what not to

Report trends and specific wins: more assistant referrals to a key page, a new user-initiated fetch pattern, a prompt where you are now cited. Do not report a single "AI visibility score" as if it were a precise fact. The systems vary too much for that, and a number that moves with the prompt wording will mislead the people who read it.

Fix the inputs while you measure

Measurement only helps if you act on it. The inputs you control are the same ones covered in what is answer engine optimization: crawl access, clear answers, structure, structured data and freshness. The technical side is quick to check.

Set up in an afternoonSegment assistant referrers in analytics; Filter server logs by AI user agents; Write 20 to 30 fixed test questions; Record results in a simple sheet; Repeat on the same day each monthSET UP IN AN AFTERNOONSegment assistant referrers in analyticsFilter server logs by AI user agentsWrite 20 to 30 fixed test questionsRecord results in a simple sheetRepeat on the same day each month
Set up in an afternoon

Next step

Before you measure, make sure AI systems can reach and read your site. The free agent-readiness scan checks your crawler rules, llms.txt, Markdown and structured data in one pass. If you want the reporting routine built into your own tools, see our automation and workflows service.

01Asked

Questions about this topic

Is there a Search Console for AI answers?

Not in the same sense. Some search engines report AI features inside their existing tools, but there is no single place that shows how often every assistant cites your site.

Can I trust tools that report my share of AI answers?

Treat them as samples. They run their own prompts, and assistants vary answers by wording, location and time. Use them for trends, not exact figures.

Why do assistant referrals look so low?

Many answers are read without a click, and some assistant traffic arrives without a referrer. Referral counts show a floor, not the full reach of your content.

See how your own site scores

The free agent-readiness scan checks the files, headers and endpoints this blog writes about, and tells you what to fix first.

AI SpeedForce
Start a project Log in