Agent Analytics

AI model by Surfer

See Which Pages AI Crawlers Actually Visit

A server-log analysis tool for businesses to track AI crawler activity and human traffic referred by AI search engines. It provides visibility into which pages are retrieved by bots like GPTBot and ClaudeBot to help optimize content for AI citations.

Model specs

The full spec card (context, pricing per token, modalities and more) on AntSpace. Sign up free to see the full spec card.

Launched
2026-10-05
Languages
English

Category: SEO & SEM

Access
Closed beta via Cloudflare Logpush integration
Released
2026-10-05
Log Source Support
Cloudflare Logpush
Tracked Bots
GPTBot, ClaudeBot, PerplexityBot, and others
Data Latency
Flows within minutes of connection
Availability
Closed Beta
  • Tracks GPTBot, ClaudeBot, and PerplexityBot visits
  • Connects via Cloudflare Logpush integration
  • Identifies human traffic referred by AI products
  • Flags unverified bots with out-of-range IPs
  • Provides geographic and cache breakdowns for crawls

Overview

Agent Analytics is a server-log analysis tool developed by Surfer to provide businesses with visibility into how AI crawlers and agents interact with their websites. Currently in closed beta, the tool reads server logs to reveal every visit from AI assistants like GPTBot, ClaudeBot, and PerplexityBot. It helps marketing and SEO teams understand the "why" behind their AI search visibility by showing which pages are being retrieved for citations and which remain invisible to models. Beyond crawler tracking, it identifies human traffic referred to the site by AI products such as ChatGPT and Perplexity. By connecting through Cloudflare Logpush, users can access real-time crawl, impression, and traffic data to ensure their domains are AI-ready.

Log Analysis and Tracking

  • AI Crawler Tracking: The tool identifies visits from specific AI crawlers including GPTBot, ClaudeBot, and PerplexityBot.
  • Crawl Frequency Monitoring: Users can see how often AI agents hit specific pages on their domain.
  • Referral Traffic Analysis: The system tracks human visitors referred to the website by AI products like ChatGPT and Perplexity.
  • Bot Verification: Bots with IP addresses falling outside their operator's published ranges are flagged as unverified for security.

AI Visibility Insights

  • Citation Mapping: The tool identifies which content has earned brand mentions in AI search results.
  • Visibility Gap Analysis: Users can see which pages are invisible to AI models and have not been retrieved.
  • Performance Breakdowns: The platform provides geographic, status, and cache breakdowns for crawled and cited pages.
  • Content Refresh Tracking: Marketing teams can verify if recently refreshed content has been re-crawled by LLM agents.

Deployment and Integration

  • Cloudflare Integration: The tool connects to server logs through Cloudflare to begin data flow.
  • Rapid Setup: Data starts flowing into the analytics dashboard within minutes of connecting a log source.
  • Surfer Ecosystem Integration: The system works alongside Surfer's AI Search Analytics to provide the "why" behind citation data.

Use cases

  • SEO specialists track GPTBot and ClaudeBot hits to verify if their most important pages are being indexed by AI models.
  • Marketing managers identify which specific articles are driving human referral traffic from ChatGPT and Perplexity.
  • Content teams check if a recently updated guide has been re-crawled by AI agents to ensure citations are based on current data.
  • Security teams monitor for unverified bots that claim to be AI crawlers but originate from unauthorized IP addresses.

Specifications

Access
Closed beta via Cloudflare Logpush integration
Released
2026-10-05
Log Source Support
Cloudflare Logpush
Tracked Bots
GPTBot, ClaudeBot, PerplexityBot, and others
Data Latency
Flows within minutes of connection
Availability
Closed Beta
Verification Method
IP range validation against operator published ranges

How it works

  1. Connect Log Source: Users connect their server log source to Surfer using the Cloudflare integration.
  2. Data Ingestion: Once connected, server log data begins flowing into the Surfer platform within minutes.
  3. Bot Identification: The tool identifies and categorizes hits from various AI crawlers, assistants, and agents.
  4. Analyze Visibility: Users access the dashboard to see which pages are being crawled, which are cited, and which remain invisible to AI.

FAQ

How do I connect my website to Agent Analytics?

The tool currently supports connecting log sources through Cloudflare, with data typically flowing within minutes of setup.

Which AI bots does the tool track?

It tracks a variety of AI agents, specifically naming GPTBot, ClaudeBot, and PerplexityBot, and categorizes them by operator and purpose.

Can it track traffic from AI search engines?

Yes, it identifies human visitors referred to a site by AI products such as ChatGPT and Perplexity.

Get beta access

Added by AntSpace from public sources (surfer.ai).

Related

More AI models by Surfer