Agent Analytics
AI model by Surfer
See Which Pages AI Crawlers Actually Visit
A server-log analysis tool for businesses to track AI crawler activity and human traffic referred by AI search engines. It provides visibility into which pages are retrieved by bots like GPTBot and ClaudeBot to help optimize content for AI citations.
Model specs
The full spec card (context, pricing per token, modalities and more) on AntSpace. Sign up free to see the full spec card.
- Launched
- 2026-10-05
- Languages
- English
Category: SEO & SEM
- Access
- Closed beta via Cloudflare Logpush integration
- Released
- 2026-10-05
- Log Source Support
- Cloudflare Logpush
- Tracked Bots
- GPTBot, ClaudeBot, PerplexityBot, and others
- Data Latency
- Flows within minutes of connection
- Availability
- Closed Beta
- Tracks GPTBot, ClaudeBot, and PerplexityBot visits
- Connects via Cloudflare Logpush integration
- Identifies human traffic referred by AI products
- Flags unverified bots with out-of-range IPs
- Provides geographic and cache breakdowns for crawls
Overview
Agent Analytics is a server-log analysis tool developed by Surfer to provide businesses with visibility into how AI crawlers and agents interact with their websites. Currently in closed beta, the tool reads server logs to reveal every visit from AI assistants like GPTBot, ClaudeBot, and PerplexityBot. It helps marketing and SEO teams understand the "why" behind their AI search visibility by showing which pages are being retrieved for citations and which remain invisible to models. Beyond crawler tracking, it identifies human traffic referred to the site by AI products such as ChatGPT and Perplexity. By connecting through Cloudflare Logpush, users can access real-time crawl, impression, and traffic data to ensure their domains are AI-ready.
Log Analysis and Tracking
- AI Crawler Tracking: The tool identifies visits from specific AI crawlers including GPTBot, ClaudeBot, and PerplexityBot.
- Crawl Frequency Monitoring: Users can see how often AI agents hit specific pages on their domain.
- Referral Traffic Analysis: The system tracks human visitors referred to the website by AI products like ChatGPT and Perplexity.
- Bot Verification: Bots with IP addresses falling outside their operator's published ranges are flagged as unverified for security.
AI Visibility Insights
- Citation Mapping: The tool identifies which content has earned brand mentions in AI search results.
- Visibility Gap Analysis: Users can see which pages are invisible to AI models and have not been retrieved.
- Performance Breakdowns: The platform provides geographic, status, and cache breakdowns for crawled and cited pages.
- Content Refresh Tracking: Marketing teams can verify if recently refreshed content has been re-crawled by LLM agents.
Deployment and Integration
- Cloudflare Integration: The tool connects to server logs through Cloudflare to begin data flow.
- Rapid Setup: Data starts flowing into the analytics dashboard within minutes of connecting a log source.
- Surfer Ecosystem Integration: The system works alongside Surfer's AI Search Analytics to provide the "why" behind citation data.
Use cases
- SEO specialists track GPTBot and ClaudeBot hits to verify if their most important pages are being indexed by AI models.
- Marketing managers identify which specific articles are driving human referral traffic from ChatGPT and Perplexity.
- Content teams check if a recently updated guide has been re-crawled by AI agents to ensure citations are based on current data.
- Security teams monitor for unverified bots that claim to be AI crawlers but originate from unauthorized IP addresses.
Specifications
- Access
- Closed beta via Cloudflare Logpush integration
- Released
- 2026-10-05
- Log Source Support
- Cloudflare Logpush
- Tracked Bots
- GPTBot, ClaudeBot, PerplexityBot, and others
- Data Latency
- Flows within minutes of connection
- Availability
- Closed Beta
- Verification Method
- IP range validation against operator published ranges
How it works
- Connect Log Source: Users connect their server log source to Surfer using the Cloudflare integration.
- Data Ingestion: Once connected, server log data begins flowing into the Surfer platform within minutes.
- Bot Identification: The tool identifies and categorizes hits from various AI crawlers, assistants, and agents.
- Analyze Visibility: Users access the dashboard to see which pages are being crawled, which are cited, and which remain invisible to AI.
FAQ
How do I connect my website to Agent Analytics?
The tool currently supports connecting log sources through Cloudflare, with data typically flowing within minutes of setup.
Which AI bots does the tool track?
It tracks a variety of AI agents, specifically naming GPTBot, ClaudeBot, and PerplexityBot, and categorizes them by operator and purpose.
Can it track traffic from AI search engines?
Yes, it identifies human visitors referred to a site by AI products such as ChatGPT and Perplexity.
Added by AntSpace from public sources (surfer.ai).