- Overview - AI traffic signals from training crawls and citations through answer fetches to referral sessions and conversions, then your top pages
- Crawls & fetches - training-crawler and answer-fetcher activity by platform, with recent answer fetches
- Referrals - referral sessions, conversion events and direct traffic, broken down by AI engine and landing page
- 404 Demand - missing pages AI systems keep requesting
What AI Traffic Tracks
AI Traffic answers two questions:- What are AI systems retrieving and citing? - Detects crawlers and answer fetchers such as GPTBot, ClaudeBot, and PerplexityBot, alongside citation evidence from Visibility.
- What visible human activity follows? - Tracks attributable referral sessions and conversions without treating them as the full measure of AI-driven demand.
Why AI Traffic Matters
AI Platforms Are a Growing Traffic Source
As more users rely on AI assistants to find information and products, the traffic they send to websites is becoming a meaningful channel. Understanding this traffic helps you:- Measure retrieval and visibility - See which content AI systems fetch and cite before looking at downstream activity
- Track AI bot crawling - Know which AI platforms are indexing your content, how frequently, and which pages they visit most
- Interpret the visible tail - Pair AI Traffic with Visibility while treating attributed referrals and conversions as an undercounted fraction
Beyond Traditional Analytics
Standard analytics tools like Google Analytics do not break down AI bot traffic or AI referral traffic in useful ways. AI Traffic is purpose-built to:- Distinguish AI bots from regular crawlers
- Identify referral traffic specifically from AI conversation platforms
- Detect AI-sourced visits via
utm_sourceparameters - Show trends and breakdowns by AI platform
Plan Requirements
AI Traffic is included on every paid plan. The monthly event allowance and how long raw events are retained scale by plan; see Working with Projects for the per-plan figures.What Gets Detected
Bot Crawlers
DevTune detects AI bot crawlers by their user-agent strings:AI Referral Traffic
DevTune detects visitors arriving from AI platforms by checking the referrer URL:UTM Source Detection
DevTune also checks theutm_source query parameter for AI platform identifiers (e.g., chatgpt, claude, perplexity, gemini, copilot). This catches traffic from AI platforms that include UTM parameters in their outbound links.
Traffic Classification
Every visit is classified into one of three types:- Bot - An AI crawler indexing your content
- Referral - A human visitor arriving from an AI platform
- Other - Regular traffic (not AI-sourced)
How It Works
- You add a JavaScript snippet to your website (a single
<script>tag) - On each page load, the snippet sends a lightweight beacon to DevTune
- DevTune classifies the visit by traffic type and AI platform
- Data is summarized into hourly and daily views
- Insights › AI Traffic displays trends, platform breakdowns, and top pages
navigator.sendBeacon() for minimal performance impact, and generates an anonymous session ID (stored in sessionStorage) to count unique sessions without tracking individual users.
Privacy
- The snippet does not use cookies
- Session IDs are anonymous and stored only in
sessionStorage(cleared when the tab closes) - The snippet collects no personally identifiable information
- All data is associated with your project, not with individual visitors
@devtune/ai-traffic 0.3.0 the edge middleware sensor sends the address a
matched crawler request arrived from, so DevTune can check the crawler against
the networks its operator publishes. Earlier versions send no address, and
their records are stored as unverified. Cloudflare pulls use the same check
when its analytics response includes an address. Every request is stored with a
verdict: verified, failed, or unknown when the check could not be made. Unknown
requests distinguish a sensor that supplied no address, an operator with no
published way to check its addresses, and a check that was temporarily
unavailable. Older unknown requests appear as before verification because
they predate this detail. Only the verdict and reason are kept. An address is
sent only for a request whose user agent
matches the AI bot registry, so ordinary browser traffic never carries one.
That match is on the user agent, and anyone can send a crawler’s user agent, so
a person whose client does that would have their address sent. That is the same
fact the check exists to handle, and it is why the address is used to reach a
verdict and then discarded rather than stored. Set trustedProxy: "none" in the
package to send no address at all, in which case that traffic is stored as
unverified.
Getting Started
- Choose Your Sensors - Work out which sensors you need
- Set Up Sensors - Connect the sensors that feed AI Traffic
- Read AI Traffic - Explore your demand data
Next Steps
- Which Sensors Do I Need - Compare what each sensor measures
- Setup Guide - Connect Cloudflare, edge middleware, GA4 or PostHog, and the tracking snippet
- Reading AI Traffic - Understand each view and what it counts
- Visibility - Track what AI platforms say about you and who they cite