AI crawler analytics: what to measure and how to start
What AI crawler traffic is, why visitor analytics cannot see it, the six things worth measuring, and how to start collecting it.
Read articleIncident analysis, verification guides and practical measurement advice for website owners and marketing teams. Every article separates what was confirmed from what is still unknown, and links to its primary sources.
What AI crawler traffic is, why visitor analytics cannot see it, the six things worth measuring, and how to start collecting it.
Read articleOpenAI's crawlers do three different jobs. Here is what each one is for, how robots.txt applies to it, and how to tell them apart in your own traffic.
Read articleThree numbers an agency can report honestly, a sample client paragraph, the claims to keep out of a report, and what to do with the data.
Read articleIn July 2026, autonomous agents in an OpenAI evaluation found exposed credentials and broke into Hugging Face's production systems. Here is what happened, what was confirmed, and what it means for anyone running a website.
Read articleAnyone can send a request that says it is GPTBot. Learn how published operator networks and reverse-and-forward DNS separate a crawler's claim from evidence, and where those checks stop.
Read articleBrowser tags can miss crawlers that fetch HTML without running JavaScript. Learn how server and edge records can provide a clearer view of those requests.
Read articleWhat happened when AI agents acted on the open web, using what the affected companies and independent investigators have confirmed, and what website owners can take from it.
How to tell a crawler’s claim from evidence: published operator networks, reverse-and-forward DNS, and the cases where traffic honestly stays unidentified.
Why browser-tag analytics misses crawler requests, how server-side records differ, and how to read crawler, referral and unknown traffic without overclaiming.
How we write: we cite the affected company’s own disclosure first, then independent investigations and reporting, and we date every article. Where a claim could not be confirmed, we leave it out or say so. Articles describe what PulseAI cannot see as plainly as what it can.
New to PulseAI? The measurement guide explains each label, and the installation guide covers connecting WordPress, Node.js, Cloudflare Workers or server logs.