AI Crawler Log Analyzer

Paste lines from your server or CDN access log and see every AI crawler that visited, how often, and the URLs each one fetched most. Everything runs in your browser; nothing is uploaded.

  • Instant·Runs in your browser
  • No signup
  • Free

Access log

Apache, Nginx, Cloudflare or Vercel lines. Nothing leaves your browser.

0 lines pasted

Paste log lines to begin

You'll see every AI crawler that visited, its share of requests, and the pages it fetched most.

Next step

Tools that pair with this one

All tools

How to use it

  1. 1Export or copy recent lines from your access log (Apache, Nginx, Cloudflare, Vercel all work).
  2. 2Paste them into the box — the analyzer only needs the user agent and the request path.
  3. 3Read the per-bot breakdown: hits, share, and the pages each bot fetched most.
  4. 4Watch the user-triggered bots: each hit is a live conversation that needed your page.

Frequently asked

Which log formats does it read?

Any line that contains a request path and a user agent string: Apache combined, Nginx default, Cloudflare Logpush lines and most CDN exports. It matches bots by their user-agent tokens, so column order doesn’t matter.

Is my log data uploaded anywhere?

No. Parsing happens in your browser tab and nothing leaves it. Reload the page and it’s gone.

Can a user agent be faked?

Yes, easily. Treat this as a first pass. To verify a hit, check the source IP against the vendor’s published ranges (openai.com/gptbot.json, claude.com/crawling/bots.json, perplexity.com/perplexitybot.json).

Want this on autopilot?

Enter your site to see how often ChatGPT, Perplexity, Gemini, and Google cite your brand, and exactly what to publish next.

No credit card required · Free 7-day trial