Upload your nginx or Apache access log. See crawl budget, AI crawler activity, bot vs human traffic, 404 clusters, and anomalies — parsed in memory, never stored.
What this tool covers
Crawl Budget
Which pages Googlebot visits most, crawl frequency, and wasted crawls on low-value or parameterised URLs.
AI Crawlers
GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot, ChatGPT-User, and Bytespider activity and page visits.
Bot vs Human
Real user traffic separated from crawlers and scrapers, with top user agents and flagged aggressive bots.
404 Clusters
Most-hit broken URLs, which bots vs humans are triggering them, and redirect opportunities.
Anomalies
POST floods, repeated 403s, unusual traffic spikes by hour, and suspicious user agent patterns.