Web Server Access Log Analyzer: Status Codes, Top URLs, Bots
Turn a slice of your access log into an SEO and crawl-budget report without uploading it.
Use the tool
Why this tool exists
The analyzer parses the combined log format (IP, time, request, status, bytes, referrer, user agent) and reports the status-class split, the most requested URLs without query strings, top 404s, how many requests carry parameters, and a table of identified crawlers (Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot, Applebot, Yandex, Baidu, Ahrefs, Semrush and others) with their 2xx, 3xx and error counts, plus a Googlebot summary.
User-agent strings can be forged; verify a crawler by reverse DNS before acting on it. Only the combined format is understood, and very large logs should be sampled first.
No data is sent anywhere: the work happens in your browser, so you can use it offline once the page has loaded.
How to use it
- Copy a few thousand lines from access.log and paste them.
- Set the number of rows per table.
- Read the status, URL and crawler sections.
- Fix 404s that crawlers hit and redirect chains they follow.
Frequently asked questions
Which log format does it need?
Apache or nginx "combined", which includes the referrer and user agent.
Can it prove a visit was Googlebot?
No. Verify with a reverse DNS lookup and forward confirmation, or Google's published IP ranges.
Is the log uploaded?
No.
Is my data sent anywhere?
No. Everything is processed in your browser, and the page makes no network requests with your input.