AI Bot Access Log Analyzer (Hits per Crawler, Path and Status)
Counts requests from known AI crawlers in a combined-format log and shows their top paths and status codes.
Use the tool
Why this tool exists
To decide whether to block an AI crawler, look at what it actually does on your site: how often it visits, what it fetches and whether you serve it.
Paste a log sample and see hits per crawler, distinct IPs, status codes and top paths. The log stays in your browser; remove IP addresses first if you prefer, since the tool only needs the request and user-agent. Matching is by user-agent text, which can be forged.
How to use it
- Paste log lines in combined format.
- Read the per-crawler table.
- Check the top paths for each bot.
- Decide what to allow or block.
Frequently asked questions
Which log formats work?
Combined format with referrer and user agent, common on Apache and Nginx.
Is my log uploaded?
No.
Why do some bots show 403?
Your server or firewall blocked them.
Can a bot fake its name?
Yes. Verify important ones with their published IP ranges.