Log vs Search Console Crawl Comparison (Paste-In)

Lines up daily Googlebot-claimed requests from your log with the daily crawl requests you copy from Search Console and shows the ratio.

Use the tool

Why this tool exists

Search Console counts the crawl requests Google made. Your log counts requests that claim to be Google. When the two differ a lot, something is off: fake bots, a CDN that hides requests from your server, or a time zone shift.

The Search Console API needs an account, so this tool does not call it. You copy the daily numbers from the Crawl Stats report yourself and paste them as date,count lines. Compare totals over several days, since a day boundary in a different time zone moves requests between days.

How to use it

  1. Open the Crawl Stats report in Search Console and copy the daily total crawl requests.
  2. Paste them in the second box as date,count lines.
  3. Paste your access log lines in the first box.
  4. Compare the ratio per day and in total.

Frequently asked questions

Why do the numbers not match?

Fake Googlebot requests, CDN or load balancer layers that are not in your log, and time zone differences are the usual causes.

Which time zone does Search Console use?

Not verified here. Check your report, and compare totals over several days to reduce the effect.

Does the tool call the Search Console API?

No. Nothing is fetched. You paste the numbers.

Can I trust the bot names in the result?

Only as claims. The tool reads the user-agent text, and anyone can send a fake one. For anything that matters, check the IP addresses against the operator's published ranges or with reverse DNS.