Reverse DNS Bot Verifier (Check host and Forward Lookup Results)
Judges the results of a reverse and forward DNS lookup for a claimed crawler.
Use the tool
Why this tool exists
The standard check for Googlebot is a reverse DNS lookup of the IP, a check that the hostname ends in googlebot.com or google.com, and a forward lookup that returns the same IP. Both steps are needed, since anyone can set a reverse record.
A web page cannot run DNS queries, so you run host in a terminal and paste the answers here. The tool prints the commands for IPs you give alone, then judges the results for Google, Apple, Common Crawl or Bing (the Bing suffix is from memory and marked so).
How to use it
- Choose the claimed crawler.
- Run host for the IP and the hostname.
- Paste lines as: IP hostname forward-IP.
- Read VERIFIED or NOT VERIFIED.
Frequently asked questions
Why two lookups?
A forged reverse record would not point back to the same IP in a forward lookup.
What domains are valid?
For Google, googlebot.com for common crawlers, google.com for special crawlers. Apple and Common Crawl have their own.
Can it run the lookups?
No, browsers cannot do DNS queries.
IPv6?
Not every crawler has IPv6 reverse records. Use the IP range checker then.