Best way to identify googlebot

Question

What is the most reliable, fastest way to identify the Googlebot crawler? rDNS can be spoofed, so the googlebot ip list looks to be the most reliable way. Are there any sites/resources, where the actual googlebot ips can be obtained? Any other ideas welcomed.

Answer 1

If you really want to have the IP hardcoded (I wouldn't recommend it, since it can change at any time and without notice), there's a list available here. What I would recommend (and, also, what is recommended on Goggle Webmaster's blog) is that you do a reverse DNS, and then a forward DNS to verify this. That should always work, and cannot be spoofed.

Answer 2

Google bot use following ranges -

• 203.208.60.0/24,
• 66.249.64.0/20,
• 2001:4860:4801:2:6b00:6006:1300:b075,
• 2001:4860:4801:5:1000:6006:1300:b075,
• 2001:4860:4801:6:e300:6006:1300:b075,
• 2001:4860:4801:2001::6006:1300:b075,
• 2001:4860:4801:2002::6006:1300:b075

More information here -

http://myip.ms/info/bots/Google_Bing_Yahoo_Facebook_etc_Bot_IP_Addresses.html