search
What are the different google bots?
Filed in archive Using Search Engines by noel on July 21, 2006
What are the different google bots?
Search Engines use a script called 'BOTS' or 'robots' that crawls the net for content or for some specific purpose.

Here's a list of Google bots for your reference.

Adsense: "Mediapartners-google/2.1"
Adwords: "googleBot/2.1"
google-: "Mozilla/5.0 (compatible; googlebot/2.1; http://www.google.com/bot.html)"
Image--: "googlebot-Image/1.0"

Sometimes I use this to do a count of how many adsense bots came today, or how many google search bots visited.

In unix, I have a logfile called access_log and I do queries such as

#cat access_log | grep 21/Jul | grep googlebot

This will list all instances where googlebot spider visited my site on 21 Jul. Or if I only need the count, I could just add "wc -l" so it will look like

#cat access_log | grep 21/Jul | grep googlebot | wc -l

Another useful one is to look at all visits that came from google search

# cat access_log | grep 21/Jul | grep google | grep search

With that, I can see what search terms people use to reach my site. Of course you can access some of these data easily from awstats or webstat.

Permalink: What are the different google bots?
Tags: google+bots  google+spiders  google  search  bots  different+google  search+engine 
Trackback: http://publish.creative-weblogging.com/publish/mt-tb.pl/29895
img Addthis img Ask img Blinklist img del.icio.us img Digg img Fark img Facebook img Google img Lycos img Ma.gnolia Add this page to Mister Wong Mr Wong img Netscape img Netvousz img Newsvine img Reddit img StumbleUpon img Slashdot img Tailrank img Technorati img Wink img Yahoo

Vote for What are the different google bots?:

  • Currently 4.13/10
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
Rating: 4.13 out of 8 vote(s) cast.
 
Subscribe
Share It
RSSrss
See all blog subscribe options
Google google
What is RSS?
Yahoo! yahoo
Addthis Subscribe using any feed reader!
Bloglines Bloglines
Newsletter

TwitterFollow us on Twitter!