Google Forum

Double Your Adwords Profits in 7 minutes!


$7 Secrets
People are making thousands of dollars using the techniques and scripts included with this popular report. And it costs only $7! [Read more...]

AdWords Secrets
Free 5-day course that can help you make money using Google AdWords.

Articles for 25 Cents Each
Get 400 exact keyword optimized articles, delivered to your inbox, every month. A new and inexpensive way to build keyword rich web sites that can make money, month after month.

Trade Links with 5,000+ Sites
This is not an automated link system. The Add URL Directory is a directory that lists over 5,000 "add url" pages that have forms that you can use to add your site and exchange links. The directory is divided into categories, helping you find sites in your topic area.

Backlink Analyzer
Automatically analyze the anchor text of all of your backlinks. Analyze your competitors' backlinks to see how you compare in the anchor text department.

SEO Web Site Templates
Web site templates that have been designed specifically for search engine optimization (SEO).

My sponsered child, Hama from Niger, Africa
A portion of the proceeds from this site help sponsor Hama from Niger. Learn more about Child Sponsorship.

Googlebot User-Agent Change


Author Message
GoogleGuy Says

PostPosted: March 5, 2004 4:05 AM 

Importance: Medium

GG explains a new user agent seen by members.

GoogleGuy Says: [Link to quote]

"Any statement, Googleguy? Would be appreciated."

Absolutely, bull. Normally I post by the seat of my pants, but I wrote this up earlier today and hadn't posted it yet:

Hey everybody, I wanted to give you a heads-up about a potential change in our user-agent name. Currently we use the user-agent

Googlebot/2.1 (+http://www.googlebot.com/bot.html)

but we're considering changing our user-agent to something like

Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

The primary reason for this is that some web servers assume that unless a user agent is IE, Netscape/Mozilla, or maybe Opera, that your browser won't support JavaScript, frames, etc. As Googlebot gets better over time, it gets closer to a regular user and browser in our ability to handle features like that. This user-agent change would let vanilla webservers assume Googlebot is more like a regular user, while still allowing site owners to recognize that Google is visiting and still providing clear contact info in case of questions or issues. We would still respect "Googlebot" in robots.txt, so the overwhelming majority of webmasters wouldn't have to change anything at all; most site owners probably wouldn't even notice the difference. This bot that a few people noticed was a test crawl with the new user agent. It looks like things went very smoothly, but we'll still be conservative when making this change. If people have any positive or negative comments or questions, just post here. If we don't hear any showstopping objections, we'll look at making this name change on the user-agent when we're convinced everything would be a smooth transition.



Posts: 1

Reply: 1

PostPosted: March 9, 2004 10:36 AM 

Hi there GoogleGuy

Just a quick question: When will Google update its PageRank database? We have new clients that put up brand new sites around the middle to the end of January and all those sites still don't any PR, as the PR bar is still all white.

Just to make certain it wasn't us, we checked many other sites that also went online at about the same time, and were optimized by other reputable SEO's too and they are 'white-out' too...

Any news on this?

Thanks GG



Posts: 1

Reply: 2

PostPosted: August 17, 2004 9:46 AM 

Hi GoogleGuy,

Sorry for my late reaction, but I was still joining my holidays!
I do noticed a change concerning the user-agent, but I also mentioned that Googlebot is crawling JavaScripts too.
I wonder if you could provide us with any clarify about that?

Already big thanks,

Subscribe to this discussion: Email

Join the conversation:

Remember personal info?

Check to Subscribe to this Comment:
(email field must be filled in)

Subscribe Without Commenting