Google Forum

Double Your Adwords Profits in 7 minutes!


$7 Secrets
People are making thousands of dollars using the techniques and scripts included with this popular report. And it costs only $7! [Read more...]

AdWords Secrets
Free 5-day course that can help you make money using Google AdWords.

Articles for 25 Cents Each
Get 400 exact keyword optimized articles, delivered to your inbox, every month. A new and inexpensive way to build keyword rich web sites that can make money, month after month.

Trade Links with 5,000+ Sites
This is not an automated link system. The Add URL Directory is a directory that lists over 5,000 "add url" pages that have forms that you can use to add your site and exchange links. The directory is divided into categories, helping you find sites in your topic area.

Backlink Analyzer
Automatically analyze the anchor text of all of your backlinks. Analyze your competitors' backlinks to see how you compare in the anchor text department.

SEO Web Site Templates
Web site templates that have been designed specifically for search engine optimization (SEO).

My sponsered child, Hama from Niger, Africa
A portion of the proceeds from this site help sponsor Hama from Niger. Learn more about Child Sponsorship.

Google Toolbar tracks URLs for spidering?


Author Message
GoogleGuy Says

PostPosted: July 16, 2003 11:30 AM 

Importance: Medium

A member posted a message about this article, which depicts a webmaster's experience of a GoogleBot trying to access a mail sign-in page that did not exist on the site. The operator of the forums replied explaining that this was likely caused by someone using the Google Toolbar attempting to access the page, then the Toolbar captured the URL for futuring spidering. GoogleGuy replies that the Toolbar wouldn't cause this, implying that the Toolbar does not capture URLs for spidering purposes. The operator of the forums replies saying that it is common knowledge that the Toolbar does this, pointing to an old thread on this issue. The thread from over one year ago includes both an experimental proof that the Toolbar does this, as well as a denial by GoogleGuy. This could be an intersting thread...
GoogleGuy Says: [Link to quote]
No, the toolbar wouldn't cause this. Either someone submitted that url and we tried to crawl it, or possibly someone linked to that url. I'll ask someone to check it out to see if they can find out which it is. When you crawl 3B+ pages, you end up trying to crawl a few pages that don't exist because of bad links/submissions on the web. No need to delve into conspiracy theories (hacked Google, Google getting into spam email, etc.). :)

Subscribe to this discussion: Email

Join the conversation:

Remember personal info?

Check to Subscribe to this Comment:
(email field must be filled in)

Subscribe Without Commenting