Google Forum

Double Your Adwords Profits in 7 minutes!


$7 Secrets
People are making thousands of dollars using the techniques and scripts included with this popular report. And it costs only $7! [Read more...]

AdWords Secrets
Free 5-day course that can help you make money using Google AdWords.

Articles for 25 Cents Each
Get 400 exact keyword optimized articles, delivered to your inbox, every month. A new and inexpensive way to build keyword rich web sites that can make money, month after month.

Trade Links with 5,000+ Sites
This is not an automated link system. The Add URL Directory is a directory that lists over 5,000 "add url" pages that have forms that you can use to add your site and exchange links. The directory is divided into categories, helping you find sites in your topic area.

Backlink Analyzer
Automatically analyze the anchor text of all of your backlinks. Analyze your competitors' backlinks to see how you compare in the anchor text department.

SEO Web Site Templates
Web site templates that have been designed specifically for search engine optimization (SEO).

My sponsered child, Hama from Niger, Africa
A portion of the proceeds from this site help sponsor Hama from Niger. Learn more about Child Sponsorship.

AdSense crawl results in removal from index?


Author Message
GoogleGuy Says

PostPosted: June 20, 2003 11:35 AM 

Importance: Medium

A moderator of one of the forums posted a recent experience with the new "Mediapartners" bot that crawls content in order to serve targeted AdSense ads. After sending the spider through a few loops, the site's home page stopped appearing in the main search index. Coincidence? GG replies by reiterating that the two bots aren't friends and don't exchange data, and that he will ask around about the matter.
GoogleGuy Says: [Link to quote]
Urg. I wish every third message didn't mention conspiracy theories around here lately. ;) Lisa, we gave the bots different names so that you could use robots.txt on one but not the other. The AdSense bots and Googlebot have never met, and don't exchange information, so they're completely independent. I'll ask around about this, but to show content ads we normally have to have or fetch the content of the page.

If you've got 30M pages, none of which Google is allowed to visit, then AdSense might not be the best match for your sites for now. You might want to remove the AdSense JavaScript for the time being while we communicate about this.


Posts: no

Reply: 1

PostPosted: June 22, 2003 3:32 AM 

Interesting, I wonder how this affects the results of cross-linked informative sites.

Subscribe to this discussion: Email

Join the conversation:

Remember personal info?

Check to Subscribe to this Comment:
(email field must be filled in)

Subscribe Without Commenting