Google Forum

Double Your Adwords Profits in 7 minutes!


$7 Secrets
People are making thousands of dollars using the techniques and scripts included with this popular report. And it costs only $7! [Read more...]

AdWords Secrets
Free 5-day course that can help you make money using Google AdWords.

Articles for 25 Cents Each
Get 400 exact keyword optimized articles, delivered to your inbox, every month. A new and inexpensive way to build keyword rich web sites that can make money, month after month.

Trade Links with 5,000+ Sites
This is not an automated link system. The Add URL Directory is a directory that lists over 5,000 "add url" pages that have forms that you can use to add your site and exchange links. The directory is divided into categories, helping you find sites in your topic area.

Backlink Analyzer
Automatically analyze the anchor text of all of your backlinks. Analyze your competitors' backlinks to see how you compare in the anchor text department.

SEO Web Site Templates
Web site templates that have been designed specifically for search engine optimization (SEO).

My sponsered child, Hama from Niger, Africa
A portion of the proceeds from this site help sponsor Hama from Niger. Learn more about Child Sponsorship.

Google webmaster tips


Author Message
GoogleGuy Says

PostPosted: July 21, 2003 1:07 AM 

Importance: Medium

GoogleGuy offers 5 tips for getting indexed by Google.
GoogleGuy Says: [Link to quote]
Okay, I'm waiting for something to finish compiling, so I thought I'd write up a few webmaster tips. Most of these are on our help pages somewhere, but not many people know all of these tidbits. So here goes:

Tip #1: Use If-Modified-Since (IMS). IMS lets your webserver tell Googlebot whether a page has changed since the last time the page was fetched. If the page hasn't changed, we can re-use the content from the last time we fetched that page. That in turn lets the bot download more pages and save bandwidth. I highly recommend that you check to see if your server is configured to support If-Modified-Since. It's an easy win for static pages, and sometimes even pages with parameters can benefit from IMS.

Tip #2: You can use wildcards in robots.txt, and patterns can end in '$' to indicate the end of a name. So if you don't want Googlebot to fetch any PDF files, for example, you could say
Disallow: /*.pdf$
Don't forget that in the robots.txt file, all url patterns need a "/" anchor to be valid. That's a pretty common webmaster error (maybe the most common robots.txt mistake), so keep it in mind and save yourself some angst. :)

Tip #3: Googlebot also permits an "Allow" directive in robots.txt. This lets you specifically flag areas that are okay to crawl. When there are two directives that could apply, we follow the longest (i.e. most specific directive). See http://www.google.com/webmasters/faq.html#robots for an example.

Tip #4: Avoid session ID's. If you can, use fewer dynamic parameters and stay away from the parameter "id=" in urls--Googlebot tries to stay away from things that might be session ID's.

Tip #5: Make sure that you can reach every page on your site with a text browser like lynx. That's the best way to make sure that a spider can follow links to all of your pages. Site maps can be a really good way to help users and spiders get down into different parts of your site.

Some of these tips work mainly with Googlebot, but I hope that they help. Anybody else with nuts and bolts tips for site architecture, crawling, or robots.txt--throw 'em in! :)


Posts: 1

Reply: 1

PostPosted: September 10, 2003 5:25 AM 

Google seems to have indexed every apge of this site even though multiple id's for same page


Mark Carey

Posts: no

Reply: 2

PostPosted: September 10, 2003 11:47 AM 

I assume you mean the URL that your name is linked to above, http://vos.ucsb.edu/browse.asp?id=3.

Interesting. While it is said that Google does not like the "id" parameter, many speculate that high PR sites are an exception to the rule. In this case, the home page has a PR of 7 - perhaps this is the reason that so many '?id=' pages were indexed.

J. Touboul

Posts: 3

Reply: 3

PostPosted: October 24, 2003 11:50 AM 

I am launching a site with /category.cfm/38
or /moreinfo.cfm?Product_ID=48&CFID=351013&CFTOKEN=42994567
type of extension and I was wondering if this may present a problem for indexing with Google.



Mark Carey

Posts: 34

Reply: 4

PostPosted: October 24, 2003 12:07 PM 

JT, the second URL pattern (moreinfo.cfm?) has three URL parameters. If you can, try to reduce this to two. In my experience, pages with three paramters are very rarely indexed by Google. Better yet use URL rewriting to make the URL appear static like moreinfo.cfm/48/351013/42994567/.


Posts: 1

Reply: 5

PostPosted: October 24, 2003 12:47 PM 

what about FRAMES

how does Google evaluate framed sites

Mark Carey

Posts: 34

Reply: 6

PostPosted: October 24, 2003 1:05 PM 

Avoid using frames. While Google can spider and index frames correctly, I have seen too may examples of framed sites that only get the home page indexed. Personally, I wouldn't risk using frames on a site.

J. Touboul

Posts: 3

Reply: 7

PostPosted: October 24, 2003 2:23 PM 

Thanks for the input.

I use frames on my site and the problem that I've encounter is exactly what Mark mention above. However, I use the tags and listed my links and other site description that would ne appear otherwise under my frame and it appears to be working.

This being said, I (or when) I redo the site I may not choose the frame route.


j. touboul

Posts: 3

Reply: 8

PostPosted: October 24, 2003 8:17 PM 

My previous message seemed to have come up incomplete. I meant to write that I use the noframes tag to include links and text in a frame environment and that seems to work.



Posts: 3

Reply: 9

PostPosted: October 26, 2003 11:36 AM 

what is the effect of a listing in Business.com
how much increase in Pr

would it be better to request for my listing to be included on Pr 6 page or better to be specific to my country which carries a Pr of 2 assuming the number of links are the same on both classifitions


Posts: 3

Reply: 10

PostPosted: October 28, 2003 1:07 PM 


why is http://www.readycompanies.com
PR dancing between 4/10 and 5/10 the last three days ( 28 October 2003)

it was 5/10 since the last 2 months

can anyone pls explain

Mark Carey

Posts: 34

Reply: 11

PostPosted: October 28, 2003 1:58 PM 

Google is conducting a "PR Update" currently. This may mean that some Google data centers have the old PR and some have the new PR. In other words, the PR of this site is now PR4 (4/10).


Posts: 3

Reply: 12

PostPosted: October 28, 2003 2:41 PM 

hi Mark

i just checked and it was 5/10
it has really been dancing the last 3 days

between 4/10 and 5/10
BUT it was 5/10 before

Mark Carey

Posts: 34

Reply: 13

PostPosted: October 28, 2003 3:14 PM 

Please see my previous message above.

The reason you just saw a PR5 was because your toolbar was getting that information from one of the data centers with the old PR data. If you want to always see the new PR data, add this line to your hosts file: toolbarqueries.google.com

then restart or do a ipconfig /flushdns from the command prompt. This will point your toolbar to the www-va data center. My toolbar is setup this way and I am seeing a PR4 for the home page of that site. In a few days, you will always see a PR4 with your toolbar...


Posts: 1

Reply: 14

PostPosted: March 3, 2004 6:21 AM 

Hi Everybody ...Im so fed up! I had my site in the top 10 for sooo long - now when I search for my site all I get is all the old pages and I dont get one person in my logs for a search term - why wont google add all my new pages??? i havejust uploaded all my new site and still im not seeing my site listed even in the top 1000- :-(

Subscribe to this discussion: Email

Join the conversation:

Remember personal info?

Check to Subscribe to this Comment:
(email field must be filled in)

Subscribe Without Commenting