Tom
19th Feb 2004, 07:50 am
As discussed at yesterday's seminar, Google advises webmasters (http://www.google.com/webmasters/guidelines.html) that in order to view their site as a spider will see it, they should view their handiwork in a text browser. I had the same disappointing experience as Francis in trying to install Lynx. Fortunately there is an online version and you can just enter your URL. It is, to say the least, revealing. See Delorie (http://www.delorie.com/web/lynxview.html).
On another point, Francis was right (and Tom wrong) about the frequency of full spidering by Google. Most people think it is much closer to once a month than once a week. I don't quite understand the relationship between Googlebot visits and full trawls. How charming that we are all beholden to the whims of spiders. Roll on The Age of Arachnophillia.
On another point, Francis was right (and Tom wrong) about the frequency of full spidering by Google. Most people think it is much closer to once a month than once a week. I don't quite understand the relationship between Googlebot visits and full trawls. How charming that we are all beholden to the whims of spiders. Roll on The Age of Arachnophillia.