Jim's Message Board
[ Reply To This Message ]

Re: Spiders unwilling to follow links
From Max on 04 May '98
adding to Spiders unwilling to follow links posted by Jonas Nordstrand

"Most of the engines just spider (and index) the page I'm submitting
not the pages which there are links to."

Many of the links I checked are this kind:
http://nordstrand.hypermart.net/webhoo/jump.cgi?ID=147

Robots have a known allergy to CGI links. Change each one
to a fixed URL and the problem will go away.


Replies from other people:


Reply to this message:

Who Are You?
Your name:
Email:
Home page title:
(optional)
Home page URL:
(optional)


Your Reply:
Subject:
Reply: