deadlock Message Board
[ November Full List | Reply ]

A problem with Inktomi spiders
From Nicholas on 25 Nov '99
I'm trying to get Inktomi Slurp to drill down through my /index.shtml
page, but I keeps shuttling back and forth between /index.shtml
and /robots.txt. This happens regardless of what IP Slurp arrives
from. The one obvious possiblity for this problem is that the
link on my index page is (semi)hidden by the link color choices:

<BODY link="fefefe" vlink="fefefe" alink="efefef">

On the other hand, this doesn't seem to bother Infoseek's Ultraseek
at all; the bot drills down happily to the next level.

Reply to this message

Required Details
Your name:

Optional Details
Home page title:
Home page URL:
(if you'd like to receive automatic replies by email)

Your Message