deadlock Message Board
[ February Full List | Reply ]

Wish I knew
From Nicholas on 4 Feb '00
replying to Which Top SE's may we submit several URL's posted by Anne Dixon

>I haven't been "keeping up" with all the changes in
>listing rules for the Top SE's. For instance, which


All I've been watching recently are and
Inktomi. Alltheweb seems to operate as claimed,
drilling everywhere from my main index pages. Their
bot pops in and grabs 5-10 at a time. Inktomi is
driving me nuts, keeps getting stuck at my robots.txt
files. Except for, which happily drills
down. Since AOL is listing the pages well -- I think
they're powered by Inktomi this week? -- perhaps
they're getting their lists from the .jp bot.

Reply to this message

Required Details
Your name:

Optional Details
Home page title:
Home page URL:
(if you'd like to receive automatic replies by email)

Your Message