deadlock Message Board
[ April Full List | Reply ]

Re: paying inktomi vs. letting it crawl
From David A on 5 April '01
replying to paying "inktomi" vs. letting it crawl posted by Ranthvs

>This Inktomi thing, what's that about? Apparently it's an index that gets you onto 4Anything, About, AOL, Canada.com, GoTo, HotBot, iWon, Looksmart, MSN, and NBCi for a yearly fee of about $30.
>
>Thing is, according to my access logs, the inktomi robot is looking at my site nearly every day. I never paid them anything. Do you think they'll find and index sites on their own regardless of who pays and submits?
>
>To be accurate, I should say that the site I'm referring to is a me.buddy-o-mine.com type of piggyback site and I have yet to ask my buddy if HE subscribed to the inktomi service.
>
>Any alternate theories here?

A little additional Inktomi info. Inktomi has said that sites which are crawled after being submitted through the "Free Submit" option (like submitting to Hotbot) are penalized. Sites which are crawled with their "Paid Crawler" or found with their "Roaming Crawler" are not penalized. They said they have been doing this for awhile.




Reply to this message

Required Details
Your name:
Subject:

Optional Details
Home page title:
Home page URL:
Email:
(if you'd like to receive automatic replies by email)

Your Message