Jim's Message Board
[ Reply To This Message ]

Web Crawler, only 25 pages indexed ?
From Andrew Harris at Robert's Hot Tubs on 21 April '98
The following is a conversation i had with WC;

dear WebCrawler ;
With reguards to submiting web pages. any of our pages are cgi generated ('on the fly') and i understand that those are not indexed, however the pages are quite
accessable through their 'normal' url. Question, is it acseptable to submit these url's to WebCrawler ? I ask because your 'rules' say not to submit more than 25
pages (and theres a bit more than 25.)
thank you for your time

-- Hi Andrew,
Thank you for your interest in Webcrawler. We do not index cgi pages and even if you submit their URL, they're still cgi pages which we won't index. We only accept up to 25 pages so you have to make your desicion what you want indexed. If
you have any other questions please let me know.

Mike Gardner
Technical Support Engineer
555 Broadway
Redwood City, CA 94063
other than the fact that he didnt understand what i was saying about the "store" pages (the direct url is NOT a cgi generated page), is it REALLY true about the "only 25 pages" ? and what happens to any over and above the 25 ?

Replies from other people:

Reply to this message:

Who Are You?
Your name:
Home page title:
Home page URL:

Your Reply: