Jim's Message Board
[ Reply To This Message ]

Re: Maximum # indexes with Altavista.
From INACHU at INACHU on 07 October '98 at 13:53
adding to Maximum # indexes with Altavista. posted by Peter on 14 October '97 at 17:23

Seems that from your message states
is that part of your domain is already indexed

The only way part of it was index when in fact
all of it should have been is this.

ROBOTS.TXT put this in the root
and CHMOD it so webspiders can read it.
and in the robots.txt file

you can tell the spiders which ones it can index

Take a look at robots.txt file at
www.cnn.com
I dont think there is a copyright on robot.txt
files so I copied it also here:
www.erols.com/inachu/robot.txt

Go check out roverbot.com!

>
>Hi,

>If you have a domain www.hardcore.com, say.
>AV will index max. 200 of your pages, right?

>But... what if www.hardcore.com happens to point to a subdirectory of another site that already has 200 pages indexed with AV?

>Are you screwed in this case? Does the 200 correspond only to your domain, or is the place its sitting important?


Replies from other people:


Reply to this message:

Who Are You?
Your name:
Email:
Home page title:
(optional)
Home page URL:
(optional)


Your Reply:
Subject:
Reply: