deadlock Message Board
[ June Full List | Reply ]

Re: meta commands for robots
From Jeff on 14 June '01
replying to meta commands for robots posted by jwj

>As DRB suggested,
>The last line for Robots is an Important line to use."
>I do realize that the commands NOT to follow are important when they apply, but do you guys know whether there is any level of significance to the command to index and follow? Or might that be of no effect?

My guess is the command is useless, kinda like the revisit command.

Reply to this message

Required Details
Your name:

Optional Details
Home page title:
Home page URL:
(if you'd like to receive automatic replies by email)

Your Message