[
February Full List
|
Reply
]
Re: Robots.txt
From
Inachu
on 23 Feb '01
replying to
Robots.txt
posted by Martyn
A real robots.txt in use is at:
http://www.cnn.com/robots.txt
Inachu
>I have heard there is a way to stop robots indexing pages you dont want them to on your server by including in the folder a robots.txt file. Could anyone give my help on creating this file? Thanks
Reply to this message
Required Details
Your name:
Subject:
Optional Details
Home page title:
Home page URL:
Email:
(if you'd like to receive automatic replies by email)
Your Message
>A real robots.txt in use is at: > > >http://www.cnn.com/robots.txt > > > > > >Inachu > >>I have heard there is a way to stop robots indexing pages you dont want them to on your server by including in the folder a robots.txt file. Could anyone give my help on creating this file? Thanks