---

[ February Full List | Reply ]

---

Re: Robots.txt From Simon at UKSprite on 22 Feb '01 replying to Robots.txt posted by Martyn You get loads of info for robots exclusion at: http://info.webcrawler.com/mak/projects/robots/norobots.html Simon. >I have heard there is a way to stop robots indexing pages you dont want them to on your server by including in the folder a robots.txt file. Could anyone give my help on creating this file? Thanks

Reply to this message
Required Details
Your name:
Subject:

Optional Details
Home page title:
Home page URL:
Email:	(if you'd like to receive automatic replies by email)
Your Message
>You get loads of info for robots exclusion at: >http://info.webcrawler.com/mak/projects/robots/norobots.html > >Simon. > > > >>I have heard there is a way to stop robots indexing pages you dont want them to on your server by including in the folder a robots.txt file. Could anyone give my help on creating this file? Thanks