deadlock Message Board
[ February Full List | Reply ]

Re: Robots.txt
From Simon at UKSprite on 22 Feb '01
replying to Robots.txt posted by Martyn

You get loads of info for robots exclusion at:
http://info.webcrawler.com/mak/projects/robots/norobots.html

Simon.



>I have heard there is a way to stop robots indexing pages you dont want them to on your server by including in the folder a robots.txt file. Could anyone give my help on creating this file? Thanks




Reply to this message

Required Details
Your name:
Subject:

Optional Details
Home page title:
Home page URL:
Email:
(if you'd like to receive automatic replies by email)

Your Message