deadlock Message Board
[ October Full List | Reply ]

Re: Robots.txt did not work
From Jaime on 26 Oct '00
replying to Re: Robots.txt did not work posted by Tim

>>I had another thought - sometimes it depends on where you locate your txt file. Have you done any research by searching the web? I found some pretty good sites with lots of info on it.... Let me know how you get on!!!
>Thanks Jaime, but that is not a problem either since it should be placed in the root directory which it is now.

How big is your txt file - maybe it is too big, or for too broad an 'audience'. You might need to tailor it for each specific search engine i.e. write a User-agent and Disallow section for each SE. Just a thought....!!!

Reply to this message

Required Details
Your name:

Optional Details
Home page title:
Home page URL:
(if you'd like to receive automatic replies by email)

Your Message