---

[ April Full List | Reply ]

---

It all depends... From Edgar on 26 April '99 replying to what's the best value for the robots meta tag? posted by John >what's the best value for the robots meta tag? >All >Index >NoIndex >NoFollow > >or no robots meta tag? It all depends on what you want the spider to do upon viewing your page. Keep in mind that not all spiders look for the robots metatag. If it is important to you to limit where spiders go on your site you might wish to consider investigating "robots.txt" files.

Reply to this message
Required Details
Your name:
Subject:

Optional Details
Home page title:
Home page URL:
Email: (if you'd like to receive automatic replies by email)
Your Message
>>what's the best value for the robots meta tag? >>All >>Index >>NoIndex >>NoFollow >> >>or no robots meta tag? > >It all depends on what you want the spider to do upon viewing your >page. Keep in mind that not all spiders look for the robots metatag. If it is important to you to limit where spiders go on your site you might wish to consider investigating "robots.txt" files.