---

[ April Full List | Reply ]

---

Re: 'Expires' Meta tag From Peter McKeown at Solution-i.net on 24 May '01 replying to 'Expires' Meta tag posted by Elizabeth >Will using the 'Expires' Meta tag prohibit any of the search engines from indexing the page? - Do not beleive it will - most search engines use robots that will check for a file called robots.txt in the "root" directory of your site - a sample attached below. You can use this file to even allow different search engines to index different areas of your site User-agent: * Disallow: /cgi-local/ Disallow: /cgi-bin/ Disallow: /design/ Disallow: /images/ Disallow: /mp3/ Disallow: /styles/ Disallow: /sounds/

Reply to this message
Required Details
Your name:
Subject:

Optional Details
Home page title:
Home page URL:
Email:	(if you'd like to receive automatic replies by email)
Your Message
>>Will using the 'Expires' Meta tag prohibit any of the search engines from indexing the page? > >- Do not beleive it will - most search engines use robots that will check for a file called robots.txt in the "root" directory of your site - a sample attached below. You can use this file to even allow different search engines to index different areas of your site > >User-agent: * >Disallow: /cgi-local/ >Disallow: /cgi-bin/ >Disallow: /design/ >Disallow: /images/ >Disallow: /mp3/ >Disallow: /styles/ >Disallow: /sounds/