deadlock Message Board
[ June Full List | Reply ]

Re: cgi-bin
From peter laurie on 16 June '00
replying to Re: cgi-bin posted by David A

>>Hi
>>Our site runs entirely from scripts that live in a cgi-bin directory.
>>I understand that some spiders don't like to see 'cgi-bin' in a URL, so I've aliased this to 'bin'. Does anyone know if that would put them off?
>
>Spiders don't care about directory structure but they will not index arguements, '?' '&' etc.
>
>www.mysite.com/cgi-bin/somepage.htm OK
>www.mysite.com/cgi-bin/somepage.cgi?product=1&product2=5 NO
>www.mysite.com/cgi-bin/somepage.cgi I don't know.

Thanks. The way the scripts work, there aren't any '?' or '&', and now I've removed 'bin' altogether. We've had visists from scooter and slurp but they look at the home page and leave without indexing anything. Is that normal?





Reply to this message

Required Details
Your name:
Subject:

Optional Details
Home page title:
Home page URL:
Email:
(if you'd like to receive automatic replies by email)

Your Message