Re: cgi-binFrom peter laurie on 16 June '00
replying to Re: cgi-bin posted by David A
>>Hi
>>Our site runs entirely from scripts that live in a cgi-bin directory.
>>I understand that some spiders don't like to see 'cgi-bin' in a URL, so I've aliased this to 'bin'. Does anyone know if that would put them off?
>
>Spiders don't care about directory structure but they will not index arguements, '?' '&' etc.
>
>www.mysite.com/cgi-bin/somepage.htm OK
>www.mysite.com/cgi-bin/somepage.cgi?product=1&product2=5 NO
>www.mysite.com/cgi-bin/somepage.cgi I don't know.
Thanks. The way the scripts work, there aren't any '?' or '&', and now I've removed 'bin' altogether. We've had visists from scooter and slurp but they look at the home page and leave without indexing anything. Is that normal?