deadlock Message Board
[ March Full List | Post A Reply ]

Re: MSIECrawler. What's that?
From cisco on 14 Oct '01
replying to MSIECrawler. What's that? posted by Nicholas

>Had an odd visitor today. Does anyone know what an
>MSIECrawler is?
>
>"A visitor from 209.98.71.163 (209.98.71.163),
>arriving without a refering URL,
>visited hastingsresearch.com/linux/penguin.shtml
>at 7:44:42 PM on Friday, March 12, 1999.
>This visitor used Mozilla/4.0 (compatible; MSIE 4.01; MSIECrawler; Windows NT)."

I yeah I have the samething hapening to me if they are searching
for a file called robots.txt then they are search Bots scanning
your site

so it can be listed in places like google.com and yahoo and stuff
like that...




Your Reply

*Your name:
*Message subject:
Home page title:
Home page URL:
Email:
(if you'd like to receive automatic replies by email)