will robots follow LINK tag|
From Tom Evans on 12 July '00
Does anybody know if robots will follow an alternate url specified in the LINK tag in the HEAD section of a HTML document? I found information about this in the HTML 4.01 spec but have found no other information about it in the usual places (ie www.searchenginewatch.com, the major search engines, the Web Robots Pages, this site's message board). I went so far as to actually ask the search engines themselves, but the predominate response is that the infomation about how thier robots work is intellectual property! If anybody knows of any resources I have not listed that could help me please list them.