From sammyh on 15 August '00
Somebody here must be able to help me - you all seem like very clever people (the old addage of flattery will get you everywhere!)
What is the simplest and most effective way to stop a site being spidered? I only want my top level page indexed - as the rest of the site is frames based & I don't want everybody diving into random pages....
OR, is there an HTML tag that I could put on my pages to prevent this - ie. re-directing to the "start" framespage if people come into a random page in the site (which should be viewed in frames)?