Robotstxt
Robots... It allows a user to quickly and easily createthe robots... The program provides the user a way to log onto hisFTP or local network server and then select the documents and directories which are not to be made searchable... Free program`s updates and upgradesunrestricted in time; unlimited number of Web sites to work with
Tags: site optimization, log file analysis, robotstxt editor, spider instructions, search engine indexation, search engine optimization,