# NOTE: # Blank lines (NL) are record seperators # Can NOT have blank lines between User-agent: and Disallow lines # Paths MUST be absolute. # A number of robots require that the path in a Disallow directive should be absolute. # For example with the URL http://example.org/blah # the Disallow line should read Disallow: /blah # Stop SlySearch User-agent: SlySearch Disallow: / # Stop NetMechanic User-agent: NetMechanic Disallow: / # Stop Teleport Pro/1.29.1590 User-agent: Teleport Pro Disallow: / # Stop Muscat/1.7 from spidering anything User-agent: MuscatFerret Disallow: / # Stop sitecheck.internetseer.com User-Agent: sitecheck.internetseer.com Disallow: / User-agent: * # Stop spider from spidering specified directories Disallow: /analog/ Disallow: /css/ Disallow: /Customer_Comps/ Disallow: /eBusiness_javascript/ Disallow: /eBusiness_logos/ Disallow: /ebusiness_ssl/ Disallow: /graphics_general/ Disallow: /graphics_backgrounds/ Disallow: /graphics_general_animated/ Disallow: /graphics_help_files/ Disallow: /graphics_links/ Disallow: /graphics_nav_left/ Disallow: /graphics_nav_top/ Disallow: /graphics_test/ Disallow: /graphics_translator/ Disallow: /help/ Disallow: /imanager/ Disallow: /scripts/ Disallow: /Templates/