# Robot-Manager was used to generate this file. # Copyright (c) 2001-2002 by Sophtware.com, Inc. All Rights Reserved. # http://www.websitemanagementtools.com/ # PARTIAL access (FAST/AllTheWeb) User-agent: FAST-WebCrawler Disallow: /beacons/ Disallow: /metrics/ Disallow: /stats/ Disallow: /tracking/ # PARTIAL access (Google) User-agent: Googlebot Disallow: /metrics/ Disallow: /stats/ Disallow: /tracking/ Disallow: /web/ # PARTIAL access (Henry Mirago) User-agent: HenryTheMiragoRobot Disallow: /beacons/ Disallow: /metrics/ Disallow: /tracking/ Disallow: /web/ # PARTIAL access (Inktomi) User-agent: Slurp Disallow: /beacons/ Disallow: /metrics/ Disallow: /stats/ Disallow: /web/ # PARTIAL access (MSN) User-agent: msnbot Disallow: /beacons/ Disallow: /metrics/ Disallow: /stats/ Disallow: /tracking/ # PARTIAL access (Teoma) User-agent: teomaagent Disallow: /beacons/ Disallow: /stats/ Disallow: /tracking/ Disallow: /web/ # PARTIAL access (Yahoo Search) User-agent: Slurp Disallow: /beacons/ Disallow: /metrics/ Disallow: /stats/ Disallow: /web/ # FULL access (All Spiders) User-agent: * Disallow: