# PURPOSE: control spidering of ALL test data so # googlbot doesn't get confused and # index test data # for development allow NO access # comment out two lines below # when in PRODUCTION # User-agent: * # Disallow: / # for production Disallow nothing # Allow all robots complete access # comment out two lines below # when in DEVELOPMENT User-agent: * Disallow: # for both production and development # we don't want spiders driving up to the load User-agent: * Disallow: /reports/ User-agent: * Disallow: /html/reports.shtml