# Robots.txt file created by http://www.webtoolcentral.com # All robots will spider the domain User-agent: * Disallow: # Disallow directories User-agent: * Disallow: /db/ Disallow: /App_Data/ Disallow: /bin/ Disallow: /power-stats/ Disallow: /cms/ Disallow: /fckeditor/ Disallow: /My Project/ Disallow: /obj/ Disallow: /pages_classic_asp/ Disallow: /web_services/ Disallow: /resources/ Disallow: /usercontrols/ Disallow: /_internal/ Disallow: /pages/_error_default.aspx Disallow: /pages/_BriefItemProductDetail.aspx Disallow: /pages/_ExportOrder.aspx Disallow: /pages/_OrderDetail.aspx Disallow: /pages/_OrderTemplate.aspx Disallow: /pages/_SessionKeeper.aspx Crawl-delay: 10 Request-rate: 1/10 Visit-time: 1100-1900 #GMT, equal to 23:00-07:00 NZ time