# robots.txt - crawler configuration file User-agent: * Disallow: /_private/ Disallow: /admin/ Disallow: /App_Data/ Disallow: /bat/ Disallow: /database/ Disallow: /webmail/ Disallow: /login.asp Sitemap: http://www.techrite.com.au/sitemap.xml