User-agent: * Disallow: /*.axd$ Disallow: /activate/ Disallow: /admin/ Disallow: /bin/ Disallow: /cardholder/ Disallow: /Controls/ Disallow: /csr/ Disallow: /editor/ Disallow: /errorpage/ Disallow: /facebook/ Disallow: /fckeditor/ Disallow: /images/ Disallow: /live/ Disallow: /MasterPages/ Disallow: /moneypak/ Disallow: /reports/ Disallow: /scripts/ Disallow: /styles/ Disallow: /webservice/ Crawl-delay: 5 #delay in seconds for robots between pages downloads (used not to load sites too much)