User-agent: * Disallow: /temp/ Disallow: /dev/ Disallow: /files/ Disallow: /stats/ Disallow: /logs/ Disallow: /testing/ Disallow: /clients/