User-agent: Googlebot Disallow: /awstat/ Disallow: /chc/ Disallow: /crawling/ Disallow: /inc/ Disallow: /page.restrictor.log Disallow: /page.restrictor.php User-agent: * Disallow: /awstat/ Disallow: /chc/ Disallow: /crawling/ Disallow: /inc/ Disallow: /page.restrictor.log Disallow: /page.restrictor.php