# robots.txt User-agent: * Disallow: /private/ Disallow: /admintools/ Disallow: /cache/ Disallow: /rss/ Disallow: /test/ Disallow: /netpbm/ Disallow: /r/ Disallow: /netpbm/ Disallow: /scripts/ # go away User-agent: sitecheck.internetseer.com Disallow: /