# Disallow all crawlers access to certain pages. User-agent: * Disallow: /awstats/ Disallow: /error_docs/ Disallow: /webalizer/ Disallow: /ioncube/ Disallow: /livehelp/ Disallow: /videos/ Disallow: /id_translate/ Disallow: /shopping/ Disallow: /shop/