User-agent: * Disallow: /privatefolder Disallow: /privatefile.html User-agent: Googlebot/2.1 Disallow :/nogoogle.html Sitemap: http://www.path-to-xml.com