To exclude all robots from part of the server
User-agent: * Disallow: /cgi-bin/ Disallow: /temp/ Disallow: /private/ Disallow: /client/