User-agent: * # robots.txt on plans & solutions.com directed to all spiders, Disallow: /cgi-bin Disallow: /logs