User-agent: * Disallow: /Internal Disallow: /pub_db/ Disallow: /cgi-bin/