User-agent: * #all robots
Disallow:/cgi-bin
Disallow:/asdf