User-agent: *
#Disallow: /directory you don't want indexed