User-agent: Slurp Disallow: /* # Allow only specific directories User-agent: ScoutJet Disallow: /*