# All robots will spider the domain User-agent: * Disallow: # Disallow Scooter/1.0 User-agent: Scooter/1.0 Disallow: /