# All robots will spider the domain User-agent: * Disallow: /images/ Disallow: /files/ Disallow: /amazon/ Disallow: /dont_put_anything_here/