# All robots will spider the domain User-agent: * Disallow: User-agent: * Disallow: /admin/ Disallow: /fast_training/ Disallow: /aspnet_client/ Disallow: /library/ Disallow: /uploads/