# /robots.txt file for http://blustein.net/ User-Agent: * Disallow: / User-Agent: W3C-checklink Disallow: User-Agent: Googlebot Disallow: /dtb/ Disallow: /nascrag/ Allow: /