# MUST be in root dir of server name .com/robots.txt # noindex, noarchive, nofollow # googlebot follows HREF and SRC links # # This file lists local URLs that well-behaved robots should ignore User-agent: Googlebot Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.pdf$ User-agent: * Disallow: /folks/ Disallow: /gallery/ Disallow: /gallery2/ Disallow: /i/ Disallow: /ipsum/ Disallow: /lorem/ Disallow: /SIAST/ Disallow: /sklof/ Disallow: /sparsity/ Disallow: /witimagery/Contact/ Disallow: /www2/