Posted By

krisdb on 04/24/09


Tagged

c-sharp


Versions (?)

robots.txt


 / Published in: C#
 

  1. # /robots.txt file for http://www.DOMAIN.com/
  2. sitemap: http://DOMAIN.com/sitemap.xml
  3.  
  4.  
  5. User-agent: *
  6. Disallow: /scripts
  7. Disallow: /css
  8. Disallow: /stats
  9. Disallow: /sitecore
  10. Disallow: /xsl
  11. Disallow: /Flash
  12. Disallow: /bin
  13. Disallow: /Controls
  14. Disallow: /images
  15. Disallow: /WebConfigurationSettings

Report this snippet  

You need to login to post a comment.