advanced code snippet search

Posted By

krisdb on 04/24/09


Tagged

c-sharp


Versions (?)

robots.txt

 / Published in: C#
 
Expand | Embed | Plain Text 
  1. # /robots.txt file for http://www.DOMAIN.com/
  2. # mail [email protected]
  3. sitemap: http://DOMAIN.com/sitemap.xml
  4.  
  5.  
  6. User-agent: *
  7. Disallow: /scripts
  8. Disallow: /css
  9. Disallow: /stats
  10. Disallow: /sitecore
  11. Disallow: /xsl
  12. Disallow: /Flash
  13. Disallow: /bin
  14. Disallow: /Controls
  15. Disallow: /images
  16. Disallow: /WebConfigurationSettings

Report this snippet  

You need to login to post a comment.