Posted By

ryarwood on 06/18/11


Tagged

server apache admin robots


Versions (?)

Simple Robots.txt Examples


 / Published in: Apache
 

  1. User-agent: *
  2. Disallow: /
  3. Disallow: /directory/
  4. Disallow: /directory/file.html

Report this snippet  

You need to login to post a comment.