advanced code snippet search

Posted By

ryarwood on 06/18/11


Tagged

server apache admin robots


Versions (?)

Simple Robots.txt Examples

 / Published in: Apache
 
Expand | Embed | Plain Text 
  1. User-agent: *
  2. Disallow: /
  3. Disallow: /directory/
  4. Disallow: /directory/file.html

Report this snippet  

You need to login to post a comment.