Posted By

chrisaiv on 09/13/14


Tagged

wordpress robotstxt


Versions (?)

Who likes this?

2 people have marked this snippet as a favorite

snima
tryan326


Wordpress: Robots.txt tricks


 / Published in: Apache
 

Sometimes you don't want robots snooping around certain files. Here's one example of a custom configuration.

  1. # Disallow indexing of WordPress scripts
  2. User-agent: *
  3. Disallow: /wp-admin/
  4. Disallow: /wp-includes/
  5. Disallow: /wp-content/plugins/
  6. Disallow: /wp-content/themes/
  7. Disallow: /feed/
  8. Disallow: */feed/

Report this snippet  

You need to login to post a comment.