Posted By

chrisaiv on 09/13/14


wordpress robotstxt

Versions (?)

Who likes this?

2 people have marked this snippet as a favorite


Wordpress: Robots.txt tricks

 / Published in: Apache

Sometimes you don't want robots snooping around certain files. Here's one example of a custom configuration.

  1. # Disallow indexing of WordPress scripts
  2. User-agent: *
  3. Disallow: /wp-admin/
  4. Disallow: /wp-includes/
  5. Disallow: /wp-content/plugins/
  6. Disallow: /wp-content/themes/
  7. Disallow: /feed/
  8. Disallow: */feed/

Report this snippet  

You need to login to post a comment.