Advanced Search

Return to Snippet

Revision: 12864
at March 30, 2009 22:13 by hotdiggity
Initial Code 
# robots.txt for http://www.apimagazine.com.au/
User-agent: *
Disallow: /as
Disallow: /ca
Disallow: /cg
Disallow: /do
Disallow: /la
Disallow: /ma
Disallow: /op
Disallow: /st
Disallow: /te
Initial URL 









Initial Description





Hides directories from robots without revealing the names of the directories. Robot ignores directory names starting with first two characters.









Initial Title





Robots.txt to hide directory without revealing directory's name









Initial Tags














Initial Language





HTML