This website requires JavaScript.
Explore
Help
Sign In
FSFE
/
fsfe-website
Watch
26
Star
31
Fork
91
You've already forked fsfe-website
Code
Issues
65
Pull Requests
18
Wiki
Activity
master
fsfe-website
/
fsfe.org
/
robots.txt
6 lines
69 B
Plaintext
Raw
Permalink
Normal View
History
Unescape
Escape
add robots.txt files for fsfe.org and test.fsfe.org
2018-12-10 13:25:20 +00:00
User-agent: *
Disallow: /source/
block SemrushBot which is spamming our logs
2019-03-06 12:46:52 +00:00
User-agent: SemrushBot
Disallow: /
Reference in New Issue
Copy Permalink