|
|
dafb337ed1
|
block SemrushBot which is spamming our logs
|
2019-03-06 13:46:52 +01:00 |
|
|
|
79672321a0
|
add robots.txt files for fsfe.org and test.fsfe.org
|
2018-12-10 14:25:20 +01:00 |
|
cri
|
05265802df
|
robots.txt is now generated by build(-test).sh with different content
svn path=/trunk/; revision=21093
|
2011-09-23 14:22:03 +00:00 |
|
samtuke
|
fe8579f068
|
attempting to kick start build script
svn path=/branches/design/; revision=18343
|
2010-11-17 13:33:27 +00:00 |
|
samtuke
|
7c90dbf964
|
attempting to kick start build script
svn path=/branches/design/; revision=18341
|
2010-11-17 13:02:44 +00:00 |
|
samtuke
|
0dd8651691
|
trying to ensure build process is started by renaming file
svn path=/branches/design/; revision=18258
|
2010-11-12 16:04:11 +00:00 |
|
samtuke
|
9a224f199a
|
still trying to kickstart build process...
svn path=/branches/design/; revision=18256
|
2010-11-12 15:52:14 +00:00 |
|
ato
|
3a7a0bff1d
|
Denying search engines access to the /sources directory (which is
generated by the build script, and which is not present in the
repository.)
svn path=/trunk/; revision=14951
|
2010-02-15 14:17:23 +00:00 |
|
ato
|
424e798dcf
|
We should allow search engines and crawlers.
svn path=/trunk/; revision=14886
|
2010-02-13 13:27:16 +00:00 |
|
cri
|
bd299d74ef
|
Do not allow web spiders to crawl the test branch
svn path=/branches/test/; revision=14013
|
2010-01-11 13:24:27 +00:00 |
|
|
|
15241ac7e3
|
Another fake commmit, this time from me :)
svn path=/trunk/; revision=7745
|
2007-02-15 22:54:48 +00:00 |
|
|
|
8f16a371bb
|
Last test commit. :-)
svn path=/trunk/; revision=7729
|
2007-02-14 14:34:47 +00:00 |
|
|
|
f712066aa0
|
Test commit.
svn path=/trunk/; revision=7728
|
2007-02-14 14:20:25 +00:00 |
|
|
|
8f85f704cb
|
Test commit.
svn path=/trunk/; revision=7727
|
2007-02-14 14:16:06 +00:00 |
|
|
|
6fab036a1e
|
Exclude source tree for robots.
svn path=/trunk/; revision=4662
|
2004-11-06 17:37:59 +00:00 |
|
