Commit Graph

15 Commits

Author SHA1 Message Date
Max Mehl dafb337ed1
block SemrushBot which is spamming our logs
the build was successful Details
2019-03-06 13:46:52 +01:00
Max Mehl 79672321a0
add robots.txt files for fsfe.org and test.fsfe.org
the build was successful Details
2018-12-10 14:25:20 +01:00
cri 05265802df robots.txt is now generated by build(-test).sh with different content
svn path=/trunk/; revision=21093
2011-09-23 14:22:03 +00:00
samtuke fe8579f068 attempting to kick start build script
svn path=/branches/design/; revision=18343
2010-11-17 13:33:27 +00:00
samtuke 7c90dbf964 attempting to kick start build script
svn path=/branches/design/; revision=18341
2010-11-17 13:02:44 +00:00
samtuke 0dd8651691 trying to ensure build process is started by renaming file
svn path=/branches/design/; revision=18258
2010-11-12 16:04:11 +00:00
samtuke 9a224f199a still trying to kickstart build process...
svn path=/branches/design/; revision=18256
2010-11-12 15:52:14 +00:00
ato 3a7a0bff1d Denying search engines access to the /sources directory (which is
generated by the build script, and which is not present in the
    repository.)

svn path=/trunk/; revision=14951
2010-02-15 14:17:23 +00:00
ato 424e798dcf We should allow search engines and crawlers.
svn path=/trunk/; revision=14886
2010-02-13 13:27:16 +00:00
cri bd299d74ef Do not allow web spiders to crawl the test branch
svn path=/branches/test/; revision=14013
2010-01-11 13:24:27 +00:00
Reinhard Müller 15241ac7e3 Another fake commmit, this time from me :)
svn path=/trunk/; revision=7745
2007-02-15 22:54:48 +00:00
jonas 8f16a371bb Last test commit. :-)
svn path=/trunk/; revision=7729
2007-02-14 14:34:47 +00:00
jonas f712066aa0 Test commit.
svn path=/trunk/; revision=7728
2007-02-14 14:20:25 +00:00
jonas 8f85f704cb Test commit.
svn path=/trunk/; revision=7727
2007-02-14 14:16:06 +00:00
Reinhard Müller 6fab036a1e Exclude source tree for robots.
svn path=/trunk/; revision=4662
2004-11-06 17:37:59 +00:00