1 changed files with 3 additions and 0 deletions
+ 3
- 0
robots.txt
View File
| @@ -1,2 +1,5 @@ | |||
| User-agent: * | |||
| Disallow: /source/ | |||
| User-agent: SemrushBot | |||
| Disallow: / | |||
Loading…