diff options
| author | Thibaut Girka <thib@sitedethib.com> | 2019-02-15 18:02:45 +0100 |
|---|---|---|
| committer | Thibaut Girka <thib@sitedethib.com> | 2019-02-15 18:02:45 +0100 |
| commit | 06cc04fd239896d294210b8bbaadb7c611aaffe5 (patch) | |
| tree | 1868711bbe9ee79b25ff10a585457cfa0f9ac121 /public | |
| parent | 2769b5446681898e8332cb505f499dac2a6e5717 (diff) | |
| parent | 8ef50706a11e115e8b4aa31b30de93738bc7e754 (diff) | |
Merge branch 'master' into glitch-soc/merge-upstream
Diffstat (limited to 'public')
| -rw-r--r-- | public/robots.txt | 7 |
1 files changed, 3 insertions, 4 deletions
diff --git a/public/robots.txt b/public/robots.txt index 3c9c7c01f..d93648bee 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,5 +1,4 @@ # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file -# -# To ban all spiders from the entire site uncomment the next two lines: -# User-agent: * -# Disallow: / + +User-agent: * +Disallow: /media_proxy/ |