diff options
| author | Eugen Rochko <eugen@zeonfederated.com> | 2019-02-13 21:28:18 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2019-02-13 21:28:18 +0100 |
| commit | 80161f43510ad9316c60c9b50dd5c09c2dae4d54 (patch) | |
| tree | 460e50d7b81024e30a7ca42c003690b80b6c0ace /config/initializers/twitter_regex.rb | |
| parent | 7750416597e4d172b1d4751215aac2a50cf528e3 (diff) | |
Change robots.txt to exclude some URLs (#10037)
- Exclude static assets - Exclude uploaded files - Exclude alternate versions of the profile page - Exclude media proxy URLs
Diffstat (limited to 'config/initializers/twitter_regex.rb')
0 files changed, 0 insertions, 0 deletions