diff options
author | ng0 <ng0@n0.is> | 2019-03-04 09:48:27 +0000 |
---|---|---|
committer | ng0 <ng0@n0.is> | 2019-03-04 09:48:27 +0000 |
commit | c06a0609176cdf37ea9639384ead5c53a25fc98d (patch) | |
tree | 931e86109c4a12f2872682f530746e01edf7f7e3 | |
parent | 68871f69f8efac23413e39424ed6ae22587b2941 (diff) | |
download | www-c06a0609176cdf37ea9639384ead5c53a25fc98d.tar.gz www-c06a0609176cdf37ea9639384ead5c53a25fc98d.zip |
change robots
-rw-r--r-- | static/robots.txt | 3 |
1 files changed, 1 insertions, 2 deletions
diff --git a/static/robots.txt b/static/robots.txt index 0c1fdbd0..7ba47472 100644 --- a/static/robots.txt +++ b/static/robots.txt | |||
@@ -16,7 +16,6 @@ | |||
16 | # For syntax checking, see: | 16 | # For syntax checking, see: |
17 | # http://www.frobee.com/robots-txt-check | 17 | # http://www.frobee.com/robots-txt-check |
18 | 18 | ||
19 | Sitemap: https://gnunet.org/en/sitemap.xml | ||
20 | |||
21 | User-agent: * | 19 | User-agent: * |
22 | Crawl-delay: 10 | 20 | Crawl-delay: 10 |
21 | sitemap: https://gnunet.org/en/sitemap.xml | ||