diff options
author | ng0 <ng0@n0.is> | 2019-03-04 09:44:37 +0000 |
---|---|---|
committer | ng0 <ng0@n0.is> | 2019-03-04 09:44:37 +0000 |
commit | e66580d759ceea6e6e9cb376f3ddb5a04d86fdf5 (patch) | |
tree | 6e2fde8b6a6a259ef5fe25f49c556cec6371bbce /static | |
parent | 9727890654820b85b13762524ccb210cfe6a1c2f (diff) | |
download | www-e66580d759ceea6e6e9cb376f3ddb5a04d86fdf5.tar.gz www-e66580d759ceea6e6e9cb376f3ddb5a04d86fdf5.zip |
A first initial draft for a sitemap
Diffstat (limited to 'static')
-rw-r--r-- | static/robots.txt | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/static/robots.txt b/static/robots.txt index 0a639917..0c1fdbd0 100644 --- a/static/robots.txt +++ b/static/robots.txt | |||
@@ -16,5 +16,7 @@ | |||
16 | # For syntax checking, see: | 16 | # For syntax checking, see: |
17 | # http://www.frobee.com/robots-txt-check | 17 | # http://www.frobee.com/robots-txt-check |
18 | 18 | ||
19 | Sitemap: https://gnunet.org/en/sitemap.xml | ||
20 | |||
19 | User-agent: * | 21 | User-agent: * |
20 | Crawl-delay: 10 | 22 | Crawl-delay: 10 |