From eafc98b3948a7e8f678ef141be162187d572a976 Mon Sep 17 00:00:00 2001 From: surtur Date: Fri, 24 Jul 2020 12:54:43 +0200 Subject: [PATCH] fix: lighthouse-approved robots file --- static/robots.txt | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/static/robots.txt b/static/robots.txt index 1979adb..3f3c85e 100644 --- a/static/robots.txt +++ b/static/robots.txt @@ -5,6 +5,7 @@ User-agent: Mediapartners* Disallow: / User-Agent: * -Disallow: /404.html -Disallow: /categories/ +Disallow: /categories +Disallow: /tags + Sitemap: https://dotya.ml/sitemap.xml