fix: lighthouse-approved robots file
This commit is contained in:
parent
a546004c7b
commit
eafc98b394
@ -5,6 +5,7 @@ User-agent: Mediapartners*
|
|||||||
Disallow: /
|
Disallow: /
|
||||||
|
|
||||||
User-Agent: *
|
User-Agent: *
|
||||||
Disallow: /404.html
|
Disallow: /categories
|
||||||
Disallow: /categories/
|
Disallow: /tags
|
||||||
|
|
||||||
Sitemap: https://dotya.ml/sitemap.xml
|
Sitemap: https://dotya.ml/sitemap.xml
|
||||||
|
Loading…
Reference in New Issue
Block a user