homepage/static/robots.txt

11 lines
168 B
Plaintext
Raw Normal View History

User-agent: AdsBot*
Disallow: /
User-agent: Mediapartners*
Disallow: /
User-Agent: *
Disallow: /404.html
Disallow: /categories/
Sitemap: https://dotya.ml/sitemap.xml