homepage/static/robots.txt

12 lines
164 B
Plaintext

User-agent: AdsBot*
Disallow: /
User-agent: Mediapartners*
Disallow: /
User-Agent: *
Disallow: /categories
Disallow: /tags
Sitemap: https://dotya.ml/sitemap.xml