User-agent: AdsBot*
Disallow: /

User-agent: Mediapartners*
Disallow: /

User-Agent: *
Disallow: /404.html
Disallow: /categories/
Sitemap: https://dotya.ml/sitemap.xml