11 lines
168 B
Plaintext
11 lines
168 B
Plaintext
User-agent: AdsBot*
|
|
Disallow: /
|
|
|
|
User-agent: Mediapartners*
|
|
Disallow: /
|
|
|
|
User-Agent: *
|
|
Disallow: /404.html
|
|
Disallow: /categories/
|
|
Sitemap: https://dotya.ml/sitemap.xml
|