Jelle van der Waa 8691ab7394 Disallow scraping the search results on the AUR ... As the queries for searching are the most 'heavy' queries we can disallow bots to scrape through all search results. Archweb uses the same robots.txt rules for disallowing indexing search results.		2020-09-02 21:53:48 +02:00
..
defaults	roles/aurweb: Switch to using a socket for memcached	2020-07-23 15:23:20 -03:00
files	Disallow scraping the search results on the AUR	2020-09-02 21:53:48 +02:00
handlers	wip/aur: Fix linting issues	2020-07-23 11:03:40 -03:00
tasks	Disallow scraping the search results on the AUR	2020-09-02 21:53:48 +02:00
templates	Disallow scraping the search results on the AUR	2020-09-02 21:53:48 +02:00