1
1
Fork 0
mirror of https://gitlab.archlinux.org/archlinux/infrastructure.git synced 2024-05-26 10:46:06 +02:00
Commit Graph

4418 Commits

Author SHA1 Message Date
Evangelos Foutras d7139019a5
common: install compsize for use with btrfs rootfs
I have needed to use compsize on multiple occasions, and thus had to
temporarily install it. As it is already installed on 9 machines and
is generally useful, make it part of the standard tool set for btrfs.
2022-10-04 02:02:02 +03:00
Evangelos Foutras 6d40f442a2
matrix: rebase turnserver.conf to coturn 4.6.0-1 2022-10-04 01:37:28 +03:00
Evangelos Foutras 4816adb6ba
common: bump nf_conntrack_max to 256k on redirect
The traffic hitting ping.archlinux.org has lately been exhausting its
default nf_conntrack_max limit of 64k. Bump it to 256k (which is also
the default limit found on systems with more than 4G of memory).

Suggested-by: Kristian Klausen <kristian@klausen.dk>
2022-10-03 07:44:09 +03:00
Evangelos Foutras 179882ee56
firewalld: rebase firewalld.conf to firewalld 1.2.1-1 2022-10-03 06:54:24 +03:00
Kristian Klausen ca181610df
Merge branch 'goodbye-mailman2' into 'master'
Kill the mailman2 server and put the mailman3 server in its place

Closes #59

See merge request archlinux/infrastructure!628
2022-09-28 21:10:53 +02:00
Kristian Klausen 893a95f329
Kill the mailman2 server and put the mailman3 server in its place
With the final lists migrated to mailman3[1], the mailman2 server can
finally be killed.

When the mailman3 server was initially setup[2], it was done on a
separate server because the mailman and mailman3 packages conflicted,
and the traffic was routed over wireguard (HTTP, LMTP and SMTP).

Instead of installing mailman3 on the original lists.al.org server and
transferring the data, it was easier just to install the missing pieces
(basically Postfix and adjusting the Nginx configuration) on the ml3
server and move the IPs (to keep the IP mail reputation).

So basically the following was done:
- The IPs for the original lists.al.org was moved to the mailman3.al.org
  server
- The mailman2 datadir was transferred to mailman3.al.org server, so we
  can keep the pipermail links alive, and import missing mails if needed
- The original lists.al.org server was decommissioned
- The mailman3.al.org server was renamed to lists.al.org
- The missing pieces was added to the mailman3 role (basically Postfix +
  Nginx adjustments)
- The mailman role was deleted and the mailman3 role renamed to mailman

[1] 75ac7d09 ("mailman: Fourth and final batch of mailman3 migrated lists")
[2] 9294828f ("Setup mailman3 server")

Fix #59
2022-09-28 21:04:41 +02:00
Evangelos Foutras 3c15270927 Merge branch 'mirrorsync-role' into 'master'
Combine sync{archive,debug,riscv} into mirrorsync

See merge request archlinux/infrastructure!632
2022-09-28 18:53:45 +00:00
Evangelos Foutras 43eb814bcf
Combine sync{archive,debug,riscv} into mirrorsync
These roles are very similar and can be merged into a single new role.

Note: The archive mirror is changed from a 4-hour sync to minutely for
conformity with the other two mirrors. In practice this doesn't matter
as it was already taking over 4 hours to finish and was starting again
right after its previous run.
2022-09-28 21:52:52 +03:00
Jan Alexander Steffens (heftig) 93407f758b
matrix: Update synapse to 1.68.0 2022-09-28 02:42:18 +02:00
Jan Alexander Steffens (heftig) 1183090ec1
matrix: Update bridge to 0.35.1 2022-09-26 17:22:26 +02:00
Evangelos Foutras fe07dc0c36
Merge branch 'ansible-lint-6.7.0' into 'master' 2022-09-24 07:27:30 +03:00
Evangelos Foutras 6a486f28e5
lint: apply a few key-order[task] recommendations
Ordering "when:" before "block:" makes it more readable I suppose.
2022-09-24 07:25:53 +03:00
Evangelos Foutras 6468250515
lint: adjust two task names to fix name[template]
Using templates anywhere but the end of the name makes grepping for
errors more difficult.
2022-09-24 07:25:52 +03:00
Jelle van der Waa a36a6c4066
archweb: bump to latest version 2022-09-23 08:54:43 +02:00
Kristian Klausen e8d0985c17
Merge branch 'mediation-team' into 'master'
dovecot: Add shared mailbox for the mediation team

Closes #464

See merge request archlinux/infrastructure!616
2022-09-22 21:45:53 +02:00
Kristian Klausen b5dd4c4a62
dovecot: Add shared mailbox for the mediation team
Please see [1] and [2] for a better understanding of how this works.

[1] https://doc.dovecot.org/configuration_manual/authentication/password_databases_passdb/
[2] https://doc.dovecot.org/configuration_manual/authentication/user_databases_userdb/

Fix #464
2022-09-22 21:43:34 +02:00
Evangelos Foutras 1b9230881b
grafana: rebase grafana.ini to grafana 9.1.6-1 2022-09-21 20:46:28 +03:00
Evangelos Foutras 66224e0d08
tasks/upgrade-servers: host-specific post-upgrades
The Ansible output is too noisy with all the skipped tasks; avoid this
by moving host-speicific tasks into their own files that get included.
2022-09-20 15:03:10 +03:00
Evangelos Foutras bede104433 Merge branch 'ansible-lint-6.6.0' into 'master'
Fix lint warnings and errors with ansible-lint 6.6.0

See merge request archlinux/infrastructure!631
2022-09-18 22:35:34 +00:00
Evangelos Foutras 08712c793e
Fix lint warning about non-FQCN ansible.builtin.user
Seems ansible-lint thinks a task calling the unqualified user module is
"not valid under any of the given schemas (schema[tasks])".
2022-09-19 00:47:07 +03:00
Evangelos Foutras 022dccfbd4
Fix lint warnings about missing galaxy_info in meta
Not sure why this is needed but whatever. 🐱

https://github.com/ansible/schemas/discussions/227
2022-09-19 00:40:48 +03:00
Evangelos Foutras 154e0512b0
mailman3: fix a name[casing] lint warning 2022-09-19 00:17:01 +03:00
Evangelos Foutras 30444a3b4e
ci: install jmespath for ansible-lint
Prevents the following lint failure:

  jinja: You need to install "jmespath" prior to
         running json_query filter (jinja[invalid])
2022-09-19 00:16:55 +03:00
Evangelos Foutras 2ed1fa1f29
Fix template-instead-of-copy lint failures 2022-09-18 23:49:50 +03:00
Evangelos Foutras 2762e2f6fa
Apply jinja[spacing] recommendations 2022-09-18 22:57:33 +03:00
Kristian Klausen 1ae3a81584
gitlab_runner: Disable slow/unneeded systemd-time-wait-sync in the VM image
The service was enabled in arch-boxes to account for "hardware clock is
not in UTC, but instead UTC+X"[1], in our case the (VM) hardware clock
is in UTC and we therfor don't need the slow systemd-time-wait-sync
service (+30 seconds).

[1] e23d3c57a0
2022-09-18 13:39:53 +02:00
Kristian Klausen f34b16d32c
Merge branch 'arch-boxes-sha256' into 'master'
arch_boxes_sync: Pull the artifacts from GitLab's package registry

See merge request archlinux/infrastructure!580
2022-09-18 13:29:43 +02:00
Kristian Klausen 159ff40189
arch_boxes_sync: Trigger immediately mirror sync by updating lastupdate 2022-09-18 13:25:52 +02:00
Kristian Klausen cfe96bc823
arch_boxes_sync: Ensure the mtime of the "latest" symlinks matches the dest
Fixes: 2e799bd1 ("arch_boxes_sync: Create predictable symlinks for latest image files")
2022-09-18 13:25:49 +02:00
Kristian Klausen ae34cd11c5
arch_boxes_sync: Pull the artifacts from GitLab's package registry
arch-boxes has decided to use GitLab's package registry instead of job
artifacts[1].

[1] d04c827450
2022-09-18 13:25:44 +02:00
Kristian Klausen f3bf576a9d
arch_boxes_sync: Fix the file path for the "latest" checksum files
Fixes: 2e799bd1 ("arch_boxes_sync: Create predictable symlinks for latest image files")
2022-09-18 13:25:40 +02:00
Kristian Klausen e7aa193b33
Merge branch 'mailman-allow-posting-to-arch-wiki-admins' into 'master'
mailman3: allow everyone to post to the arch-wiki-admins mailing list

See merge request archlinux/infrastructure!629
2022-09-18 12:55:54 +02:00
nl6720 415c2a61cc
mailman3: allow everyone to post to the arch-wiki-admins mailing list
The mailing list is used for non-public communication with users, so everyone needs be able to post to it.
It is also the assigned email address of the ArchWiki user "WikiSysop".
See https://wiki.archlinux.org/title/ArchWiki:Maintenance_Team#Who,_when_and_how_to_contact
2022-09-18 13:23:36 +03:00
Kristian Klausen c445970d2e
Merge branch 'buildbot-oauth2' into 'master'
tf/keycloak: Add openid client for buildbot

See merge request archlinux/infrastructure!623
2022-09-18 11:57:57 +02:00
Kristian Klausen c56fbb55e0
tf/keycloak: Add openid client for buildbot
The buildbot POC wants to use Keycloak for user authentication. The
client is public, because it doesn't make sense to have a client secret,
which can't be kept under wrap anyway (it would need to be shipped with
the CLI[1]).

[1] https://gitlab.archlinux.org/foxboron/buildctl
2022-09-18 11:55:11 +02:00
Kristian Klausen 7115860700
aurweb: Double fd limit to avoid "Too many open files"
From time to time aurweb is failing with "Too many open files"
errors[1], this could indicate a bug in aurweb or perhaps the limit is
just too low. Let's try doubling the limit and see if it helps.

[1] https://gitlab.archlinux.org/archlinux/aurweb-errors/-/issues/275
2022-09-18 03:21:45 +02:00
Kristian Klausen 89c5e1af87
mailman3: Add missing trailing slash for the /static/ path
The code isn't vulnerable to nginx alias traversal[1][2], nevertheless
it should only match /static/ and not e.g. /staticfoobar.

[1] d94f18a7 ("Fix nginx alias traversal")
[2] 641060d635/docs/en/plugins/aliastraversal.md

Fixes: 9294828f ("Setup mailman3 server")
2022-09-18 01:19:14 +02:00
Kristian Klausen c9df10e4c2
mailman3: Switch to a faster search backend (Xapian)
Whoosh is used by default, but it is slow at indexing (multiple hours
for just aur-requests) and searching e.g. aur-requests isn't possible
(it is slow and uses 3G+ of memory resulting in it getting OOM-killed).

Xapian indexed everything in just 76 minutes and searching aur-requests
now works and is plenty fast.

Co-authored-by: Evangelos Foutras <evangelos@foutrelis.com>
2022-09-18 01:08:14 +02:00
Evangelos Foutras 595e3316c4
aurweb/rspamd: append .vault to vaulted secrets
This avoids triggering a GitLab push rule which rejects files that look
like secrets.
2022-09-17 22:10:08 +03:00
Kristian Klausen 22389d633f
Merge branch 'renovate' into 'master'
Add GPG master and signing key for Renovate and arch-boxes

See merge request archlinux/infrastructure!579
2022-09-16 22:00:09 +02:00
Kristian Klausen ecb032c53b
Add GPG master and signing key for arch-boxes
The key is used for signing the releases, so the users can be sure the
images on the mirrors haven't been modified. arch-boxes has been tweaked
to use the key in this MR[1].

[1] https://gitlab.archlinux.org/archlinux/arch-boxes/-/merge_requests/176
2022-09-16 21:58:40 +02:00
Kristian Klausen 5d55253cd0
Add GPG master and signing key for Renovate
Renovate is a tool for: "Automated dependency updates. Multi-platform
and multi-language."[1].

We require all commits pushed directly to official projects to be
signed, so a master key and signing key have been generated for
Renovate. Both keys are stored in renovate.asc and Renovate only has
access to the signing key.

[1] https://github.com/renovatebot/renovate
2022-09-16 21:58:37 +02:00
Evangelos Foutras c74adcfec7 Merge branch 'riscv-mirror' into 'master'
syncriscv: add role for mirroring the RISC-V port

See merge request archlinux/infrastructure!625
2022-09-16 19:23:28 +00:00
Evangelos Foutras 29aaed2bd0
syncriscv: add role for mirroring the RISC-V port
Going to be served by all our Geo boxes under riscv.mirror.pkgbuild.com.
2022-09-16 22:22:43 +03:00
Evangelos Foutras 72eb5d049e
Capitalize few more handler names that were missed
Fixes: 578b781966 ("Capitalize the handler name in handler invocations")
Fixes: 26f289b72b ("Capitalize the first letter of all task names")
2022-09-16 19:19:23 +03:00
Kristian Klausen 94045bd875
mailman: Show the mailman3 interface by default
All lists have been migrated to mailman3[1] and mailman3 is what users
should use, so show its interface by default and not the mailman2
interface.

[1] 75ac7d09 ("mailman: Fourth and final batch of mailman3 migrated lists")
2022-09-16 15:10:07 +02:00
Kristian Klausen 25e52b7bcc
mailman3: Be consistent in ordering of ml options
Fixes: 4d8dfb6a ("mailman: Third batch of mailman3 migrated lists")
2022-09-16 00:40:28 +02:00
Kristian Klausen 75ac7d09be
mailman: Fourth and final batch of mailman3 migrated lists
arch-general
aur-general
aur-requests

It has been decided not to migrate the following unlisted and unused
lists:
arch-magazine
arch-notifications
arch-test
mailman
2022-09-16 00:40:25 +02:00
Evangelos Foutras 5c6308b107
aurweb: remove unused php-fpm.conf.j2 template
Fixes: 92586d5b60 ("change(aurweb): rework ansible config for 6.0.0")
2022-09-15 15:52:47 +03:00
Leonidas Spyropoulos 6154362c6d Merge branch 'aurweb_6_1_3' into 'master'
aurweb: bump to v6.1.4

See merge request archlinux/infrastructure!626
2022-09-14 23:01:15 +00:00