1
0
Fork 0
mirror of https://github.com/poseidon/typhoon synced 2024-05-26 09:26:24 +02:00
typhoon/google-cloud/flatcar-linux/kubernetes/workers
Dalton Hubble 393a38deff Configure Graceful Node Shutdown and lengthen max inhibitor delay
* Configure Kubelet Graceful Node Shutdown to detect system shutdown
events and stop running containers gracefully when possible
* Allow up to 30s for critical pods to gracefully shutdown
* Allow up to 15s for regular pods to gracefully shutdown
* Node will be marked as NotReady promptly, instead of having to
wait for health checks
* Kubelet uses systemd inhibitor locks to delay shutdown for a limited
number of seconds
* Raise the default max inhibitor time from 5s to 45s

Verify systemd inhibitor locks are present:

```
sudo systemd-inhibit --list
WHO     UID USER PID  COMM    WHAT     WHY                                        MODE
kubelet 0   root 4581 kubelet shutdown Kubelet needs time to handle node shutdown delay
```

Tail journal logs and then shutdown a node via systemctl reboot
or via the cloud console to watch container shutdown

Rel:

* https://kubernetes.io/blog/2021/04/21/graceful-node-shutdown-beta/
* https://kubernetes.io/docs/reference/config-api/kubelet-config.v1beta1/
* https://github.com/kubernetes/kubernetes/issues/107043
* https://github.com/coreos/fedora-coreos-tracker/issues/821
* https://www.freedesktop.org/software/systemd/man/systemd-inhibit.html
* https://github.com/kubernetes/kubernetes/blob/release-1.24/pkg/kubelet/nodeshutdown/nodeshutdown_manager_linux.go
* https://github.com/godbus/dbus/blob/master/conn.go
2022-08-28 10:37:33 -07:00
..
butane Configure Graceful Node Shutdown and lengthen max inhibitor delay 2022-08-28 10:37:33 -07:00
image.tf Remove Terraform template provider dependency 2022-08-02 18:15:03 -07:00
outputs.tf Rename container-linux modules to flatcar-linux 2020-10-20 22:47:19 -07:00
target_pool.tf Rename container-linux modules to flatcar-linux 2020-10-20 22:47:19 -07:00
variables.tf Switch to using Flatcar Linux images on Google Cloud 2022-01-28 21:04:10 -08:00
versions.tf Migrate Flatcar Linux from Ignition spec v2.3.0 to v3.3.0 2022-08-03 08:32:52 -07:00
workers.tf Adjust Google Cloud worker health checks to use kube-proxy healthz 2022-08-17 20:50:52 -07:00