Ubuntu 24.04 LTS – Kubelet not registering node due to cgroup mismatch – Fix & Prevention

📖 ~1 min read

Table of contents

1. Symptom & Impact
2. Environment & Reproduction
3. Root Cause Analysis
4. Quick Triage
5. Step-by-Step Diagnosis
6. Solution – Primary Fix
7. Solution – Alternative Approaches
8. Verification & Acceptance Criteria
9. Rollback Plan
10. Prevention & Hardening
11. Related Errors & Cross-Refs
12. References & Further Reading

Symptom & Impact

Node remains NotReady and workloads fail to schedule.

Environment & Reproduction

Common after runtime or kubelet upgrade.

sudo systemctl status kubelet
kubectl get nodes
crictl info

Root Cause Analysis

Kubelet and container runtime use different cgroup drivers.

Quick Triage

Compare kubelet config and container runtime cgroup settings.

grep -R cgroup /var/lib/kubelet/config.yaml /etc/containerd/config.toml -n
sudo journalctl -u kubelet -n 100

Step-by-Step Diagnosis

Inspect effective kubelet settings and containerd dump.

sudo cat /var/lib/kubelet/config.yaml
sudo containerd config dump | grep -i SystemdCgroup
crictl info | grep -i cgroup

Solution – Primary Fix

Align both services to systemd cgroup and restart daemons.

sudo sed -i 's/SystemdCgroup = false/SystemdCgroup = true/' /etc/containerd/config.toml
sudo systemctl restart containerd
sudo systemctl restart kubelet

Solution – Alternative Approaches

Rebootstrap node configuration with kubeadm join.

sudo kubeadm reset -f
sudo kubeadm join  --token  --discovery-token-ca-cert-hash 

Verification & Acceptance Criteria

Node reaches Ready state and accepts scheduled pods.

kubectl get nodes
kubectl describe node $(hostname)

Rollback Plan

Restore previous runtime config if compatibility issues emerge.

sudo cp /etc/containerd/config.toml.bak /etc/containerd/config.toml
sudo systemctl restart containerd kubelet

Prevention & Hardening

Standardize kubelet and runtime config through automation.

sudo systemctl is-enabled kubelet
grep -R cgroup /var/lib/kubelet /etc/containerd -n

Related Errors & Cross-Refs

Related to container runtime endpoint and swap settings issues.

Related tutorial: View the step-by-step tutorial for Ubuntu 24.04 LTS.

View all Ubuntu 24.04 LTS tutorials on the Tutorials Hub →

Browse all common problems & solutions on the Tutorials Hub.

References & Further Reading

Ubuntu Kubernetes node setup guidance.