How to gracefully drain a node in EKS?
These steps should work:
1.) kubectl get nodes
2.) kubectl cordon <node name>
3.) kubectl drain <node name> --ignore-daemonsets
4.) aws autoscaling terminate-instance-in-auto-scaling-group --instance-id <instance-id> --should-decrement-desired-capacity
For step 3, you might need to consider using this instead:
kubectl drain <node name> --ignore-daemonsets --delete-local-data
For AWS autoscaling group, if you have nodes span out to multiple zones, consider delete nodes in each zones instead of all nodes from a single zone.
After the execution of the above commands, check the autoscaling group's desired number. It should decrease automatically. If you are using terraform or other automation framework, don't forget to update your autoscaling group config in your infrastructure script.
1.) kubectl get nodes2.) kubectl cordon <node name>3.) kubectl drain <node name> --ignore-daemonsets --delete-emptydir-dataFlag --delete-local-data has been deprecated, This option isdeprecated and will be deleted. Use --delete-emptydir-data.