'k8 hot swap node pools to keep a a dead node-pool/pods while users getting routed to another healthy node-pool/pod for trouble shooting

I have the situation what all pods within my node pools get stale and unhealthy pretty much at the same time. I'd like to keep an unhealthy node-pool/pod to troubleshoot the problem, send requests to it and analyze it, while the others should get restarted to stay healthy. So public traffic is only routed to healthy nodes, whereas I as developer am still able to access the unhealthy ones.

Anyone has any smart solution for this?

Is it possible with kubernetes to have two node pools and hot swap public inbound traffic from node-pool-a to node-pool-b?

(with this deactivating pod restart on node-pool-a to force them to stay on the dead state).



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source