Losing kubectl when control plane node goes down ?

I got a 3 master + X worker topology and whenever a master goes down, kubectl goes timeout and no longer respond.

To mitigate this issue I set up a nginx with three master as upstream and a roundrobin algorithm and make my kubeconfig point to nginx opened port.

Without success ; means whenever master goes down, kubectl hang and timeout until I reset failing master.

How would you address this issue ? Is this normal behaviour ?

k8s 1.30.5 with rke v1.6.3