Follow these steps to recover PKI Hub and the deployed solutions after a system crash.

Recovering multi-node installations with a quorum

If your multi-node installation retains the quorum described in Required number of nodes, you can remove, restore, and add the crashed nodes.

To recover a crashed node

1. Mark the node as unschedulable. 

   sudo kubectl cordon <node-to-delete>

2. Drain the pods from the node to delete. 

   sudo kubectl drain <node-to-delete> --delete-emptydir-data --disable-eviction --force --ignore-daemonsets --timeout=600s

3. Delete the node from the cluster. 

   sudo kubectl delete node <node-to-delete> --timeout=600s
4. Restore the node and add it again to the cluster, as explained in Joining nodes.

Recovering multi-node installations without a quorum

If your multi-node installation does not retain the quorum described in Load balancing requirements, follow the steps below to recover it.

To recover a multi-node deployment without a quorum

1. Run clusterctl uninstall on all nodes to uninstall PKI Hub.
2. Recover the PKI Hub and the deployed solutions from a backup as explained in Restoring the PKI Hub state.