I honestly don’t know enough about spot instances to know how feasible that would be! Very interesting question though…!!
If you lose a node and a pod, what happens to the storage? Will the pod come up again somewhere else with the storage (theoretically) intact? (I’m not sure if that’s what you meant by the SSDs being permanent)
I’m definitely not aware of anyone else running on spot instances!