If that is the configuration then yes Node 1 or 2 should have become primary.
Double check the replicaset configuration to be sure it is what you expect it to be. The logs will contain all the information about what occurred during the the period when node 3 and 4 were down and should indicate why a primary was not elected.