For references: Seems the problem was CPU idling in GCP which I had overlooked. That in combination with some cronjobs obviously caused the issue.
If someone from Mongo dev team reads this: Would be nice to change “ReplicaSetNoPrimary” into something more meaningful like: “Some generic connection error occurred. Most likely something in your infrastructure.”