This seems to be stemming from the Spark version not matching the version supported by of the MongoDB Spark Connector. Can you try with Spark version 3.2.4 please (instead of 3.4.1 that you seem to be using)?
2 Likes