Overview
以流式传输模式向 MongoDB 写入数据时，可以配置以下属性。
注意
如果您使用 SparkConf 设置连接器的写入配置，请为每个属性添加前缀 spark.mongodb.write.。
属性名称 | 说明 | |
|---|---|---|
| Required. The connection string configuration key. Default: mongodb://localhost:27017/ | |
| Required. The database name configuration. | |
| Required. The collection name configuration. | |
| The comment to append to the write operation. Comments appear in the
output of the Database Profiler. Default: None | |
| MongoClientFactory configuration key. You can specify a custom implementation that must implement the
com.mongodb.spark.sql.connector.connection.MongoClientFactory
interface.Default: com.mongodb.spark.sql.connector.connection.DefaultMongoClientFactory | |
| Specifies if the connector parses string values and converts extended JSON
into BSON. This setting accepts the following values:
Default: false | |
| Specifies a field or list of fields by which to split the collection data. To
specify more than one field, separate them using a comma as shown
in the following example: Default: _id | |
| When true, the connector ignores any null values when writing,
including null values in arrays and nested documents.Default: false | |
| Specifies the maximum number of operations to batch in bulk
operations. Default: 512 | |
| Specifies the type of write operation to perform. You can set
this to one of the following values:
Default: replace | |
| Specifies whether to perform ordered bulk operations. Default: true | |
| When true, replace and update operations insert the data
if no match exists.For time series collections, you must set upsertDocument to
false.Default: true | |
| Specifies w, a write-concern option requesting acknowledgment that
the write operation has propagated to a specified number of MongoDB
nodes.For a list of allowed values for this option, see WriteConcern
w Option in the
manual. Default: Acknowledged | |
| Specifies j, a write-concern option requesting acknowledgment that
the data has been written to the on-disk journal for the criteria
specified in the w option. You can specify either true or
false.For more information on j values, see WriteConcern j
Option in the
manual. | |
| Specifies wTimeoutMS, a write-concern option to return an error
when a write operation exceeds the specified number of milliseconds. If you
use this optional setting, you must specify a nonnegative integer.For more information on wTimeoutMS values, see
WriteConcern wtimeout in
the manual. | |
| The absolute file path of the directory where the connector writes checkpoint
information. For more information about checkpoints, see the Spark Structured
Streaming Programming Guide Default: None | |
| A Boolean value that specifies whether to delete existing checkpoint data. Default: false |
指定属性，在 connection.uri
如果您使用 SparkConf指定以前的任何设置，则可以将它们包含在connection.uri设置中或单独列出。
以下代码示例显示如何将数据库、集合和 convertJson 设置指定为 connection.uri 设置的一部分：
spark.mongodb.write.connection.uri=mongodb://127.0.0.1/myDB.myCollection?convertJson=any
为了缩短 connection.uri 并使设置更易于阅读，您可以改为单独指定它们：
spark.mongodb.write.connection.uri=mongodb://127.0.0.1/ spark.mongodb.write.database=myDB spark.mongodb.write.collection=myCollection spark.mongodb.write.convertJson=any
重要
如果您在 connection.uri 及其自己的行中都指定了某个设置，则 connection.uri 设置优先。例如，在以下配置中，连接数据库为 foobar：
spark.mongodb.write.connection.uri=mongodb://127.0.0.1/foobar spark.mongodb.write.database=bar