Sink Connector Post-processor Properties

This version of the documentation is archived and no longer supported. View the current documentation to learn how to upgrade your version of Kafka Connector.

Overview

Use the following configuration settings to specify how the MongoDB Kafka sink connector should transform Kafka data before inserting it into MongoDB.

For a list of sink connector configuration settings organized by category, see the guide on Sink Connector Configuration Properties.

Settings

Name

Description

post.processor.chain

Type: list

Description:
A list of post-processor classes the connector should apply to
process the data before saving it to MongoDB.

To learn more about post-processors and see examples of
their usage, see
Sink Connector Post Processors.

Default:

com.mongodb.kafka.connect.sink.processor.DocumentIdAdder

Accepted Values: A comma-separated list of fully qualified Java class names

field.renamer.mapping

Type: string

Description:
A list of field name mappings for key and value fields. Define
the mappings in an inline JSON array in the following format:

[ { "oldName":"key.fieldA", "newName":"field1" }, { "oldName":"value.xyz", "newName":"abc" } ]

Default: []

Accepted Values: A valid JSON array

field.renamer.regexp

Type: string

Description:
A list of field name mappings for key and value fields using
regular expressions. Define the mappings in an inline JSON array
in the following format:

[ {"regexp":"^key\\\\..*my.*$", "pattern":"my", "replace":""}, {"regexp":"^value\\\\..*$", "pattern":"\\\\.", "replace":"_"} ]

Default: []

Accepted Values: A valid JSON array

key.projection.list

Type: string

Description:
A list of field names the connector should include in the key
projection.

Default: ""
Accepted Values: A comma-separated list of field names

key.projection.type

Type: string

Description:
The key projection type the connector should use.

Default: none
Accepted Values:  none, BlockList, or AllowList (Deprecated: blacklist, whitelist)

value.projection.list

Type: string

Description:
A list of field names the connector should include in the value
projection.

Default: ""
Accepted Values: A comma-separated list of field names

value.projection.type

Type: string

Description:
The type of value projection the connector should use.

Default: none
Accepted Values: none, BlockList, or AllowList (Deprecated: blacklist, whitelist)

writemodel.strategy

Type: string

Description:
The class that specifies the WriteModelStrategy the connector should
use for Bulk Writes.

To learn more about how to create your own strategy, see
Custom Write Model Strategies.

Default:

com.mongodb.kafka.connect.sink.writemodel.strategy.DefaultWriteModelStrategy

Accepted Values: A fully qualified Java class name

Back

Connector Error Handling

Id Strategy