Docs Menu

Docs HomeMongoDB Kafka Connector

What's New

On this page

  • What's New in 1.3
  • What's New in 1.2
  • What's New in 1.1
  • What's New in 1.0

Learn what's new by version:

  • Added automated integration testing for the latest MongoDB Kafka Connector and Confluent Platform versions to ensure compatibility

  • Added support for records that contain Bson byte types

  • Added support for the errors.tolerance property

  • Changed max.num.retries default to 1

  • Improved the error messages for business key errors

  • Improved the error handling for List and JSON array configuration options

  • Updated to use the dot notation for filters in key update strategies

  • Added support to output a key or value as a Bson byte type

  • Added support for schema and custom Avro schema definitions

  • Added support for dead letter queue and the errors.tolerance property

  • Added configurations for the following formatters:

    • DefaultJson

    • ExtendedJson

    • SimplifiedJson

  • Added configuration for copy.existing.pipeline to allow you to use indexes during the copying process

  • Added configuration for copy.existing.namespace.regex to allow you to copy the filtering of namespaces

  • Added configuration for offset.partition.name to allow for custom partitioning naming strategies

  • Updated to validate that the fullDocument field is a document

  • Updated to sanitize the connection string in the offset partition map to improve maintenance of the connection.uri, database, and collection parameters

  • Updated to disable publishing a source record without a topic name

  • Stopped MongoDB 3.6 from copying existing issues when the collection didn't exist in the Source Connector

Important

We deprecated the following post processors:

  • BlacklistKeyProjector

  • BlacklistValueProjector

  • WhitelistKeyProjector

  • WhitelistValueProjector

If you are using one of these post processors, use the respective one instead for future compatibility:

  • BlockListKeyProjector

  • BlockListValueProjector,

  • AllowListKeyProjector

  • AllowListValueProjector

  • Added configurations for the following properties:

    • document.id.strategy.overwrite.existing

    • UuidStrategy output types

    • document.id.strategy.partial.value.projection.type

    • document.id.strategy.partial.value.projection.list

    • document.id.strategy.partial.key.projection.type

    • document.id.strategy.partial.key.projection.list

    • UuidProvidedInKeyStrategy

    • UuidProvidedInValueStrategy

  • Added the UpdateOneBusinessKeyTimestampStrategy post processor

  • Added built-in support for parallelism and scalable data copying by assigning topic partitions to tasks

  • Improved the error messaging for missing resume tokens

  • Removed failures with the MongoCopyDataManager when the source database does not exist

  • Fixed the copying the existing resumability error in the Source Connector

  • Added support for the topics.regex property

  • Updated to ignore unused source record key or value fields

  • Added validation for the connection using MongoSinkConnector.validate

  • Added validation for the connection using MongoSourceConnector.validate

  • Removed the "Unrecognized field: startAfter" error for resuming a change stream in the Source Connector

The initial GA release.

←  MongoDB Kafka ConnectorIntroduction →