I have implemented MongoDB connector with Kafka. where all the data from Kafka topic(ksqlDB table) sink kafta to MongoDB. Connection established successfully between them. Only the first record of the Kafka sink in MongoDB. Whereas I have 100 records in the table. Unable to understand behavior like this. My configuration looks like this.
{
"name": "MongoSinkConnectorConnector_1",
"config": {
"connector.class": "com.mongodb.kafka.connect.MongoSinkConnector",
"key.converter": "org.apache.kafka.connect.storage.StringConverter",
"value.converter": "io.confluent.connect.avro.AvroConverter",
"topics": "FEEDS",
"connection.uri": "mongodb://xxx:xxx@x.x.x.x:27017/",
"database": "xxx",
"max.num.retries": "10000",
"writemodel.strategy": "com.mongodb.kafka.connect.sink.writemodel.strategy.UpdateOneTimestampsStrategy",
"value.projection.type": "allowlist",
"value.projection.list": "id",
"document.id.strategy": "com.mongodb.kafka.connect.sink.processor.id.strategy.PartialValueStrategy",
"buffer.capacity": "20000",
"value.converter.schema.registry.url": "http://x.x.x.x:8081",
"key.converter.schemas.enable": "false",
"insert.mode": "upsert"
}
}
Any help suggestion appreciated. Thank you.