Array of Objects become Array of String during upload to Kafka

Working with Data Connectors & Integrations
6

Hi @Robert_Walters,

Thanks, I understood the RCA, I am bypassing it by using StringConverter it produces 100% valid JSON string then later is read and transformed back to JSON Object.

However I do not agree that problem is with Kafka itself, since everything in Kafka is kept in a Array[Byte] format - this is why we are using converters, so types are not applied there.

Another point that I could agree that there is a logic that elements of array should be the same. But again on which scope? Basically this array is Array[Objects], each document has its own internal structure.

And finally if MongoDB saves, operates such structures, provides the functionality to create MongoDB -> Kafka -> MongoDB connection (as mentioned in docs) then obviously something is wrong with the JsonConverter because during this Data flow Source != Sink.