Using the Put Mongo Record processor on Nifi.
Data is in JSON format.
You have to assign a Record Reader so for that we selected: JSONPathReader
We run the processor and the data succesfully enters Mongo. All keys for the data are present however every one of their values are “null.”
We go back to the JSONPathReader and add a property for one of the fields:
E.g.:
$.name
We re-ingest the data and now the values for all the “name” fields are present.
So technically we could do this for every single field in the JSON document, but it doesn’t provide for much flexibility and expansion of new datasets.
Does anyone know if there is a way to “splat” the JsonPathReader and have mongo accept all the values for every key?
I have put this topic in the Cloudera community but have not received any help