Need help with output.schema.key

Nikhil_Moudgil · January 31, 2023, 9:45am

I want to send to store message to a specific partition. But I can’t understand how they configured output.shcema.key in this example posted on Git of a MongoDB specialist. Can anyone help me understand how he mentioned output.schema.key as animal_type? Thanks a lot in advance

Robert_Walters · January 31, 2023, 12:10pm

Can you paste the link to which example you are referring?

Nikhil_Moudgil · January 31, 2023, 12:41pm

github.com

RWaltersMA/kafka1.3/blob/master/source-key-demo.txt

#start the demo environment

#define your atlas conection string (optional)
export ATLAS_CONNECTION="mongodb+srv://YOUR CONNECTION STRING HERE"

#Start the containers, skip the configuration so we can step through it and explain the parameters
sh start-demo.sh $ATLAS_CONNECTION skip

#If you do not have the kafka installed locally, download from https://www.apache.org/dyn/closer.cgi?path=/kafka
#there will be a bin folder that includes various kafka- utilities
#create a topic with 3 partitions
~/kafka/bin/kafka-topics.sh --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 3 --topic demo1-3.Demo.pets

#configure source connector to read from Demo.pets
curl -X POST -H "Content-Type: application/json" --data '
  {"name": "mongo-source-key",
   "config": {
     "tasks.max":"1",
     "connector.class":"com.mongodb.kafka.connect.MongoSourceConnector",
     "output.json.formatter":"com.mongodb.kafka.connect.source.json.formatter.SimplifiedJson",

This file has been truncated. show original

Its your article sir

Robert_Walters · February 28, 2023, 1:39pm

output.schema.key is the avro representation (not JSON schema) of the message event.