Hi
We are running kafka connect on our k8s on-premise cluster.
I am using confluence kafka connect to copy data from mongo to kafka.
The payload is json
Kafka is configured with 3 brokers.
I see high latency i.e. it seems that it takes about 10 secs for the json to get to kafka.
I changed the number of the kafka topic partitions and tried to change the following parameters , but I dont see any decrease in latency :
batch.size
poll.await.time.ms
confluent.topic.replication.factor
compression.type": “lz4”
linger.ms
Any ideas ?
Thanks