We have several collections based on n tenants and want the kafka connector to only watch for specific collections.
Below is my mongosource.properties file where I have added the pipeline filter to listen only to specific collections.It works
the collections will grow in the future to maybe 200 collections which have to be watched, wanted to know the below three things
- is their some performance impact with one connector listening to huge number of collections ?
- is their any limit on the collections one connector can watch ?
- what would be the best practice, to run one connector listening to 100 collections or 10 different connectors listening to 10 collections each ?