Hi everyone,
we have just deployed our first Kafka Source connecter which is configured to listen to all database change events.
I have noticed that at least 50% of changes are coming from one specific collection which I would not want to listen to. Is there a way to specifically configure the connector to listen to all database, excluding this one collection?
You can define a regex expression within the pipeline parameter to fine tune the collections you’d like to include/exclude:
To exclude, use a negative lookhead in your regex, something like
pipeline=[{“$match”: {“ns.coll”: {“$regex”: ^((?!name_of_collection_to_skip).*)$ }}}]
2 Likes
This topic was automatically closed 5 days after the last reply. New replies are no longer allowed.