Hi all.
We are faced with replicating data between several AWS regions task. We need to replicate any user profile changes across all regions. At the same time, profile data can change in any of the regions in which the user is currently located.
For example we have 3 regions
user one registered on region1
his registration data was replicated to region2 and region3
user changed his data on region1
user data has also been replicated to region2 and region3
user changed region to region2
user data has changed on region2
his data was replicated to region1 and region3
I would like to know who had a similar problem and how it can be solved in the best way)
From what you mentioned, it seems you are looking for a multi-master setup, where any data can be changed anywhere and be propagated to all clusters. In an Atlas replica set deployment, members can be hosted in different regions. You can use Atlas Global Clusters for your use case. I’m attaching a few documentation links for you to go over. Manage Global Clusters Segmenting Data by Location
Please let us know if there’s any more information needed around this. Feel free to reach out for anything else as well.
Hey Satyam,
Unfortunately, we don’t use MongoDB Atlas. We chose the MongoDB Multi-Master deployment on AWS. Each our region will has own MongoDB cluster. And use the MongoDB Kafka Connector as the replication mechanism.
But also we need to integrate with AWS DocumentDB database and stream changes to MongoDB. We will use Kafka as a message broker.
Can we use MongoDB Kafka Connector as a Sink/Source for AWS DocumentDB ?
But also we need to integrate with AWS DocumentDB database and stream changes to MongoDB. We will use Kafka as a message broker.
Can we use MongoDB Kafka Connector as a Sink/Source for AWS DocumentDB ?
Our Kafka connector was not designed to work with products other than genuine MongoDB servers. There is no guarantee that it can work correctly, or at all, with other databases.
Also, since you mentioned Multi-Master deployment, I came across a blog on our developer centre that should be of use to you. It talks about deploying an application across multiple data centers where application servers in all data centers are simultaneously processing requests, something that you are trying to do as well. Active Active Architectures in MongoDB