MongoDB Federation Concurrency Limit and Queuing

I’m planning to utilize MongoDB Atlas Data Federation’s $out feature to export data to Amazon S3 on a daily basis. I’m employing the MongoDB scheduler to execute a script daily to initiate this process. Since the trigger’s execution time is restricted to 2 minutes, all aggregation pipeline operations are executed in the background. According to the documentation, there’s a maximum of 30 concurrent federated queries possible. What happens if more queries are submitted? Will they be rejected or queued?

Has anyone employed MongoDB Federation for S3 exports and encountered positive outcomes? I’d appreciate hearing your experiences.

If you hit the query limits you would start seeing errors returned.

We do have limited capacity for increasing the number of connections available to you if you start hitting that limit. Please open up a support ticket if you do and we can take a look.

  • Irwin