MongoDB Data Federation, query, transform and analyze data across AWS S3 and MongoDB Atlas.

What is Atlas Data Federation? It is an incredible distributed query engine that enables seamless querying, transforming, and data migration across various sources inside and outside of Atlas! 

With Atlas Data Federation, we can achieve a wide range of use cases, such as gaining a comprehensive view of our data through querying across multiple Atlas clusters and importing data from AWS S3 buckets into Atlas clusters. By combining various clusters and buckets, we can gain deeper insights into the data we have at hand. 

In this tutorial, we show you how to utilize Atlas Data Federation to merge JSON data stored in your MongoDB Atlas cluster with data in your AWS S3 bucket. Let’s get started!

00:00:00 - Intro
00:00:36 - MongoDB Atlas Setup
00:01:51 - AWS S3 Data Setup
00:02:29 - JSON File Upload in AWS
00:03:19 - Data Federation Setup
00:03:31 - Atlas Data Source Upload
00:04:07 - AWS S3 Data Source Upload
00:05:04 - AWS CLI
00:06:12 - AWS IAM Role
00:08:45 - Querying Our Federated Database
00:10:01 - Aggregation Pipeline 

Pre-reqs: 
MongoDB Atlas: <a target="_blank" rel="noreferrer">https://trymongodb.com/3Lce0Vo</a>
MongoDB Compass: <a target="_blank" rel="noreferrer">https://trymongodb.com/3omSiVJ</a>
AWS: <a target="_blank" rel="noreferrer">https://trymongodb.com/3LcWvEp</a>

More resources:
Article written about this demo: <a target="_blank" rel="noreferrer">https://trymongodb.com/43GwLY7</a>
YouTube video about all things MongoDB Atlas: <a target="_blank" rel="noreferrer">https://trymongodb.com/3BIPLcd</a>
Aggregation pipeline documentation: <a target="_blank" rel="noreferrer">https://trymongodb.com/3mBHtyA</a>
Data federation documentation: <a target="_blank" rel="noreferrer">https://trymongodb.com/3ULNYv3</a>


___
Connect with Anaiya: 
Twitter: @anaiyaraisin
LinkedIn: <a target="_blank" rel="noreferrer">https://www.linkedin.com/in/anaiyaraisinghani/</a>
More of my content: <a target="_blank" rel="noreferrer">https://www.mongodb.com/developer/author/anaiya-raisinghani/</a>

Subscribe to MongoDB  ➡️  <a target="_blank" rel="noreferrer">https://bit.ly/3bpg1Z1</a>

Unlocking the Full Potential of Your Data with MongoDB Atlas Data Federation

Learn how to bring data together from different data sources for a near-real-time view into customer data using the MongoDB Federated Database feature.

Written tutorial → <a target="_blank" rel="noreferrer">https://trymongodb.com/3GAbTru</a>

Subscribe to MongoDB  ➡️  <a target="_blank" rel="noreferrer">https://bit.ly/3bpg1Z1</a>

Data Federation

Videos

All Data Federation Videos

Unlocking the Full Potential of Your Data with MongoDB Atlas Data Federation

Delivering a Near Real-Time Single View into Operations with a Federated Database