10gen will be at OSCON, the Open Source Convention, this week to meet with other open source enthusiasts. Stop by Booth 706 to meet 10gen Engineers and pick up your MongoDB T-Shirt.
Catch talks from 10gen and the MongoDB Community at OSCON this week:
- MongoDB - From Zero to Sharded with Shaun Verch, MongoDB Kernel Engineer, 10gen on Monday, July 22 at 1:30PM in Portland 252.
- Choosing A Shard Key In MongoDB with Shaun Verch, MongoDB Kernel Engineer, 10gen Wednesday, July 24 at 1:40PM in E143.
- Creating a User Journey for Your Open Source Community with Francesca Krihely, MongoDB Community Marketing Manager, 10gen, Thursday July 25 at 2:30PM in E144.
- MongoDB on Amazon Web Services: Operational Best Practices with Charity Majors, Engineer at Parse at 10AM Friday in E145.
Deadline 6: Powered by MongoDB
Thinkbox Software recently announced Deadline 6 , the newest version of their render software, which is powered by MongoDB. Deadline is a render management tool, used heavily in the visual effects, broadcast and architectural industries. Thinkbox’s Deadline team chose MongoDB as their database of choice for its JSON-based document structure and speed at handling connections. A bit of background on render management for those unfamiliar: when making a film, production teams create and render thousands to millions of individual frames for the layers of their shots. Computers process your image data for compositing blue screens, characters or rendering fire, smoke and other special effects. “There are a lot of products that make this happen,” says Chris Bond, founder and CEO of Thinkbox Software. “They all render, control and work differently depending on your OS platform.” In the past, filmmakers or graphic specialists would manually split these jobs up between a number of machines to distribute the amount of data for processing jobs. There are thousands of frames in a shot, and thousands of shots in a movie. Some rendering processes could take 24 hours, while others could take 20 minutes. There wasn't the virtualization platform that could distribute these tasks and manage these processes, so they were typically done manually or executed by scripts. Deadline solves this problem as a management queue for rendering farms. Deadline 6's Monitoring Dashboard Deadline currently supports over 40 applications and operating systems across the board, and breaks up shots and frames into tasks across different machines. Many of this year’s summer movies such as Man of Steel, Iron Man 3, Oblivion, and 300: Rise of an Empire, are made with Deadline 6 and used MongoDB as the backend. The team switched to MongoDB in order to improve create a tool that could run fast while operating on tens of thousands of tasks at a time. Up until Deadline 5, the team was using an XML, file-based storage system which was easy for rapid development, like JSON, and it was schema-less, so they didn't have to worry about tables. “Deadline was designed as a ‘serverless’ architecture.” said Ryan Russell, lead developer on Deadline 6. “Rather than having a central application telling its clients what to do, the clients would go to a central data store, based on the data in there, it would take the next step.” The client would go to the storage location where these "jobs" are housed and would pick up and frame and then pick up another frame. “It was a solid backend for our software, because Deadline could never ’go down’ unless our server hosting that data went down.” But a file-based system is hard to scale and the team needed a way to help Deadline scale and hit higher performance numbers. When searching for a new solution, one of the developers stumbled across CouchDB. “It matched our document-based system, and when we investigated further, the team kept seeing MongoDB come up in searches and blog posts.” For them, the 1 to 1 XML to JSON mapping was a winning feature for both document stores, but to get a better understanding, they decided to build a prototype with each data store to see which one performed better. MongoDB won out in the end. “MongoDB handled hundreds of connections at the same time without any issue. CouchDB had a hard time because of the RESTful API overhead. The improved performance with MongoDB created such a great experience for the end-user. That was a huge thing for us.” Select clients recently went through a 6 month a beta program with Deadline 6, and after using it in production, were amazed at how much faster their system was with MongoDB as the backend. In Deadline, MongoDB functions as a task queue, and controls the management of third party render processes. Each day, a large film set might render over 25-30 Terabytes of data. MongoDB handles the process management of each job and controls the data movement. To the team MongoDB “seems like something we can stand on and scale in many orders of magnitude more than we have before.” Look out for a film powered by Deadline and MongoDB this summer.
MongoDB and AWS: How a decade-old collaboration got even better in 2022
Developers select MongoDB because it makes building with data for almost any class of application easy and fast for them. They select Amazon Web Services (AWS) because it offers a comprehensive and broadly adopted cloud platform, offering more than 200 fully featured services. Bringing together MongoDB Atlas on AWS helps developers build and ship higher quality applications faster and scale them further. MongoDB has collaborated with AWS for close to a decade now, but 2022 has seen dramatic growth in both the quantity and quality of our joint activities, resulting in a strategic collaboration agreement announced earlier this year. Our collaboration spans joint product engineering and integration so MongoDB Atlas is a first-party service on AWS, and also extends to making it easy for customers to procure MongoDB Atlas on AWS. In 2022, we have worked more closely together than ever before. In this post, we'll cover what we've achieved, and how our customers benefit. If at any point you want to stop reading about the partnership and experience it in action, we invite you to get started for free with MongoDB's fully managed, pay-as-you-go listing on the AWS Marketplace . Delivering an outstanding customer experience Since re:Invent 2021, MongoDB and AWS have jointly seen an explosion in customer success, with MongoDB for Startups becoming one of the most widely used offerings in the AWS Activate program after we launched in July. And, since launching in the AWS Marketplace with pay-as-you-go pricing in December 2021, MongoDB Atlas has become one of the most popular self-service listings, with well over 1,000 customers. More broadly, we've seen our AWS Marketplace business show triple-digit growth through significant, mutual investments across engineering, sales, and marketing. We've also found great success working with AWS' Workload Migration and Proof of Concept programs, helping many new customers accelerate their migration to MongoDB Atlas on AWS over the past 12 months. Additionally, while MongoDB works closely with AWS across the globe, we devoted increased attention to Europe this past year, resulting in a considerable increase in customer adoption. As a result, AWS named us their AWS Marketplace Partner of the Year - EMEA in November 2022. One way that we've helped to accelerate such customer success is by making it easier to procure MongoDB Atlas on AWS. Over the past year, MongoDB and AWS have significantly simplified the purchasing experience for customers. We did this across a few key areas. One thing customers love about buying through AWS Marketplace is how seamless it makes the purchasing experience. However, historically this has been slowed somewhat for MongoDB customers by the need to agree to separate legal terms. Starting in November 2022, however, all Atlas on AWS customers purchasing through the AWS Marketplace Self Service listing use AWS Marketplace’s Standard Contract for Marketplace (SCMP) terms and conditions rather than MongoDB Cloud Terms of Service, thereby further reducing friction to getting productive, faster, with MongoDB. Close product collaboration Behind these improvements to our joint purchasing experience were significant improvements to how MongoDB Atlas integrates with key AWS services. MongoDB has long worked seamlessly with core AWS services such as Amazon Elastic Compute Cloud (Amazon EC2) and Amazon Simple Storage Service (Amazon S3), and more recently has collaborated with AWS to ensure tight integration with AWS container services like Amazon Elastic Kubernetes Service (Amazon EKS) and Amazon Elastic Container Service (Amazon ECS), AWS serverless technologies like AWS Lambda, Amazon Eventbridge, and AWS Fargate; and edge computing services like AWS Wavelength . Over the past year, however, we've delved more deeply into AWS machine learning services (Amazon Comprehend, Amazon Kendra, Amazon Lex, etc.), AWS AppSync, Amazon Forecast, AWS Elastic Beanstalk, and more. In addition to direct integrations with AWS services, we made it simpler for customers to use MongoDB with important joint partners such as Datadog, Databricks, and Confluent. For Datadog, we improved MongoDB Atlas App Service to support forwarding logs on AWS to Datadog, thereby improving observability through real-time log analytics. With Databricks, we announced MongoDB as a data source within a Databricks notebook, thereby offering data practitioners an easier, more curated experience for connecting Databricks to MongoDB Atlas data. And with Confluent, we strengthened our integrations to help developers easily build robust, reactive data pipelines that stream events between applications and services in real time. Through innovations to the purchasing process and the product experience, we've helped make thousands of customers successful running MongoDB on AWS. Some joint customers, like Unqork , are upending entire industries with innovative approaches to technology and business. Others, like Volvo's Connected Solutions business , rely on MongoDB and AWS to scale their fleet management solution from tens of millions to billions of daily events. Other recent customers include Verizon , Marsello , GLS , and Shopline . Get started with MongoDB Atlas on AWS You needn't take our word for it, however. With just a few clicks — and no risk — you can get started for free with MongoDB Atlas on AWS . There's no upfront commitment, and if you choose to continue to build with MongoDB on AWS, you only pay for what you use.