10 Things We Learned at MongoDB World 2022
When you return to a normal routine after a long break, you find out how much you miss your old routine. After hosting MongoDB World remotely for two years, we were happy to get back to seeing people in person — almost 3,000 of them. Here’s a quick rundown of the top 10 things we learned at MongoDB World 2022. 1. Queryable Encryption was a hit How many times have you been to a concert and the opening act winds up being as good as the band you actually went to see? Queryable Encryption was like that at MongoDB World 2022. While a lot of attendees came to learn about MongoDB Atlas Search or Atlas Serverless Databases , they were equally intrigued by the ability to encrypt data in use and perform rich, expressive queries on encrypted data. This groundbreaking innovation is the result of a collaborative effort between Brown University cryptographer Seny Kamara, his longtime collaborator Tarik Moataz, and MongoDB. 2. Developers are in the driver's seat Starting with the opening keynote by MongoDB CEO Dev Ittycheria, MongoDB World reinforced the notion that developers are the key to the future success and productivity for today’s organizations. “Every product we build, every feature we develop, is all geared toward developer productivity,” Ittycheria said. In fact the entire event centered on powerful new tools that are now available in our developer data platform. In the Partner Promenade, dozens of vendors showed how they’re helping developers become faster and more productive. As Søren Bramer Schmidt, chief architect and founder of Prisma, explained, “New generations of developers are much bigger, and we can invest in better tooling for them. It’s an exciting time to be building tools for developers.” As the world increasingly goes digital, developers will be the key to companies’ success. Services, products, and advancements are inherently tied to the ability of developers to quickly build, iterate, and release. 3. Everyone's data is in motion The volume of data moving to the cloud is unprecedented. In a session titled “Connecting Distributed Data to MongoDB With Confluent,” Joseph Morais, cloud partner solutions architect for Confluent , cited a study that predicted 75% of all databases would be on a cloud platform by 2022. MongoDB senior vice president of product management, Andrew Davidson, said, “MongoDB has really broken through with the MongoDB Relational Migrator at the perfect time, since so many enterprises are accelerating their efforts to get off legacy relational databases and legacy on-premises estates to move to MongoDB Atlas.” 4. Public cloud security is not as easy as some people think While scores of businesses are increasing their cloud footprints with new cloud-native services and applications, securing them is becoming increasingly complex. Steve Walsh, senior solutions architect at MongoDB, gave a session titled “Securing Your Application's Data in the Public Cloud” and cited constantly changing cloud deployments and security policies in multi-cloud environments as reasons why security can be three times more complex in a multi-cloud environment. According to an ITRC study that Walsh cited, failure to configure cloud settings properly caused 30% of data breaches in 2021. MongoDB Atlas is designed to be secure by default , which simplifies the process of restricting access to sensitive data. 5. Ray Kurzweil might be even more prescient than he realizes On Day 3 of MongoDB World 2022, best-selling author, pioneering inventor, and futurist Ray Kurzweil delivered a wide-ranging keynote address covering everything from computational power to vaccine trials to life expectancy and literacy rates. In the address, Kurzweil said it was likely that an AI would pass a Turing test by 2029. Just days later, news reports came out about a Google engineer who’d been fired after claiming that an artificial-intelligence chatbot the company developed had become sentient , though the company dismissed the claims. 6. Attendees were eager to try MongoDB It’s easy to assume that everyone who came to MongoDB World was already using it and wanted to know about new features and capabilities. But in the Learn Booth at the event, plenty of visitors weren't using MongoDB at all — they were there to discover and evaluate. In the Ask the Experts booth, roughly one in 10 people asked about how to prepare to migrate to MongoDB. One of the most common questions we heard was, "How do I convert relational schemas to the document model?" We have tools like Relational Migrator to help with that. We also recommend training for developer and ops teams, including our MongoDB for SQL Pros university course and our Developer-Led Training programs to ramp them up on what makes MongoDB different from SQL. 7. Developer friction comes in many forms The opening keynote address and product announcements set the stage for many of the conversations we had over the next few days. We consistently heard from developers about the friction points that we could help eliminate for them, and how reducing developer friction results in real benefits — apps and services get launched that could not have existed otherwise because of the toll that complexity takes on development teams’ bandwidth. Atlas Serverless databases are going to be a big part of getting those new services off the ground because it’s one less thing developers have to worry about. And the MongoDB CLI allows developers to interact with our services using the method they’re familiar with — especially advanced developers who prefer control and speed over a more visual interface. 8. @MarkLovesTech draws the crowds MongoDB CTO Mark Porter was the center of the action at the event. Wherever he went, a crowd would gather, eager to meet, exchange thoughts, and ask questions. His talks during the Builder’s Fest were standing room only. Mark Porter delivers a short talk on scaling and managing teams at MongoDB World 2022. Photo by Eoin Brazil. 9. Every software company needs custom track jackets Our field marketing team knocked it out of the park with the custom track jacket. After MongoDB CEO Dev Ittycheria debuted the jacket during the Day 1 keynote , it immediately became the most desired piece of swag of the show. A few lucky contestants won their own track jackets during the Builder’s Fest. Developers are either highly fashion-conscious or avid joggers. 10. There's no replacement for in-person gatherings For almost three years, we’ve been getting by with remote events and Zoom calls, but we learned at least two more things from MongoDB World 2022: There’s no replacement for real-life, in-person experiences, and remote interactions actually require a different set of skills. “It is not impossible to talk with people on Zoom. But it requires so much more intentionality,” Mark Porter said. “My takeaway from MongoDB World is making sure that in this new hybrid world, we can talk with people! But even on Zoom, we must become much more focused on the intentionality of talking with them because it is so much different."
Highlights From MongoDB World 2022, Day 3
As we said on Day 1 , MongoDB World is a developer-focused event. And on Day 3, we really set out to prove it. The day got going with a keynote from best-selling author, pioneering inventor, and futurist Ray Kurzweil. His encyclopedic knowledge covers a wide range of topics and subject areas, and his talk was equally broad and freewheeling, touching on everything from computational power to vaccine trials to life expectancy and literacy rates. Kurzweil’s general viewpoint was overwhelmingly positive. He cited global poverty and literacy rates, per capita income, and the spread of democracy as examples of how the world is steadily becoming a better place to live. Not shy of making predictions, Kurzweil anticipates computational power roughly doubling each year, bringing AI ever closer to emulating human intelligence. In fact, he predicts that some AI systems will be able to pass the Turing test by 2029. And he sees humans eventually connecting directly to AI systems, expanding our emotional and intellectual intelligence far beyond our current state. He refers to this eventuality as the “ singularity ” and with it, human life will be changed forever. Minds were blown, but not so much that the developers in attendance weren’t ready to get down to doing what they love to do: building apps and writing code. Immediately after the keynote, Builder’s Fest kicked into gear in the Partner Promenade. The floor of the Jacob Javits Center was transformed by dozens of pods where MongoDB experts, partners, and customers gave hands-on tutorials showing how their services and applications integrated with the MongoDB developer data platform. Booming over the main sound system was a super-sized, four-person Mario Kart battle royale, where the victors won prizes like a Nintendo Switch. Another pod hosted a Price is Right–style game show, The Database is Right, where contestants drawn from the audience answered trivia questions about MongoDB, document databases, and database functions. Adjacent to the Bob Barker cosplay, MongoDB senior product manager Rob Walters gave an eager audience a live demo of how to configure the MongoDB Connector for Apache Kafka to use MongoDB as a source or a sink. Our Kafka connector enables developers to build robust, reactive data pipelines that stream events between applications and services in real time. Over on the Google Cloud Coding Stage, four developers competed to see who could build the closest version of the Google homepage in 20 minutes — without previewing their work. The blind coding test resulted in some fairly primitive approximations of the real thing, but all four contestants were praised for their high pressure creations. The winner of each round took home a limited edition MongoDB track jacket. MongoDB CTO Mark Porter joined in a number of Builder’s Fest activities, delivered several short talks, and often drew a crowd for impromptu Q&A. At one point he gave a “Chaos Presentation” — an improvised talk guided by randomly selected imagery — about the outages that inevitably occur in the public cloud, despite the exceptionally resilient infrastructures and high service levels. “Mirror image is an illusion,” Porter said. “A laptop is not staging, staging is not production, and production is not production.” Different regions have different hardware and configuration patterns that can build up over time, he said. “Staging has had far more rollbacks than production,” he said. “Find weaknesses in your architecture by doing post-mortems after an outage. Make staging environments reproducible by blowing them away from time to time. By making staging more predictable, over the course of a few years, you can make production more predictable.” In response to an audience question about what’s more important, implementing a culture of committing to rollbacks or automating it, he said, “The culture of rollbacks is what’s important, but at scale — meaning a couple thousand engineers — culture won’t be enough. You’ll need to automate some of it. But make it so rollbacks are not a bad thing.” A few pods over, developer advocate from Prisma , Sabine Adams, gave a talk entitled, “Giving MongoDB Guardrails.” His talk included step-by-step instructions, using the brand new MongoDB Atlas CLI , on how to ensure data consistency by providing an easy-to-read schema and a type-safe database client. First, he set up a MongoDB cluster in the CLI, then he initialized a TypeScript project with Prisma to model the data, and then used the Prisma CLI to create and retrieve some data. The Prisma client provides an API for reading data in MongoDB, including filters, pagination, ordering, and relational queries for embedded documents. If you want more highlights about MongoDB World 2022, read our Day One and Day Two recaps. For all those who attended the event, we’re happy you made it. For anyone who missed it, we hope to see you at next year's event.
Highlights From MongoDB World 2022, Day 2
Day Two of MongoDB World 2022 was all about the breakout sessions — more than 80 were on tap for the day. Things kicked off shortly after 8 a.m. with a discussion on empowering women and other underrepresented groups in the workplace, held in the IDEA Lounge . The 9 a.m. slot was packed with 10 sessions that ranged from building a sustainable ecosystem to the principles of data modeling to using Rust to build applications. Steve Westgarth, senior director of engineering at GSK (formerly GlaxoSmithKline) dove into the weighty topic of morality in the digital world and what developers ought to do when the software they build leads to unintended consequences. All too often, there’s immense pressure to release MVPs early — before all potential vulnerabilities have been vetted. Westgarth’s session sprang from a rhetorical question: “Do we as engineers have an ethical and moral responsibility to anticipate unintended consequences and how much personal responsibility should an individual take to ensure ethical management of data?” His discussion answered that with a Yes — developers do have to weigh the risk of unintended consequences, such as data breaches, versus the desire to maximize market opportunity. Westgarth urged developers to ask themselves what the unintended consequences are of the software they have in production, and to raise awareness of these issues in their organizations. A 15-minute lightning talk followed, with a session name that made it a popular draw for fans of worst-case scenarios: “Strange Cases From the Field.” Adam Schwartz, MongoDB director of technical services in EMEA, walked attendees through some especially challenging real-life technical support stories. He gave a detailed account of such curious cases as The Mistaken Hypotheses and The Unsuccessful Mitigations, and shared lessons he learned during years in the trenches as a support specialist. Closing on a positive note, he assured attendees that problem cases are rare, most cases have straightforward solutions, and exceptional cases are always a learning experience. Day One saw Mark Porter announce the MongoDB Relational Migrator , including a live demo of the product. On Day Two, lead product manager Tom Hollander did a deep dive into use cases, justifications, and future capabilities for the tool. MongoDB Relational Migrator imports and analyzes relational database schemas, maps them to an appropriate MongoDB schema, and transforms and migrates the data into MongoDB. Hollander said organizations can experience a 3x to 5x increase in development velocity and up to 70% in cost reductions by migrating away from relational models in favor of a more modern deployment such as MongoDB Atlas . Hollander said he anticipates future capabilities to include continuous replication, Kafka integration, application code generation, schema recommendations, and more. One company thriving in its legacy modernization efforts is Vodafone. The global head of engineering and transformation, Felipe Canedo, described Vodafone’s transition from a traditional telecommunications company to a Telco-as-a-Service (TaaS) provider. At the core of this transition was the creation of a scalable and open platform for the company’s engineers to innovate with complete freedom and flexibility. Canedo said Vodafone chose MongoDB because of its security, cloud-native high availability, support for multi-region and multi-cloud deployments, agile delivery, professional services, and ease of integration. The ultimate goal, Canedo said, was to provide Vodafone engineers with the best software experience possible. Day One also saw MongoDB CPO Sahir Azam announce the general availability of MongoDB Atlas serverless instances . On Day Two, MongoDB advisory solutions architect Carlos Castro gave a live demo of deploying a serverless database. In 15 minutes, starting from the Atlas dashboard, Castro took the audience step-by-step through the process of selecting a cloud provider, spinning up the instance, creating an app service, authentication, and users, and then setting up rules to allow users to access data on the instance. Serverless instances always run the latest version of Atlas, include always-on security, and enable customers to only pay for operations they run. Day Two also featured several discussions with leading experts and MongoDB partners. MongoDB senior vice president, product management, Andrew Davidson hosted a panel with three leaders in the effort to close the Developer Experience Gap : Peggy Rayzis, senior director of developer experience for Apollo GraphQL; Lee Robinson, director of developer relations for Vercel; and Søren Bramer Schmidt, chief architect and founder for Prisma. Rayzis cited Apollo’s supergraph as one way it's helping developers be more productive by unlocking their flow state. “When you’re in that flow state, you’re writing better code, making better decisions, and developing better value for consumers,” she said. Schmidt pointed out how the newest generation of developers stand to benefit the most from the proliferation of developer tools. “New generations of developers are much bigger and we can invest in better tooling for them,” Schmidt said. “It’s an exciting time to be building tools for developers.” Lee emphasized the important role the open source community plays in these tools. “People hear about Vercel through Next.js,” Lee said, “and we invest to give back to the open source community.” As gratifying and fun the first two days of World were, we really have something special in store for Day Three. It kicks off with a final keynote address by best-selling author, pioneering inventor, and futurist Ray Kurzweil. Day Three also features our Builder’s Fest , where even MongoDB CTO Mark Porter is expected to lend his considerable expertise to a few promising projects. With live game shows, chaos presentations, nerd battles and more, MongoDB World 2022 will finish on a high note. Check back tomorrow for more highlights from MongoDB World 2022.
Highlights from MongoDB World 2022, Day 1
MongoDB World is back in person at New York’s Jacob Javits Center after a three-year hiatus. Day One featured a jam-packed schedule of educational sessions, live tutorials, customer stories, and product announcements for a crowd of nearly 2,700 developers and IT professionals. The developer-focused conference got off to an early start with breakout sessions beginning at 8 a.m. Three sessions were on tap: an introduction to data modeling with MongoDB, a primer on MongoDB Atlas Search , and a tutorial on getting started with MongoDB Atlas . In that tutorial, MongoDB solution architect Tom Gleitsmann explained how, out of all the challenges developers face on a daily basis, the common denominator is friction. Gleitsmann gave a crisp and informative summary of MongoDB Atlas features that were engineered specifically to reduce the amount of friction developers face, including ease of deployment, security by default, data visualization, the Performance Advisor , alerts, and backup scheduling, to name a few. The early-morning sessions were followed by a keynote delivered by MongoDB CEO Dev Ittycheria and Chief Product Officer Sahir Azam celebrating the company’s rapid growth, setting out a vision for its future, and highlighting several of its customers. The executives were joined on stage by Vercel founder and CEO Guillermo Rauch, Wells Fargo head of digital enablement Catherine Li, Avalara VP of software engineering John Jemseck, and several MongoDB product experts, each providing insight into the latest enhancements to MongoDB. The biggest reveal, though, was a new vision for MongoDB Atlas and the products that work seamlessly with it, such as Atlas Search and Atlas Data Federation . “We believe that developers want to build on a modern data model that's designed to the way they think and the way they code,” Ittycheria said. “And we also believe that developers want an elegant developer experience that makes their lives so much easier. And they want all this in one unified platform. What they need is a developer data platform.” After the morning keynote, sessions ran back-to-back until lunch. They ranged from quick, 15-minute “chalk talks” to hour-plus deep dives. In one, MongoDB software engineer James Wang gave a hands-on tutorial on using our data visualization tool, MongoDB Atlas Charts , which is fully integrated with MongoDB Atlas. Wang showed how easy it is to link data sources in just a few clicks. Using a fictitious company, he demonstrated step-by-step how to embed data visualization via code snippets and an SDK, share the data with others using a public link, filter data inside the admin web page, and restrict access to authorized users. Attendees followed along on their own laptops and were quickly able to replicate the visualizations. In another talk, Keller Williams’ senior architect Jim McClarty shared some of the real-world impact of Atlas — how it has accelerated the real estate firm’s ability to innovate its applications, how essential Atlas Search is in their applications, and how Charts has become “the best hidden feature in Atlas.” Attendees shuttled from room to room like they had places to go and people to meet, which they did. MongoDB principal, industry solutions, Felix Reichenback took attendees through mobile sync and why developers often waste tons of time trying to build their own sync tool that fails to handle conflict resolution because of the intermittent nature of mobile connections. Next, Michael van der Haven, VP at consulting giant CGI and expert in cloud-native platforms, explained how he helped the energy industry’s open source architecture group, OSDU, migrate away from Elasticsearch, simplify its architecture by removing memory-intensive indexes, and reduce OPEX by six figures using MongoDB Atlas. After lunch, MongoDB CTO Mark Porter gave an energetic keynote, announcing several more new products and features, including the new MongoDB Atlas CLI , the general availability of the Data API , and, perhaps our biggest announcement of the day, Queryable Encryption , which allows users to search their databases while sensitive data stays encrypted. Available in preview, Queryable Encryption offers a big step forward in protecting sensitive data. Porter gave personal anecdotes illustrating many of the hurdles developers have to overcome that have nothing to do with building software, such as rigid and fragile relational databases, and working with SQL, a language that developers early in their careers or fresh out of school have no desire to work with. Porter’s keynote address included a live demo of the Relational Migrator, which, while risky to perform in front of an audience, went off flawlessly. Meanwhile, a series of events kept the IDEA Lounge a lively place, including a great panel discussion called Our Journey: Being Black in Tech. And a floor below the workshops, more than a dozen MongoDB partners demonstrated their platforms and related products — including many of the companies named MongoDB Partners of the Year . The schedule for Day 2 is equally packed, with more than 80 sessions that include partner showcases, strange cases from the field, book club sessions, more deep dives into product announcements and tutorials, and talks on diversity, equity, and inclusion. In the afternoon, MongoDB celebrates Pride with food, drinks, and entertainment at the historic Stonewall Inn. And MongoDB World 2022’s biggest event happens at the end of the day — “The Party,” featuring music from The Midnight and Don Diablo, as well as retro arcade games and an open bar. Check back tomorrow for more highlights from MongoDB World 2022.
The Developer Data Platform: Highlights from MongoDB World 2022 Keynotes
MongoDB World 2022 is the first in-person MongoDB conference in nearly three years, offering us an opportunity to announce new releases and outline the future of MongoDB. During three World keynotes on June 7, the company’s leaders discussed our vision for the company and our products — and how they form a developer data platform, a family of tools and services built around a common API to help developers reduce complexity, improve their experience, achieve operational excellence, and run deep analytics. The inspiration for this concept originated from the desire to empower developers to build and scale applications faster, thus transforming their organizations and businesses. As Dev Ittycheria has discovered over the course of his eight years as CEO, “No customer has complained about innovating too quickly.” “What they have complained about — and what they struggle with — is increasing their pace of innovation,” Ittycheria says. “Invariably, the thing that holds them back is their legacy, brittle, inflexible architecture and infrastructure.” Why developers? From the beginning, MongoDB was built by — and for — developers, a category that includes anyone who creates or works with applications, as well as those who lead them. “Every product we build, every feature we develop — is all geared towards developer productivity,” Ittycheria says. “The obvious question,” Ittycheria continues, “is how do you make developers insanely fast and productive?” Given that developers spend so much time troubleshooting data, the answer lay in removing the friction inherent to this process. That’s why MongoDB was built on the document model, which maps data to objects in code — transforming the way developers organized and interacted with data. We believed in the potential of the document model so strongly that we built our entire product family around it, streamlining the developer data experience and facilitating all data-related tasks and products, from search to analytics. Additionally, the world continues to digitize, a trend that was only accelerated by the COVID-19 pandemic and the ensuing lockdowns. “There will be 750 million new digital apps by 2025,” Ittycheria says, citing a study from analyst firm IDC. CTO Mark Porter agrees. “There will be more applications built over the next four years than were built in the first 40 years,” he says. “The pace of innovation is increasing, and that means developer productivity is essential.” To get ahead of these trends, Ittycheria says, MongoDB is doubling down on research and development — as well as empowering innovators to create, transform, and disrupt industries by unleashing the power of software and data. The struggles of a developer The root causes of many developer difficulties can be summed up in two parts: an obsolete, decades-old technology (the relational data model) and the complications that arise from its fundamental mismatch with modern applications. “Relational databases were not scalable,” Porter says, recalling his time as a developer. “No matter how hard I tried, we couldn’t make them available, and no matter what we did, we couldn’t make SQL and RMS easy to use.” In essence, the limitations of relational databases are becoming very clear, Ittycheria adds. “They’re too rigid, too inflexible, too cumbersome, and just don’t scale.” As a result, “there’s been a proliferation of niche databases — which are focused on some small point solution — to compensate.” In fact, these narrow, specialized products (such as key-value or in-memory databases) often add cost and complexity. Combining these disparate products into a single architecture can impede innovation by siloing data, fragmenting application infrastructure, and further confusing workflows. This also creates a training gap — slowing down developers as they spend valuable time learning the ins and outs of each product. A typical data architecture, with a number of specialized databases adding complexity. A better way to work with data “We obsess about helping you get from an idea to a global reality,” says Sahir Azam, MongoDB’s chief product officer. The result of that obsession is MongoDB Atlas, our developer data platform, which reflects that obsession in three key ways. First, MongoDB offers an elegant developer experience. By getting the data, plumbing, and complexity out of the way, MongoDB enables users to “focus on innovating and building the differentiation for their companies and ideas,” Azam says. As a result, developers no longer have to create or run unwieldy, bespoke architectures for each new product or application. Next, Atlas enables broad workload support, providing, in Azam’s words, “most, if not all, of the capabilities you need for demanding modern applications” — whether they’re operational, analytical, or transactional. This includes abilities like application search, data lake, and aggregation pipelines, to name a few. Lastly, Atlas is resilient, scalable, stable, and secure, “so you can take an idea from a single geography to serving customers worldwide,” Azam says. When combined with the ease of use and versatility of the document model, the Atlas product family presents a uniquely valuable proposition for many developers. In order to build the future, developers need a mission-critical foundation. “Applications have always needed a solid foundation — from silicon to chips,” Porter says. If “someone at the lower level misses a configuration file, someone at the lower level messes something up, and everything comes crashing down.” Ultimately, the strength of MongoDB is that it frees up the developer to play to their strengths — building new products and applications, and not wrangling existing components. By providing documents and a flexible schema, high availability and scalability, and seamless partner integration, MongoDB helps become the mission-critical foundation for developers to build upon. “Just a database isn’t enough,” Porter says. For you to succeed, “there’s an actual, existential need to have this foundation. And we call it our developer data platform.” How far we've come Today, MongoDB is the world’s most popular data platform for building modern applications, Ittycheria says. The numbers back up this statement, with over 265 million downloads of MongoDB’s Community Edition, upwards of 150,000 new Atlas registrations per month, and more downloads in the past twelve months than in the first 12 years of MongoDB’s existence. Further, MongoDB has greatly expanded its global reach. From a humble beginning of four regions in AWS, MongoDB Atlas now runs in 95+ regions worldwide in AWS, Google Cloud, and Azure. MongoDB has also partnered with other cloud providers around the world. MongoDB’s core mission remains the same, even as our user base has expanded to 35,000+ customers across every industry and use case, as well as 100+ nations. MongoDB continues to simplify the developer experience, streamline the release process, speed up innovation, and help organizations ship faster. “Every week, we see new ideas spring up across the globe,” Azam says, many of which are powered by MongoDB. These organizations, which range from small startups to large corporations, include a digital-only challenger bank in Vietnam, a startup providing simulation training for Norwegian healthcare professionals, and a nonprofit that deals with surplus food from restaurants across Mexico. A serverless, mission-critical foundation MongoDB’s goal is to make Atlas the data platform for developers, empowering them to build the applications of the future. To achieve this objective, MongoDB is going serverless. “Modern development, in many ways, has been a constant search for higher levels of abstraction,” Azam points out, which removes complexity, and enables developers to move faster, differentiate, and pivot as needed. By going serverless, Atlas will minimize operational overhead down to almost zero, shifting the burden of servers, data centers, and provisioning away from developers. Further, Azam points out that many existing serverless databases “pose some significant limitations.” For instance, one popular type of serverless database is the key-value store, an ultra-simple database that cannot sustain complex workloads — and forces developers to add more databases in order to support additional application functionality. Instead, Atlas serverless combines all the best characteristics of serverless with the complete MongoDB experience — including the versatility of the rich document model, transactional guarantees, rich aggregations, and much more. This way, “we can support the full breadth of use cases you’re used to building on our platform,” Azam says. Unlike other serverless products, Atlas serverless instances also offer a competitive pricing model. Currently, “most serverless databases force a hard trade-off” when it comes to scaling, Azam says, requiring users to either deal with cold start delays when ramping up their serverless databases from zero, or pay extra (and pre-provision capacity) in order to scale quickly up from zero. In contrast, Atlas serverless enables users to “scale down to minimal usage and instantly scale up as your application needs — without any pre-committed capacity,” Azam says. Coupled with competitive pricing, flexibility for development and deployment, and instant scaling, Atlas serverless instances bring all of the advantages of serverless — without any of the downsides. What MongoDB can do for developers In essence, MongoDB will enable users to do their best work in four key ways. Reduce complexity Complicated application architectures, alongside an abundance of point solutions, force developers to spend more time and effort on operational “plumbing,” distracting them from their core mission of transformation through innovation. Using the MongoDB Atlas developer data platform, developers can, in Azam’s words, “remove complexity and the need for more niche databases in your architecture.”These features include MongoDB Atlas Search, for a purpose-built search solution, and Atlas Device Sync, for ensuring data consistency between edge, cloud, and backend.” Read our blog on reducing complexity to learn more . Provide a better developer experience “If you remove the friction from working with data,” Ittycheria says, “you make developers insanely productive.” An elegant developer experience “makes lives so much easier.” This is achieved through superior tooling and integration between MongoDB features, such as Atlas serverless instances, which abstract away considerations like provisioning and scaling, or the Atlas CLI, which packs the power and functionality of a GUI into the simplicity of a command line. Read our blog on the developer experience gap to learn more . Application analytics As businesses continue to digitize, their need to collect information for real-time analytics has only grown. To address this need, Atlas has added real-time application analytics abilities into its unified platform, Azam says. This means supporting analytical queries (and not just transactions), as well as making this data easily available for deep analysis and strategic decision making. This category includes Atlas Charts for rich data visualizations, and the Atlas SQL Interface for both connecting third party SQL-based analytics tools to Atlas. Read our blog on new analytics features to learn more . Operational excellence “We do this all with a strong foundation of resiliency, security, and scale,” Azam says. This means automating core operational processes to deploy and run global data infrastructure, plus simplifying complex procedures such as data secrecy, migrations, and cross-environment sync. Related features include the Atlas Operator for Kubernetes, which allows developers to deploy, scale, and manage Atlas clusters using Kubernetes, or our pioneering Queryable Encryption, a cryptographically secure, operationally efficient solution for working with sensitive data. Read our blog on new features to improve security and operations to learn more . Building the future — with MongoDB “But we’re not done yet — and neither are you,” Ittycheria says. “Tomorrow, we will help support newer and more inspiring applications. Just imagine what we’ll do tomorrow.” “We have 150,000 new ideas coming in every month,” Azam says. “I challenge you to think about how to transform your organization — how to take your next big idea to a global reality.” “What I’d like to challenge you to do is to grab your share of those 765 million apps,” Porter says. “Think about how you can change the world — and hopefully do it on our platform.... I am sure that the future is going to be built by you.”
Congratulations to the 2022 Innovation Award Winners
I just got off stage at MongoDB World, where I had the honor of announcing 15 winners of the ninth annual MongoDB Innovation Awards. The MongoDB Innovation Awards honor projects and people who dream big. They celebrate the groundbreaking use of data to build compelling applications and the creativity of professionals expanding the limits of technology with MongoDB. This year, we received applications from a diverse range of organizations, from emerging startups to industry-leading global enterprises, across a wide variety of industries. We are delighted to announce the winners below. 2022 MongoDB Innovation Award Winners Customer-First and Innovator of the Year Award: BEES Anheuser-Busch InBev (AB InBev), home to several of the world’s most recognizable beer brands, chose MongoDB Atlas as the primary database for its proprietary B2B platform, BEES. The platform digitizes AB InBev’s relationship with its customers, offering convenience, seamless communication, and most important, enhanced business performance. Putting customers first has helped BEES grow to a network of 2.7 million monthly active users across 17 markets, process over 23 million orders, and capture more than $6.5 billion in gross merchandise value during the first quarter of 2022. Data for Good Award: Memorial Sloan Kettering Cancer Center Memorial Sloan Kettering Cancer Center (MSKCC) is a world-renowned, state-of-the-art cancer facility. According to US News & World Report, MSKCC has been ranked as one of the top two hospitals for cancer care in the country for more than 30 years, and among the nation's top pediatric hospitals for cancer care. MSKCC's Department of Pathology plays a pivotal role in diagnosing the type of cancer affecting a patient, which in turn helps providers determine possible treatments. MPath, an advanced software ecosystem developed in-house, is built on MongoDB and supports digital review and reporting of over three dozen Molecular Pathology diagnostic tests. To date, MPath has provided digital review and reporting for over 200,000 molecular diagnostic tests. From Batch to Real-Time Award: AT&T To build its next-generation AI-based fraud-detection platform, AT&T quickly discovered that relational technology would not be able to scale and support their application’s needs and requirements. Given their desire for a flexible data model, AT&T turned to MongoDB Atlas, which has decreased their time to market and improved their query response times. As part of an overall modernization effort to enhance an already robust AI environment, MongoDB Atlas will improve performance and further AT&T’s efforts for real-time fraud detection. MongoDB Atlas is also being extended to include the AT&T Feature Store for data modeling. Front Line Heroes Award: Sogei Sogei is an in-house company of the Italian Ministry of Economy and Finances, spearheading public sector digital transformation in Italy. Impressed by the flexibility and performance of MongoDB’s data platform technology, they leveraged MongoDB’s document model to develop and bring to market Italy's official COVID-19 vaccination passport app — in less than 45 days. The "Green Pass" project has generated over 230 million digital certificates to date, helping Italians easily provide vaccination requirements for cultural and sporting events, long-distance travel, nightlife, and indoor dining during the pandemic. Going Global Award: Auth0 Auth0, a product unit within Okta, is an Identity-as-a-Service platform that eliminates the complexity of implementing authentication and authorization capabilities. Looking to further prioritize reliability and security, Auth0 recently migrated its Public Cloud platform from self-hosted MongoDB to MongoDB Atlas to help power billions of authentications per month. This move helps Auth0 scale at a faster pace, allowing them to deliver services to an ever-growing number of customers. Additionally, foundational operations tasks that used to take several weeks can now be completed in hours, enabling Auth(0) to deliver services faster and more reliably to their customers. Huge Impact Award: Cisco Systems Cisco is best known for its enterprise networking gear, but the tech giant is also a major player in the cybersecurity market, the part of its business that’s leading the transformation to an “Everything-as-a-Service” model. Cisco Secure has been on a multi-year journey to fundamentally change the way enterprises think about security by developing its integrated, cloud-native SecureX platform. An integral component of the platform, SecureX Orchestration allows customers to orchestrate critical security workflows using a no/low-code drag-and-drop interface, and helps SecOps, ITOps, and NetOps teams save critical working hours. By migrating to MongoDB Atlas, the SecureX Orchestration team has reaped benefits such as increased scalability, decreased architectural complexity, improved reliability, and lower total cost of ownership. Industry Transformation Award: Corva With an increasing focus on reducing worldwide greenhouse gas emissions, Corva's technologies play a crucial role in helping the energy industry meet its sustainability objectives. Corva's proven technologies, infrastructure, and deep industry knowledge, combined with the power of MongoDB Atlas, have put it on an unbeatable path to creating a sustainability platform that will transform the industry's journey to net-zero carbon emissions. By leveraging a centralized dataset of emissions, Corva has plans to automate greenhouse gas monitoring, analysis, and benchmarking; monitor real-time energy consumption and emissions; and build applications to raise carbon awareness. Operational Resilience at Scale Award: Wells Fargo Wells Fargo is a leading financial services company offering a diversified set of banking, investment, and mortgage products and services, as well as consumer and commercial finance. Tempest is a data fabric built to improve the digital customer experience by providing continuous availability and responsiveness even when portions of the bank's infrastructure are experiencing availability interruptions. This data fabric serves Wells Fargo’s 30 million-plus digital retail customers. Savvy Startup Award: Pioneera The World Health Organization now recognizes burnout as an occupational phenomenon — and there has never been a greater need for a solution. Pioneera is combining psychology and technology to prevent and redress toxic workplace issues, starting with the crippling and insidious issue of workplace burnout. Indie, Pioneera's "Grammarly for Mental Health," helps large and small companies reduce burnout and improve engagement, productivity, and collaboration. Founded and based in Australia, Pioneera uses MongoDB to help it scale globally. Unbound Award: Cue Health Cue Health is a healthcare technology company that makes it easy for individuals to access health information and places diagnostic information at the center of care. Their revolutionary new device, the Cue Health Monitoring System, paired with their COVID-19 test, is the first at-home COVID-19 test available over the counter without a prescription, and it is used by the NBA, Johnson & Johnson, and the Mayo Clinic. The company chose MongoDB Atlas, Search, and Atlas Device Sync to power its mobile application, mobile database, and synchronization, enabling consumers to receive data from their Cue devices on their smartphones and securely store it in the cloud. Cue Health is planning on leveraging MongoDB to launch additional tests such as respiratory, women's and men's health, fertility, and more. Cutting Edge Award: Goldman Sachs Goldman Sachs is a leading global financial institution that serves a diversified client base of corporations, financial institutions, governments and individuals and holds offices in major financial centers worldwide. Over the past 10 years, MongoDB and Goldman Sachs have had a strong engineering collaboration. Together, we have worked to ensure that MongoDB Core Server and Atlas have product capabilities that enable their use in regulated environments, without compromising the developer experience. Goldman Sachs expanded its utilization of Atlas in FY'22, growing both existing and new Consumer and Transaction Banking use cases across the firm; their utilization of cloud solutions and their forward-thinking, cloud-based approach to deploying next generation banking applications represents a cutting edge approach and serves as a model for the financial services industry. Judges' Choice Award: Getir Ultrafast grocery delivery pioneer Getir has revolutionized last-mile grocery delivery with its 10-minute grocery delivery proposition, making thousands of everyday items available within minutes. The company originally built its core grocery delivery platform on MongoDB Community and migrated to MongoDB Atlas. Getir achieved superior performance and reliability, regardless of spikes in traffic during the COVID-19 pandemic, and also relied on Atlas's always-on, multi-region clusters for 99.995% uptime during its critical U.S. launch. Getir utilizes almost 350 clusters, deployed across projects to cover each aspect of its product, with a microservices architecture to create incredible resilience across global markets and time zones. In the past 12 months, Getir has scaled successfully across geographies with minimal downtime due to this approach. Seamless Migration Award: Truist Banks struggle to keep up with the digital natives and neobanks, but Truist's Consumer Tech organization is striving to set an example of how major banks can compete in the digital world. In order for their Client Availability Layer platform, or CAL, to consolidate terabytes of customer data from the heritage system of records into a highly available and scalable operational data layer from scratch to provide uptime to digital applications, the platform required modern technology for support. Truist decided to implement MongoDB on AWS Outpost as a resilient and secure option to align to the maturing cloud strategy at the bank, which has allowed CAL to support new, complex digital banking needs. Certified Professional of the Year Award: Mohit Talniya Mohit Talniya works with PeerIslands, a boutique MongoDB SI based out of the Cayman Islands. He is passionate about building cloud-native applications, solving technical challenges, MongoDB, and cryptocurrency. As a certified MongoDB developer, Mohit has worked with MongoDB teams on crucial, time-sensitive projects, including a mission-critical real-time data migration and building a MongoDB persistence layer for an open-source OAuth framework. He loves playing ping-pong and cricket in his spare time. The William Zola Award for Community Excellence Award: Prasad Saya Prasad is a MongoDB Certified Developer and a natural-born mentor who harnesses his deep curiosity about technology and channels it into providing informative and helpful answers for his fellow developers. Active on Stack Overflow, our own Community Forums (where he has achieved the rank of Forum Elder), and other technical communities such as JavaRanch, Prasad is always there with a thorough understanding of the problem and a detailed answer to get folks going on the right path.
5 New Analytics Features to Accelerate Insights and Automate Decision-Making
The applications we use every day are continually delivering richer experiences and working more efficiently. One of the driving forces of this progress is analytics. As organizations ingest and use ever increasing layers of data, they are able to derive more timely insights about their users’ preferences, patterns, and needs to deliver just-in-time information and choices within their applications. The next generation of applications will take a huge leap in intelligence by integrating real-time analytics into their app experiences. Such analytics will increasingly be automated, developer-driven, and incorporated seamlessly within data platforms alongside transactional — or application workloads. As announced at MongoDB World 2022 , MongoDB will introduce five new features this year that will help businesses modernize their analytics: Column Store indexes, MongoDB Atlas Data Federation , MongoDB Atlas Data Lake , MongoDB Atlas SQL Interface , and distinct tiering for analytics nodes. Using these features will automate decision-making and drastically decrease the time it takes to get application insights in front of users. Modernizing analytics around operational data Today, in order to create dynamic in-app experiences, businesses need to take multiple steps — collecting application data, sending it to a data warehouse or data lake to run analytics on it, deriving insights, coding new experiences, and releasing the app back to users. Modern applications must be able to automate this process by capturing and processing the data at the source — that is, in the application. The data inside your application is the most valuable and current picture of what is happening with your business. Combining real-time, operational, and embedded analytics, analytics driven by application data helps determine, influence, and automate decision-making for the app and provide real-time insights for the user. Real-time analytics is, as the name implies, done nearly instantly, usually on data that resides in an application. Examples include fraud detection for banks and personalized offers or recommendations on an e-commerce site. The analytics can range from basic aggregations to machine learning models that provide insight and automate an action, such as sending an offer. One example is Ticketek , an Australia-based event ticketing company, which uses real-time analytics to make critical decisions, such as whether to open up more sections of a venue or put on more shows. Operational analytics is the process of finding insights from your data sources to improve decision-making for the daily operations of a business. Use cases include real-time reporting, improving overall operations, and product analytics. Online grocery Boxed , for example, was able to manage inventory levels during peak demand thanks to real-time data and insights directly from MongoDB Atlas . Embedded analytics enhances applications by embedding data visualizations and dashboards with MongoDB Atlas Charts , providing users with relevant insights when and where they need them. What's New Here are five advances announced at MongoDB World that can help businesses modernize their analytics: Column Store indexes: This feature enhances analytical queries by allowing developers to deliver real-time analytics on live, operational data. It also improves the performance of common analytical queries by adding a structure on top of collections that groups similar fields together to speed up reads. This eliminates the need to offload analytics to disparate specialized systems and rely on complex and fragile ETL pipelines that ultimately slow down the time to gain insights. Atlas Data Federation : Atlas Data Lake is relaunching as Atlas Data Federation to reflect our focus on the value of federation. MongoDB Atlas users have the ability to query several data sources at once. Atlas Data Lake : The new Atlas Data Lake provides a cost-effective data store optimized for high-performance analytics on large volumes of data. Atlas Data Lake delivers analytical workload isolation, allowing you to perform complex, long-running, or large analytical queries without impacting your production application. Fully integrated as part of the MongoDB Atlas, Atlas Data Lake can be provisioned alongside your Atlas Database, making the ingestion and optimization of data simple, with no infrastructure to set up or manage. Atlas SQL Interface, Connectors, and Drivers : Atlas’s new SQL capabilities allow people who mainly work in SQL tools, such as data analysts, to easily interact with Atlas data. Users can query Atlas data via a BI tool or SQL driver and are able to directly query live data and gain enhanced schema control. Distinct tiering for analytics nodes: Users can choose an appropriately sized node tier dedicated to their analytics workload without needing to change the tier of the entire cluster. This can enhance the performance of your analytics workloads; you can provision only what you need if your analytical workload requirements are less than your transactional requirements. Learn more about MongoDB World 2022 announcements at mongodb.com/new and in these stories: 4 New MongoDB Features to Improve Security and Operations Closing the Developer Experience Gap: MongoDB World Announcements Streamline, Simplify, Accelerate: New MongoDB Features Reduce Complexity
Closing the Developer Experience Gap: MongoDB World Announcements
Now is a great time to be a software developer or architect. Never have there been so many solutions, vendors, and architectural patterns to choose from as you build new applications and features. But the sheer number of choices creates another puzzle for developers to solve before they can begin to build. Many of MongoDB’s efforts over the past year have been to help address the needs of the developer communities we serve, and one of the greatest needs we’ve seen in developer communities is improving the experience of being a developer. At MongoDB World 2022, we announced several tools to help improve that experience and to boost developer velocity: Atlas Data API — A serverless API that lets you easily access your Atlas data from any environment that supports HTTPS requests, including services like AWS Lambda and Google App Services. The Atlas Data API is fully functional upon generation, language-agnostic, and secure from the start. Serverless instances — With MongoDB serverless instances, developers don’t have to worry about scaling up to meet increasing workloads or paying for resources they’re not using if their workload is idle. The serverless model dynamically uses only what it needs — and only charges for what it uses. Atlas CLI — The MongoDB Atlas CLI is a completely new way to access Atlas in a non-GUI-centered environment. CLIs are often the interaction method of choice by developers, especially advanced developers who prefer control and speed over a more visual interface. Our new CLI gives these developers an easier registration experience with nearly instant free tier deployments in Atlas. Time series — We have expanded our data platform so developers can work more easily with time series data in support of IoT use cases, financial analytics, logistics, and more. MongoDB time series makes it faster and lower cost to build and run time series applications by natively supporting the entire time series data lifecycle. Facets in Atlas Search — Categorize data with facets for fast, filtered search results. With facets in Atlas Search, you can index your data to map fields to categories, then quickly update query results based on the ones relevant to your users. Verified Solutions — The MongoDB Verified Solutions program gives developers the confidence to use third-party tools, such as Mongoose, by guaranteeing comprehensive testing of the tools as well as a base level of support from MongoDB Technical Services. Change streams — Change streams enable developers to build real-time, event-driven applications that react to data changes as they happen. This allows them to build more complex features and better end-user experiences. The paradox of choice for developers Developers today have no shortage of tools to work with, but the abundance of options is itself a problem. And when there’s little or no central decision-making, developers are forced to figure out how to stitch together a patchwork of technology solutions to create the seamless user experiences that consumers have come to expect. Developers had fewer choices when applications were built on a three-tier framework composed of a relational database, a J2EE stack, and an app or web server. Since then, however, application development has fragmented into different architectures, SDKs, and cloud services, leaving developers many more patterns to figure out. On top of that, the rise of DevOps has increased the pressure on developers to build and maintain the tools they’re working with, and serious development shops often take pride in building their own toolchains, backends, and databases. Put it all together — the abundance of choices, the patchwork nature of solutions, the pressure to build and maintain toolchains, and the glue code keeping it all together — and it adds up to more cognitive load, elevated stress levels, and a lengthening of time to value. As Stephen O’Grady from analyst firm RedMonk explains , “Developers are forced to borrow time from writing code and redirect it toward managing the issues associated with highly complex, multifactor developer toolchains held together in places by duct tape and baling wire. This, then, is the developer experience gap.” Having a lot of options is a good thing — until it’s not. One way we’re working to unwind the paradox of choice is by providing tools that exist in the same form whether in the cloud or on the client — that is, solutions that integrate with the way developers already work. This could mean plugging into a CLI first, abstracting provisioning, simplifying and securing the data layer so developers don’t have to worry about it, and unlocking the creativity of developers with a data model that maps to how data is actually going to be used. We’re also enabling developers to access the tools they need from within MongoDB without having to integrate myriad bolt-on tools (i.e., the paradox of choice). Building at velocity The key to unlocking developer productivity, as we see it, is giving developers the building blocks they need to create a whole workload from scratch, or to bring a new workload into their ecosystem — be it time-series, search, or analytics — and have them run on a single platform instead of having to stitch together disparate systems. Our goal is to bring a modern data layer to modern applications. We want to bring that experience to more and more of what you work on. We know that modern applications have complicated data requirements, but that shouldn’t mean complicated data infrastructure. We want to serve most of your workloads with a single unified platform. Learn more about MongoDB World 2022 announcements at mongodb.com/new and in these stories: 5 New Analytics Features to Accelerate Insights and Automate Decision-Making 4 New MongoDB Features to Improve Security and Operations Streamline, Simplify, Accelerate: New MongoDB Features Reduce Complexity
Streamline, Simplify, Accelerate: New MongoDB Features Reduce Complexity
At MongoDB World 2022 , we announced several developer-centric features that provide more powerful analytics, streamline operations, and reduce complexity. In this post, we look at MongoDB Atlas Data Federation , MongoDB Atlas Search , MongoDB Atlas Device Sync and its Flexible Sync, and change streams. As consumer expectations of the applications they use grow, developers must continue to create richer experiences. To do that, many are adding a variety of data systems and components to their architectures, including single-purpose NoSQL datastores, dedicated search engines, and analytics systems. Piecing these disparate systems together adds complexity to workflows, schedules, and processes, however. For instance, one application could utilize a solution for database management, another solution for search functionality, and a third solution for mobile data sync. Even within an organization, teams often use different products to perform the same tasks, such as data analysis. This way of building modern applications often causes significant problems, such as data silos and overly complex architectures. Additionally, developers are forced to spend extra time and effort to learn how each of these components functions, to ensure they work together, and to maintain them over the long term. It should not be the developer’s job to rationalize all these different technologies in order to build rich application experiences. The developer data platform For developers and their teams, cobbling together a data infrastructure from disparate components is inefficient and time-consuming. Providers have little incentive to ensure that their solutions can function alongside the products of their competitors. Further, internal documentation, which is key to demystifying the custom code and shortcuts in a bespoke architecture, might not be available or current, and organizational knowledge gets lost over time. MongoDB Atlas, our developer data platform , was built to solve these issues. An ecosystem of intuitive, interlinked services, Atlas includes a full array of built-in data tools, all centered around the MongoDB Atlas database. Features are native to MongoDB, work with a common API, are designed for compatibility, and are intended to support any number of use cases or workloads, from transactional to operational, analytics to search, and anything in between. Equally important, Atlas removes the hidden, manual work of running a sprawling architecture, from scaling infrastructure to building integrations between two or more products. With these rote tasks automated or cleared away, developers are free to focus on what they do best: build, iterate, and release new products. MongoDB Atlas Data Federation MongoDB Atlas Data Federation allows you to write a single query to work with data across multiple sources, such as your Amazon S3, Atlas Data Lake , and MongoDB Atlas clusters. Atlas Data Federation is not a separate repository of data, but a service to combine, enrich, and transform data across multiple sources, regardless of origin, and output to your preferred location. With Atlas Data Federation, developers who want to aggregate data or federate queries do not need to use complex data pipelines or time-consuming transformations — a key advantage for those seeking to build real-time app features. Atlas Data Federation also makes it easier to quickly convert MongoDB data into columnar file formats, such as Parquet or CSV, so you can facilitate ingestion and processing by downstream teams that are using a variety of different analytics tools. MongoDB Atlas Search Rich, responsive search functionality has become table stakes for both consumer-facing and internal applications. But building high-quality search experiences isn’t always easy. Developers who use a third-party, bolt-on search engine to build search experiences have to deal with problems like the need to sync data between multiple systems; more operational overhead for scaling, securing, and provisioning; and using different query interfaces for database and search. Built on the industry-leading Apache Lucene search library, MongoDB Atlas Search is the easiest way to build rich, fast, and relevant search directly into your applications. It compresses three systems — database, search engine, and sync mechanism — into one, so developers don’t have to deal with the problems that bolt-on search engines introduce. It can be enabled with a few API calls or clicks and uses the same query language as the rest of the MongoDB product family. Atlas Search provides all of the features developers need for rich, personalized search experiences to users, like facets , now generally available, which offers users a way to quickly filter and navigate search results. With facets, developers can index data to map fields to categories like brand, size, or cost, and update query results based on relevance. This allows users to easily define multiple search criteria and see results updated in near real-time. MongoDB Atlas Device Sync With apps such as TikTok, Instagram, and Spotify, mobile users have come to expect features such as real-time updates, reactive UIs, and an always-on, always-available experience. While the user experience is effortless, building these abilities into a mobile app is anything but. Such features require lots of time and resources to develop, test, debug, and maintain. MongoDB Atlas Device Sync is designed to help developers address mobile app data challenges, including limited connectivity, dead zones, and multiple collaborators (all with varying internet speeds and access) by gathering, syncing, and resolving any sync conflicts between the mobile database and MongoDB Atlas — without the burden of learning, deploying, and managing separate data technologies. At World 2022, MongoDB announced Flexible Sync, a new way to sync data between devices and the cloud. Using Flexible Sync, developers can now define synced data using language-native queries and fine-grained permissioning, resulting in a faster, more seamless way of working — and one analogous to the way developers code and build. Previously, developers had to sync full partitions of data; Flexible Sync enables synchronization of only the data that’s relevant. With support for filter logic, asymmetric sync, and hierarchical permissioning, Flexible Sync can reduce the amount of required code by 20% or more, and speed up build times from months to weeks. Change Streams Data changes quickly, and your applications need to react just as quickly. When a customer’s order is shipped, for instance, they expect an in-app or email notification — and they expect it immediately. Yet building applications that can respond to events in real time is difficult and often requires the use of polling infrastructure or third-party tools, both of which add to developer overhead. Latency and long reaction times result in data that is outdated, and poor experiences for users of that data. Like Atlas’s Database Triggers, change streams enable developers to build event-driven applications and features that react to data changes as they happen. Along with reducing the complexity and cost of building this infrastructure from scratch, the new change stream enhancements (available in MongoDB 6.0) will enable you to determine the state of your database before and after an event occurs, so you can act on the changes and build business logic, analytics, and policies around it. That opens up new use cases, such as retrieving a copy of a document immediately after it is updated. All of these updates and new capabilities focus on the critical need to eliminate complexity in order to build, deploy, and secure modern applications in any environment. Together, MongoDB helps solve what MongoDB president and CEO Dev Ittycheria called a key developer challenge in his MongoDB World 2022 keynote: reducing the friction and cost of working with data. Learn more about MongoDB World 2022 announcements at mongodb.com/new and in these stories: 5 New Analytics Features to Accelerate Insights and Automate Decision-Making 4 New MongoDB Features to Improve Security and Operations Closing the Developer Experience Gap: MongoDB World Announcements
4 New MongoDB Features to Improve Security and Operations
Data platforms are designed to remove operational complexity and enable developers to move and innovate faster. For applications that are critical to your users and your business, the data platform powering them must also be reliable, scalable, and global. Achieving that should take minimal work, both upfront and on an ongoing basis. At MongoDB World 2022, we announced several new capabilities that further help organizations achieve operational excellence: Queryable Encryption , Cluster-to-Cluster Sync , Scheduled Archiving , MongoDB Atlas Operator for Kubernetes , and MongoDB Atlas Serverless . With the introduction of Queryable Encryption , MongoDB will be the only database provider that allows customers to run expressive queries such as equality and range, prefix, suffix, substring and more on fully randomly encrypted data, just as they can do on unencrypted data. This is a huge advantage for organizations that need to run expressive queries while also securing their data. Queryable Encryption reduces the heavy lifting involved when working with encrypted data, resulting in faster app development without undermining data protection or compliance with data privacy regulations. Not every organization is fully — or may ever be fully — in the cloud. Many businesses also leverage hybrid or multi-cloud environments. Cluster-to-Cluster Sync enables continuous, uni-directional, real-time data synchronization of two MongoDB clusters in the same or different environments — public cloud, private cloud, on-premises, and at the edge. MongoDB now supports, for example, hybrid Atlas and Enterprise Advanced deployments, wherein a cluster’s data can be synced from on-prem to Atlas, or vice versa. With Cluster-to-Cluster Sync, organizations have full control of the synchronization process. They can decide when to start, stop, pause, or resume your synchronization, or to reverse the direction of synchronization. And they can monitor the progress of the synchronization in real time. This new capability will enable greater experimentation and innovation, increase organizational insights, and help developers find more efficient ways to work with data. Use cases that benefit from having the data of two MongoDB clusters fully synchronized include data migration, enhanced development lifecycles, dedicated analytics, audit compliance, and improving latency by moving data to the edge. The MongoDB Atlas Operator for Kubernetes is the best way to use MongoDB with Kubernetes. With the Atlas Operator, developers can seamlessly integrate MongoDB Atlas into their Kubernetes deployment pipeline, controlling Atlas resources without leaving the Kubernetes control plane. They can also control Atlas projects, clusters, database users, backup policy, serverless instances, private network endpoints, and more. The operator is compatible with any certified Kubernetes distribution, including Amazon Elastic Kubernetes Service (EKS), Google Kubernetes Engine (GKE), Azure Kubernetes Service (AKS), Red Hat OpenShift, and dozens more. We are enhancing the Online Archive feature of Atlas with two new features: Data expiration and scheduled archiving. With data expiration, you can define and automate for how long you need the data stored in the online archive before getting deleted. With the scheduled archiving feature, you can set rules about the time window of when you want the archive to run. This could be daily, weekly or monthly. You can also edit the archive rule and define when you want to archive your data and when you want it deleted from the archive. One big trend in the developer world is removing operational overhead by moving to a managed database offering. This move away from day-to-day management and administration lets developers do what they do best — create. To this end, MongoDB has rolled out Atlas Serverless . With Atlas Serverless, server provisioning and management has been abstracted (hidden) from the customer or end-user of the service. This eliminates the cognitive load of sizing and scaling infrastructure to keep up with application demand. Instead of paying for idle resources, with Atlas Serverless, you pay for only what you use. By simplifying provisioning, Atlas Serverless helps organizations accelerate time to market and improve experiences for both developers and IT managers. All of these new features have been designed to help organizations improve their operational excellence, ensuring security, consistency, and scale while alleviating repetitive operational tasks for developers and IT managers. Learn more about MongoDB World 2022 announcements at mongodb.com/new and in these stories: 5 New Analytics Features to Accelerate Insights and Automate Decision-Making Closing the Developer Experience Gap: MongoDB World Announcements Streamline, Simplify, Accelerate: New MongoDB Features Reduce Complexity
Announcing Atlas Data Federation and Atlas Data Lake
Two years ago, we released the first iteration of Atlas Data Lake . Since then, we’ve helped customers combine data from various storage layers to feed downstream systems. But after years spent studying our customers’ experiences, we realized we hadn’t gone far enough. To truly unleash the genius in all our developers, we needed to add an economical cloud object storage solution with a rich MQL query experience to the world of Atlas. Today, we’re thrilled to announce that our new Atlas Data Federation and Atlas Data Lake offerings do just that. We now offer two complementary services, Atlas Data Federation (our existing query service formerly known as Atlas Data Lake) and our new and improved Atlas Data Lake (a fully managed analytic-oriented storage service). Together, these services (both in preview) provide flexible and versatile options for querying and transforming data across storage services, as well as a MongoDB-native analytic storage solution. With these tools, you can query across multiple clusters, move data into self managed cloud object storage for consumption by downstream services, query a workload-isolated inexpensive copy of cluster data, compare your cluster data across different points in time, and much, much more. In hearing from our customers about their experiences with Atlas Data Lake, we learned where they have struggled, as well as the features they’ve been looking for us to provide. With this in mind, we decided to shift the name of our current query federation service to Atlas Data Federation to better align with how customers see the service and are getting value. We’ve seen many customers benefit from the flexibility of a federated query engine service, including querying data across multiple clusters, databases, and collections, as well as exporting data to third-party systems. We also saw where our customers were struggling with data lakes. We heard them ask for a fully managed storage solution so they could achieve all of their analytic goals within Atlas. Specifically, customers wanted scalable storage that would provide high query performance at a low cost. Our new Data Lake provides a high-performance analytic object storage solution, allowing customers to query historical data with no additional formatting or maintenance work needed on their end. How it works Atlas Data Federation encompasses our existing Data Lake functionality with several new affordances. It continues to deliver the same power that it always has, with increased performance and efficiency. The new Atlas Data Lake will now allow you to create Data Lake pipelines (based on your Atlas Cluster backup schedules) and fields on which you can optimize queries. The service takes the following steps: On the selected schedule, a copy of your collection will be extracted from your Atlas backup with no impact to your cluster. During extraction, we build partition indexes based on the contents of your documents and the fields you’ve selected for optimization. These indexes allow your queries to be optimized by capturing the minimums and maximums (and other stats) of the records in each partition, letting you quickly find the relevant data for your queries. Finally, the underlying data lands in an analytic-oriented format inside of cloud object storage. This minimizes data scanned when you execute a query. Once a pipeline has run and a Data Lake dataset has been created, you can select it as a data source in our new Data Federation query experience. You can either set it as the source for a specific virtual collection in a Federated Database Instance or you can have your Federated Database Instance generate a collection name for each dataset that your pipeline has created. Amazingly, no part of this process will consume compute resources from your cluster — neither the export nor the querying of datasets. These datasets provide workload isolation and consistency for long-running analytic queries, a target for ETL jobs using the powerful $out to S3. This makes it easy to compare the state of your data over time. Advanced though this is, it’s only the beginning of the story. We’re committing to evolving the service, improving performance, adding more sources of data, and building new features. All of this will be based on the feedback you, the user, gives us. We can’t wait to see how you’ll use this powerful new tool and can’t wait to hear what you’d like to see next. Try Atlas Data Lake Today
Keeping Data in Sync Anywhere with Cluster-to-Cluster Sync
For over a decade, MongoDB users have been deploying clusters for some of their most important workloads. We work with customers running MongoDB in a variety of environments, but there are three main environments that we see customers using: Globally distributed cloud clusters (Atlas and self-managed): Enterprises have been successfully running cloud-based applications — in multiple zones and regions — for 10-plus years. More recently, the deployment of globally distributed multi-cloud data clusters has provided tremendous value and flexibility for modern applications. The last two years of the pandemic resulted in an accelerated proliferation of cloud data clusters to support new application services and workloads. On-premises clusters: Many leading companies and government institutions remain reliant on their on-premises systems for various reasons, including regulatory compliance, data governance, existing line-of-business application integrations, or legacy investments. Edge clusters: Organizations also distribute workloads to edge systems to bring enterprise applications closer to data sources, such as local edge servers ingesting sensor data from IoT devices. This proximity to data at its source can deliver substantial business benefits, including improved response times and faster insights. Keeping hybrid data clusters in sync is challenging Due to the diverse data origins and evolution of apps, maintaining data stores in hybrid environments — i.e., distributing data between different environments or distributing data between multiple clusters in a single environment — can be challenging. As application owners innovate and expand to new data environments, a big part of their success will depend on effective data synchronization between their clusters. Cluster data synchronization requires: Support for globally distributed hybrid data clusters . All cluster data must be synchronized between different types of clusters. Continuous synchronization . Support for a constant, nonstop stream of data that seamlessly flows across cluster deployments and is accessible by apps connecting to those different deployments. Resumability . The ability to pause and resume data synchronization from where you left off. The need for a hybrid, inter-cluster data sync By default, a MongoDB cluster allows you to natively distribute and synchronize data globally within a single cluster. We automate this intra-cluster movement of data using replica sets and sharded clusters . These two configurations let you replicate data across multiple zones, geographical regions, and even multi-cloud configurations. But there are occasions when users want to go beyond a single MongoDB cluster and synchronize data to a separate cluster (inter-cluster) configuration for use cases such as: Migrating to MongoDB Atlas Creating separate development and production environments Supporting DevOps strategies (e.g., blue-green deployments) Deploying dedicated analytics environments Meeting locality requirements for auditing and compliance Maintaining preparedness for a stressed exit (e.g., reverse cloud migration) Moving data to the edge Introducing Cluster-to-Cluster Sync We designed Cluster-to-Cluster Synchronization to solve the challenges of inter-cluster data synchronization. It provides you with continuous unidirectional data synchronization of two MongoDB clusters (source to destination) in the same or hybrid environments. With Cluster-to-Cluster Sync, you have full control of your synchronization process by deciding when to start, stop, pause, resume, or reverse the direction of synchronization. You can also monitor the progress of the synchronization in real time. Availability Cluster-to-Cluster Sync is currently available as a Preview release and will soon be Generally Available. At the current time, Cluster-to-Cluster Sync is compatible only with source and destination clusters that are running on MongoDB 6+. What's next? To get started with Cluster-to-Cluster Sync, you need mongosync, a downloadable and self-hosted tool that enables data movement between two MongoDB clusters. Get started today: Download Cluster-to-Cluster Sync (Preview) Read the Cluster-to-Cluster Sync docs Learn more about Cluster-to-Cluster Sync