Since announcing the public preview of MongoDB Atlas Vector Search back in June, we’ve seen tremendous adoption by developers working to build AI-powered applications. The ability to store, index, and query vector embeddings right alongside their operational data in a single, unified platform dramatically boosts engineering velocity while keeping their technology footprint streamlined and efficient.
Atlas Vector Search is used by developers as a key part of the Retrieval-Augmented Generation (RAG) pattern. RAG is used to feed LLMs with the additional data they need to ground their responses, providing outputs that are reliable, relevant, and accurate for the business. One of the key enabling technologies being used to bring external data into LLMs is LangChain. Just one example is healthcare innovator Inovaare who is building AI with MongoDB and LangChain for document classification, information extraction and enrichment, and chatbots over medical data.
Now making it even easier for developers to build AI-powered apps, we are excited to announce our partnership with LangChain in the launch of LangChain Templates!
We have worked with LangChain to create a RAG template using MongoDB Atlas Vector Search and OpenAI. This easy-to-use template can help developers build and deploy a Chatbot application over their own proprietary data. LangChain Templates offer a reference architecture that’s easily deployable as a REST API using LangServe.
If you’re building AI-powered apps on MongoDB, we’d love to hear from you. Sign up to our AI Innovators program where successful applicants receive no-cost MongoDB Atlas credits to develop apps, access to technical resources, and the opportunity to showcase your work to the broader AI community.
Every Operational Data Layer (ODL) Can Benefit From Search
In today's digital landscape, organizations frequently encounter the daunting challenge of managing complex data architectures. Multiple systems, diverse technologies, and a variety of programming languages become entwined, making smooth operations a significant struggle. A frequent example of this issue is seen in some major banks still relying on a banking system built in the 1970s, continuing to run on a mainframe with minimal updates. The consequence is a complex architecture as seen in Figure 1, where data is scattered across various systems, creating inefficiencies and hindering seamless operations. Offloading the data from one or more monolithic systems is a well-proven approach to increase agility and deliver new innovative services to external and internal customers. In this blog we will speak about how search can make Operational Data Layers (ODL) – an architectural pattern that centrally integrates and organizes siloed enterprise data, making it available to consuming applications – an even more powerful tool. Figure 1: Complex Data Architecture Operational Data Store (ODS) as a solution To tackle the complexities of their existing data architecture, organizations have turned to Operational Data Stores (ODS). An ODS serves as a secondary data store, holding data replicated of primary transactional systems as seen in Figure 2. Organizations can feed their ODS with change data capture technologies. Figure 2: Conceptual model of an Operational Data Layer The evolutionary path of adoption Implementing an ODS requires a thoughtful approach that aligns with the organization's digital transformation journey. Typically, the adoption path consists of several stages as seen in Figure 3. Initially, organizations focus on extracting data from one system into their Operational Data Store, allowing them to operate on a more unified dataset. Gradually, they can retire legacy systems and eliminate the need for intermediate data streams. The key benefit of this incremental approach is that it delivers value (e.g. offloading mainframe operations) to the business at every step by eliminating the need for a complete overhaul and minimizing disruption. Figure 3: Evolution of a basic ODS into a system of records Areas of application ODS are used to support the business in three different ways: Data Access Layers allow organizations to free their data from the limitations imposed by data silos and technological variations. Organizations consolidate data from different sources that often use different data storage technologies and paradigms, creating a unified view that simplifies data access and analysis. This pattern is mainly used to enable modern APIs, speed up development of new customer services, and improve responsiveness and resiliency. Operational Data Layer (ODL): The ODL is an internal-focused layer that aids in complex processing workflows. It serves as a hub for orchestrating and managing data across various stages of processing. The ODL empowers organizations to enrich and improve data iteratively, resulting in more powerful and accurate insights. It provides a holistic view of data and process information, an improved customer experience, and reduced operational costs. Developer ODL: Building a developer-focused ODL can provide significant advantages during the development cycle. By making data readily available to developers, organizations can accelerate the development process and gain a comprehensive understanding of their data structures. This, in turn, helps in identifying and addressing issues early on, leading to improved data models and better system performance. In a nutshell, this pattern helps reduce developer training time, streamlines development and speeds up testing and test automation. The power of search in ODS So how can every ODL benefit from search capabilities and how can MongoDB Atlas Search help? Atlas Search plays a crucial role in maximizing the value of an ODS. When we have questions or are searching for an answer, our natural interaction with information is primarily through search. We excel at interpreting imprecise queries and extracting relevant information from vast datasets. By incorporating search capabilities with Atlas Search into an ODS, organizations can empower their users to explore, analyze, and gain valuable insights from their data. Consider the example of a banking organization with a complex web of interconnected systems. Searching for specific transactions or identifying patterns becomes a daunting task, especially when dealing with numeric identifiers across multiple systems. Traditionally, this involved manual effort and navigating through numerous systems. However, with a search-enabled ODS, users can quickly query the relevant data and retrieve candidate matches. This greatly streamlines the process, saves time, and enhances efficiency. Practical examples: Leveraging ODS and Atlas Search Let's explore a few practical examples that demonstrate the power of ODS and the Atlas Search functionality. Operational Data Layer for Payments Processing: A financial institution implemented an ODS-based operational layer for processing payments. By aggregating data from multiple sources and leveraging search capabilities, they achieved faster and more accurate payment processing. This enabled them to investigate issues, ensure consistency, and deliver a superior customer experience. Customer 360 View: Another organization leveraged an ODS to create a comprehensive view of their customers, empowering relationship managers and bank tellers with a holistic understanding. With search functionality, they could quickly locate customer information across various systems, saving time and improving customer service. Post-trade Trading Platform: A global broker operating across 25 different exchanges utilized an ODS to power their post-trade trading platform. By leveraging search capabilities, they simplified the retrieval of data from various systems, leading to efficient and reliable trading operations. Conclusion In the dynamic world of data management, Operational Data Stores (ODS) have emerged as a crucial component for organizations seeking to streamline their data architectures. By adopting an incremental approach and leveraging search functionality such as Atlas Search , organizations can enhance data accessibility, improve operational efficiency, and drive valuable insights. The power of search within ODS lies in its ability to simplify data retrieval, accelerate development cycles, and enable users to interact with data in a more intuitive and efficient manner. By embracing these practices, organizations can unlock the true potential of their data, paving the way for a more productive and data-driven future. For more information on Atlas Search, check out the following resources: Watch this MongoDB.local talk which expands on this blog: Every ODS Needs Search: A Practical Primer Based on Client Experiences Discover MongoDB’s search functionalities Learn how Helvetia accelerates cloud-native modernization by 90% with MongoDB Atlas and MongoDB Atlas Search
MongoDB Doubles Down on Aotearoa as Part of Continued APAC Expansion
MongoDB is expanding its business in New Zealand to help Kiwi organisations build modern applications and take advantage of the AI opportunity that exists today. With hundreds of customers already in Aotearoa, including Pathfinder, Rapido, and Tourism Holdings, we're continuing to hire and invest to continue to grow our community in the country. Powering the next generation of modern applications Interest and excitement in AI, and particularly generative AI, has exploded. With a proud history of Innovation, it's not a surprise that many New Zealand companies are early adopters of this incredible technology. In fact, an AI Forum report has revealed that AI has the potential to increase New Zealand's GDP by as much as $54 billion by 2035. No matter what you think of the veracity of those bold predictions, one thing is sure: Almost every company is trying to figure out how to take advantage of data and software, to help them build better products, more efficiently and more quickly. Jake McInteer speaking at MongoDB.local Auckland As organisations transform into digital-first businesses, they’re faced with a growing list of application and data requirements. Modern applications are complex – they need to handle transactional workloads, app-driven analytics, full-text search, AI-enhanced experiences, stream data processing, and more. Companies are being asked to do this all while reducing data infrastructure sprawl, complexity and often also cut costs. What we are seeing globally is our developer data platform solves this challenge and complexity since it integrates all of the data services organisations need to build modern applications in a unified developer experience. Additionally, we also allow our customers to easily run anywhere in the world with over 110+ locations making us uniquely placed to enable Kiwi companies to adapt to a multicloud future. We also have strong local partnerships with all three cloud hyperscalers, all of which plan to open new cloud regions in New Zealand in the coming years. With the support of our cloud partners, in New Zealand we've already seen great adoption of MongoDB Atlas, including the largest established enterprises, through to cutting-edge startups. Here are a couple of examples. Pathfinder: Protecting vulnerable children Pathfinder , headquartered in Auckland, is a global leader in software development specialising in protecting vulnerable children. The company's mission centres on empowering law enforcement agencies with state-of-the-art technology, meticulously designed to combat the reprehensible crime of child exploitation. "We are committed to delivering investigators the most advanced tools. We cannot accept delays in removing a child from harm due to investigations being overwhelmed by large amounts of disparate data. In situations where every minute impacts a child's well-being, these tools must enable investigators to swiftly navigate data challenges, and rapidly apprehend perpetrators" said Bree Atkinson, CEO of Pathfinder Labs. Pathfinder’s Paradigm service is being built on MongoDB Atlas, running on AWS, and takes advantage of the wider developer data platform features in order to enable the next generation of data-driven investigative capabilities. By using MongoDB Atlas Vector Search , a native part of the MongoDB Atlas platform, the Pathfinder team are also able to match images and details within images (such as people and objects), classify documents and text, and build better search experiences for their users via semantic search. This enables Paradigm to efficiently aid law enforcement in identifying victims and apprehending offenders. Bree Atkinson, CEO of Pathfinder Labs, and Peter Pilly, DevOps Architect at Pathfinder Labs, with the MongoDB team in Auckland at the recent .local event "MongoDB Atlas allows our team to focus on our strengths: developing outstanding technology. It works with us not against us, enhancing integration which enables us to build better user experiences," said Peter Pilley, DevOps Architect at Pathfinder Labs. "Take MongoDB Atlas Vector Search, for example. Before MongoDB, we would have needed to incorporate multiple tools to achieve that functionality. Now we can handle it all from a single platform removing complexity and architecture that wasn't needed. With MongoDB Atlas, we're able to make data-driven decisions swiftly, boosting our productivity and decision-making speed." Peter's team at Pathfinder also uses MongoDB's performance advisor. They say it's like having an extra team member who suggests the best indexes for accessing their data, which is critical in an industry where getting to a specific piece of data could make all the difference. Rapido: Optimising B2B revenue and distribution Rapido has been utilising MongoDB Atlas for over five years. The team was originally part of MongoDB for Startups , a programme that offers startups free credits and technical advice to help them build faster and scale further. Their eagerness to adopt new technologies has enabled them to effectively harness MongoDB Atlas's evolving features. Working with the Accredo ERP system, Rapido has harnessed MongoDB Atlas to innovate in business-to-business (B2B) transactions. Using features like MongoDB Atlas Vector Search, the ' moreLikeThis ' operator, and MongoDB App Services, they've transformed business interactions, offering precise product recommendations and improved real-time visibility via change streams. Rapido's platform, which has processed orders collectively worth more than $100m to date, is essential for many wholesale businesses in New Zealand. Adam Holt, CEO of Rapido, summarises their experience: "Our journey with MongoDB Atlas has been transformative. By building on a cohesive developer data platform, we don't need to bolt-on and learn special technologies for every requirement. Continuously integrating new features keeps our platform advanced in the fast-paced B2B market. It's about leveraging technology to innovate and deliver better solutions to our clients." MongoDB expands in Aotearoa The increased demand from Kiwi organisations who are looking to innovate faster and take advantage of cutting-edge technologies, like AI, means MongoDB is now doubling down on its New Zealand footprint. Earlier this month, MongoDB established its local operations in Aotearoa, New Zealand. Jake McInteer , a native Kiwi, has officially transferred from MongoDB’s Australia business to lead the organisation in New Zealand. MongoDB already has a large, engaged community, more than 200 customers, and an extensive partner network. CEO of Lumin Max Ferguson presents at the Christchurch MongoDB user group We are incredibly excited about the opportunity to invest in and contribute to the Kiwi tech ecosystem, both to support local companies and help kiwi startups like Lumin and Marsello as well as established companies like Tourism Holdings , Figured , and Foster Moore . To support our growth, we have roles open on our Sales and Solutions Architecture team. If you are based in NZ and interested in joining our incredible team, working in our hybrid environment, please check out and apply for the roles here: Enterprise Account Executive, Acquisition Senior Solutions Architect Additionally, read here about the massive opportunity at MongoDB in APAC from our SVP Simon Eid.