Building an E-commerce Content Catalog with Atlas Search
Rate this tutorial
Search is now a fundamental part of applications across all industries—but especially so in the world of retail and e-commerce. If your customers can’t find what they’re looking for, they’ll go to another website and buy it there instead. The best way to provide your customers with a great shopping experience is to provide a great search experience. As far as searching goes, Atlas Search, part of MongoDB Atlas, is the easiest way to build rich, fast, and relevance-based search directly into your applications. In this tutorial, we’ll make a website that has a simple text search and use Atlas Search to integrate full-text search capabilities, add autocomplete to our search box, and even promote some of our products on sale.
First, start by cloning the repository that contains the starting source code.
In this repository, you will see three sub-folders:
mdbstore: contains the front end
backend: has the Node.js back end
data: includes a dataset that you can use with this e-commerce application
Use your connection string without the database name at the end. It should look like
This tool will automatically locate the BSON file from the dump folder and import these documents into the
itemscollection inside the
You now have a dataset of about 20,000 items to use and explore.
The Node.js back end will act as an API that your front end can use. It will be connecting to your database by using a connection string provided in a
.envfile. Start by creating that file.
Open your favourite code editor, and enter the following in the
.envfile. Change <CONNECTION_STRING> to your current connection string from MongoDB Atlas.
This command will start the server. You should see a message in your console confirming that the server is running and the database is connected.
It’s now time to start the front end of your application. In a new terminal window, go to the
mdbstorefolder, install all the dependencies for this project, and start the project using
Once this is completed, a browser tab will open, and you will see your fully functioning store. The front end is a React application. Everything in the front end is already connected to the backend API, so we won’t be making any changes here. Feel free to explore the source code to learn more about using React with a Node.js back end.
Your storefront is now up and running. A single page lets you search for and list all products. Try searching for
chicken. Well, you probably don’t have a lot of results. As a matter of fact, you won't find any result. Now try
Boneless Chicken Thighs. There’s a match! But that’s not very convenient. Your users don’t know the exact name of your products. Never mind possible typos or mistakes. This e-commerce offers a very poor experience to its customers and risks losing some business. In this tutorial, you will see how to leverage Atlas Search to provide a seamless experience to your users.
The first thing we’ll do for our users is to add full-text search capabilities to this e-commerce application. By adding a , we will have the ability to search through all the text fields from our documents. So, instead of searching only for a product name, we can search through the name, category, tags, and so on.
Start by creating a search index on your collection. Find your collection in the MongoDB Atlas UI and click on Search in the top navigation bar. This will bring you to the Atlas Search Index creation screen. Click on Create Index.
From this screen, click Next to use the visual editor. Then, choose the newly imported data—‘grocery/items’, on the database and collection screen. Accept all the defaults and create that index.
While you’re there, you can also create the index that will be used later for autocomplete. Click Create Index again, and click Next to use the visual editor. Give this new index the name
autocomplete, select ‘grocery/items’ again, and then click Next.
On the following screen, click the Refine Index button to add the autocomplete capabilities to the index. Click on the Add Field button to add a new field that will support autocomplete searches. Choose the
namefield in the dropdown. Then toggle off the
Enable Dynamic Mappingoption. Finally, click Add data type, and from the dropdown, pick autocomplete. You can save these settings and click on the Create Search Index button. You can find the detailed instructions to set up the index in this .
The first aggregation pipeline we will create is for the search results. Rather than returning only results that have an exact match, we will use Altas Search to return all similar results or close to the user search intent.
In the Aggregation Builder screen, create a new pipeline by adding a first $search stage.
You use the following JSON for the first stage of your pipeline.
In the file backend/index.js, look for the route that listens for GET requests on
/search/:query. Here, replace the code between the comments with the code you used for your aggregation pipeline. This time, rather than using the hard-coded value, use
req.params.queryto use the query string sent to the server.
The old code used the
find()method to find an exact match. This new code uses the newly created Search index to return any records that would contain, in part or in full, the search term that we’ve passed to it.
If you try the application again with the word “Chicken,” you will get much more results this time. In addition to that, you might also notice that your searches are also case insensitive. But we can do even better. Sometimes, your users might be searching for more generic terms, such as one of the tags that describe the products or the brand name. Let’s add more fields to this search to return more relevant records.
$searchstage that you added in the previous code snippet, change the value of the path field to contain all the fields you want to search.
Experiment with your new application again. Try out some brand names that you know to see if you can find the product you are looking for.
Your search capabilities are now much better, and the user experience of your website is already improved, but let’s see if we can make this even better.
A common feature of most modern search engines is an autocomplete dropdown that shows suggestions as you type. In fact, this is expected behaviour from users. They don’t want to scroll through an infinite list of possible matches; they’d rather find the right one quickly.
In this section, you will use the Atlas Search autocomplete capabilities to enable this in your search box. The UI already has this feature implemented, and you already created the required indexes, but it doesn’t show up because the API is sending back no results.
Open up the aggregation builder again to build a new pipeline. Start with a $search stage again, and use the following. Note how this $search stage uses the
autocompletestage that was created earlier.
In the preview panel, you should see some results containing the string “chic” in their name. That’s a lot of potential matches. For our application, we won’t want to return all possible matches. Instead, we’ll only take the first five. To do so, a $limit stage is used to limit the results to five. Click on Add Stage, select $limit from the dropdown, and replace
numberwith the value
Excellent! Now we only have five results. Since this request will be executed on each keypress, we want it to be as fast as possible and limit the required bandwidth as much as possible. A $project stage can be added to help with this—we will return only the ‘name’ field instead of the full documents. Click Add Stage again, select $project from the dropdown, and use the following JSON.
Note that we also added a new field named
highlights. This field returns the metadata provided to us by Atlas Search. You can find much information in this metadata, such as each item's score. This can be useful to sort the data, for example.
Now that you have a working aggregation pipeline, you can use it in your application.
In the file backend/index.js, look for the route that listens for GET requests on
/autocomplete/:query. After the
TODOcomment, add the following code to execute your aggregation pipeline. Don’t forget to replace the hard-coded query with
req.params.query. You can directly from Compass or use the following code snippet.
Go back to your application, and test it out to see the new autocomplete functionality.
And look at that! Your site now offers a much better experience to your developers with very little additional code.
When delivering results to your users, you might want to push some products forward. Altas Search can help you promote specific results by giving you the power to change and tweak the relevance score of the results. A typical example is to put the currently on sale items at the top of the search results. Let’s do that right away.
In the backend/index.js file, replace the database query for the
/search/:queryroute again to use the following aggregation pipeline.
This might seem like a lot; let’s look at it in more detail.
First, we added a
compoundobject to the
$searchoperator. This lets us use two or more operators to search on. Then we use the
mustoperator, which is the equivalent of a logical
ANDoperator. In this new array, we added two search operations. The first one is the same
textas we had before. Let’s focus on that second one.
Here, we tell Atlas Search to boost the current relevance score by three if the field
price_specialexists in the document. By doing so, any document that is on sale will have a much higher relevance score and be at the top of the search results. If you try your application again, you should notice that all the first results have a sale price.
Another common feature in product catalog search nowadays is fuzzy matching. Implementing a fuzzy matching feature can be somewhat complex, but Atlas Search makes it simpler. In a
textsearch, you can add the
fuzzyfield to specify that you want to add this capability to your search results. You can tweak this functionality using , but we’ll stick to the defaults for this application.
Once again, in the backend/index.js file, change the
search/:queryroute to the following.
You’ll notice that the difference is very subtle. A single line was added.
This enables fuzzy matching for this
$searchoperation. This means that the search engine will be looking for matching keywords, as well as matches that could differ slightly. Try out your application again, and this time, try searching for
chickn. You should still be able to see some results.
A fuzzy search is a process that locates web pages that are likely to be relevant to a search argument even when the argument does not exactly correspond to the desired information.
To ensure that your website is successful, you need to make it easy for your users to find what they are looking for. In addition to that, there might be some products that you want to push forward. Atlas Search offers all the necessary tooling to enable you to quickly add those features to your application, all by using the same MongoDB Query API you are already familiar with. In addition to that, there’s no need to maintain a second server and synchronize with a search engine.
How to Use Custom Archival Rules and Partitioning on MongoDB Atlas Online Archive
Jun 07, 2022