Massimiliano Marcon

Developers are increasingly shifting from the traditional development model of writing code and testing the entire application stack locally to remote development environments that are more cloud-native. This allows them to have environments that are configurable as-code, are easily reproducible for any team member, and are quick enough to spin up and tear down that each pull request can have an associated ephemeral environment for code reviews.

As new platforms and services that developers use on a daily basis are more regularly provided as cloud-first or cloud-only offerings, it makes sense to leverage all the advantages of the cloud for the entire development lifecycle and have the development environment more effectively mirror the production environment.

In this blog, we’ll look at how [Gitpod](https://www.gitpod.io/), with its Cloud Development Environment ([CDE](https://www.gitpod.io/cde)), is a perfect companion for [MongoDB Atlas](https://www.mongodb.com/atlas/database) when it comes to a cloud-native development experience. We are so excited about the potential of this combined development experience that [we invested](https://www.gitpod.io/blog/future-of-software-cdes) in Gitpod’s most recent funding round.

As an example, let’s look at a simple Node.js application that exposes an API to retrieve quotes from popular authors. You can find the source code on [Github](https://github.com/mongodb-developer/quotes-api). You should be able to try out the end-to-end setup yourself by going to [Gitpod](https://gitpod.io/#https://github.com/mongodb-developer/quotes-api). The project is configured to use a free cluster in Atlas and, assuming you don’t have one already running in your Atlas account, everything should work out of the box.

![Gitpod workspace connected to a free MongoDB Atlas cluster for development](https://mongodb-devhub-cms.s3.us-west-1.amazonaws.com/gitpod_workspace_a884bcf955.png)

The code for the application is straightforward and is mostly contained in [app.js](https://github.com/mongodb-developer/quotes-api/blob/main/app.js), but the most interesting part is how the Gitpod development environment is set up: With just a couple of configuration files added to the GitHub repository, **a developer who works on this project for the first time can have everything up and running, including the MongoDB cluster needed for development seeded with test data, in about 30 seconds!**

Let’s take a look at how that is possible.

We’ll start with the [Dockerfile](https://github.com/mongodb-developer/quotes-api/blob/main/gitpod-config/.gitpod.Dockerfile). Gitpod provides an out-of-the-box Docker image for the development environment that contains utilities and support for the most common programming languages. In our case, we prefer to start with a minimal image and add only what we need to it: the [Atlas CLI](https://www.mongodb.com/docs/atlas/cli/stable/) (and the [MongoDB Shell](https://www.mongodb.com/products/shell) that comes with it) to manage resources in Atlas and Node.js.

```dockerfile
FROM gitpod/workspace-base:2022-09-07-02-19-02

# Install MongoDB Tooling
RUN sudo apt-get install gnupg
RUN wget -qO - https://pgp.mongodb.com/server-5.0.asc | sudo apt-key add -
RUN echo "deb [ arch=amd64,arm64 ] https://repo.mongodb.org/apt/ubuntu focal/mongodb-org/5.0 multiverse" | sudo tee /etc/apt/sources.list.d/mongodb-org-5.0.list
RUN sudo apt-get update
RUN sudo apt-get install -y mongodb-atlas

# Install Node 18
RUN curl -fsSL https://deb.nodesource.com/setup_18.x | sudo -E bash -
RUN sudo apt-get install -y nodejs

# Copy Atlas script
COPY mongodb-utils.sh /home/gitpod/.mongodb-utils.sh
RUN echo "source ~/.mongodb-utils.sh" >> .bash_aliases

```

To make things a little easier and cleaner, we’ll also add to the container a [mongodb-utils.sh](https://github.com/mongodb-developer/quotes-api/blob/main/gitpod-config/docker-content/mongodb-utils.sh) file and load it into bash_aliases. It’s a bash script that contains convenience functions that wrap some of the Atlas CLI commands to make them easier to use within the Gitpod environment.

The second half of the configuration is contained in [.gitpod.yml](https://github.com/mongodb-developer/quotes-api/blob/main/.gitpod.yml). This file may seem a little verbose, but what it does is relatively simple. Let’s take a closer look at these configuration details in the following sections of this article.

## Ephemeral cluster for development
Our Quotes API application uses MongoDB to store data: All the quotes with their metadata are in a MongoDB collection. [Atlas](https://mongodb.com/atlas) is the best way to run MongoDB so we will be using that. Plus, because we are using Atlas, we can also take advantage of Atlas Search to offer full-text search capabilities to our API users.

Since we want our development environment to have characteristics that are compatible with what we’ll have in production, we will use Atlas for our development needs as well. In particular, we want to make sure that every time a developer starts a Gitpod environment, a corresponding ephemeral cluster is created in Atlas and seeded with test data.

![a free Atlas cluster gets automatically created when the Gitpod workspace starts up](https://mongodb-devhub-cms.s3.us-west-1.amazonaws.com/free_atlas_cluster_0fd45e84bb.png)

With some simple configuration, Gitpod takes care of all of this in a fully automated way. The `atlas_up` script creates a cluster with the same name as the Gitpod workspace. This way, it’s easy to see what clusters are being used for development.

```bash
if [ ! -n "${MONGODB_ATLAS_PROJECT_ID+1}" ]; then
  echo "\$MONGODB_ATLAS_PROJECT_ID is not set. Lets try to login."
  if ! atlas auth whoami &> /dev/null ; then
    atlas auth login --noBrowser
  fi
fi
MONGODB_CONNECTION_STRING=$(atlas_up)
```

The script above is a little sophisticated as it takes care of opening the browser and logging you in with your Atlas account if it’s the first time you’ve set up Gitpod with this project. Once you are set up the first time, you can choose to generate API credentials and skip the login step in the future. The instructions on how to do that are in the [README file](https://github.com/mongodb-developer/quotes-api/blob/main/README.md) included in the repository.

## Development cluster seeded with sample data
When developing an application, it’s convenient to have test data readily available. In our example, the repository contains a zipped dataset in JSON format. During the initialization of the workspace, once the cluster is deployed, we connect to it with the MongoDB Shell (mongosh) and run a script that loads the unzipped dataset into the cluster.

```bash
unzip data/quotes.zip -d data
mongosh $MONGODB_CONNECTION_STRING data/_load.js
```

## Creating an Atlas Search index
As part of our Quotes API, we provide an endpoint to search for quotes based on their content or their author. With Atlas Search and the MongoDB Query API, it is extremely easy to configure full-text search for a given collection, and we’ll use that in our application.

As we want the environment to be ready to code, as part of the initialization, we also create a search index. For convenience, we included the `data/_create-search-index.sh`  script that takes care of that by calling the [`atlas cluster search index create command`](https://www.mongodb.com/docs/atlas/cli/stable/command/atlas-clusters-search-indexes-create/) and passing the right parameters to it.

## Cleaning things up
To make the cluster truly ephemeral and start with a clean state every time we start a new workspace, we want to make sure we terminate it once it is no longer needed.

For this example, we’ve used a free cluster, which is perfect for most development use cases. However, if you need better performance, you can always configure your environment to use a paid cluster (see the [`--tier` option](https://www.mongodb.com/docs/atlas/cli/stable/command/atlas-setup/#options) of the Atlas CLI). Should you choose to do so, it is even more important to terminate the cluster when it is no longer needed so you can avoid unnecessary costs.

To do that, we wait for the Gitpod environment to be terminated. That is what this section of the configuration file does:

```yml
tasks:
  - name: Cleanup Atlas Cluster
    command: |
      atlas_cleanup_when_done
```

The [`atlas_cleanup_when_done`](https://github.com/mmarcon/quotes-api/blob/82549fad47f0ebfb801c43ef374c795519322822/gitpod-config/docker-content/mongodb-utils.sh#L18) script waits for the SIGTERM sent to the Gitpod container and, once it receives it, it sends a command to the Atlas CLI to terminate the cluster.

![the cluster used for development is automatically terminated when the Gitpod workspace is stopped](https://mongodb-devhub-cms.s3.us-west-1.amazonaws.com/cluster_terminated_6ba1738375.png)

## End-to-end developer experience
During development, it is often useful to look at the data stored in MongoDB. As Gitpod integrates very well with VS Code, we can configure it so [the MongoDB for VS Code extension](https://www.mongodb.com/products/vs-code) is included in the setup.

This way, whoever starts the environment has the option of connecting to the Atlas cluster directly from within VS Code to explore their data, and test their queries. MongoDB for VS Code is also a useful tool to insert and edit data into your test database: With its [Playground functionality](https://www.mongodb.com/docs/mongodb-vscode/playgrounds/), it is really easy to execute [any CRUD operation](https://www.mongodb.com/docs/mongodb-vscode/crud-ops/), including scripting the insertion of fake test data.

![MongoDB for VS Code is a great way to explore your data in Atlas without leaving the Gitpod workspace](https://mongodb-devhub-cms.s3.us-west-1.amazonaws.com/mongodb_for_vs_code_51c5e34d58.png)

As this is a JavaScript application, we also include the Standard VS Code extension for linting and code formatting.

```yml
vscode:
  extensions:
    - mongodb.mongodb-vscode
    - standard.vscode-standard
```

## Conclusion
MongoDB Atlas is the ideal data platform across the entire development lifecycle. With Atlas, developers get a platform that is 100% compatible with production, including services like Atlas Search that runs next to the core database. And as developers shift towards Cloud Development Environments like Gitpod, they can get an even more sophisticated experience developing in the cloud with Atlas and always be ready to code. Check out the [source code](https://github.com/mongodb-developer/quotes-api) provided in this article and give MongoDB Atlas a try with Gitpod.

Questions? Comments? Head to the [MongoDB Developer Community](https://www.mongodb.com/community/forums/) to join the conversation.

More developers are moving from local development to working in cloud-native, remote development environments. Together, MongoDB and Gitpod make a perfect pair for developers looking for this type of seamless cloud development experience.

Massimiliano Marcon

Content by Massimiliano Marcon

Streamlining Cloud-Native Development with Gitpod and MongoDB Atlas