Docs Home → MongoDB Atlas Data Lake
View Atlas Data Lake Pipelines
You can view all of your Data Lake pipelines through the Atlas UI and Data Lake Pipelines API. You can also retrieve all of your completed Data Lake pipeline data ingestion jobs from the API.
View Atlas Data Lake Pipelines from the Atlas UI
Log in to MongoDB Atlas.
Select Data Lake under Deployment on the left-hand navigation.
The page displays all the Data Lake pipelines in the project. For each Data Lake pipeline, the service also displays the following information:
Column Name | Description |
|---|---|
Pipeline Name | Name of your Data Lake pipeline. Each pipeline can produce
multiple datasets. You can expand the name to view the
datasets in the pipeline. |
Data Source | Source for the data in the pipeline datasets. For data
from a collection on the Atlas cluster, this column
shows the cluster name, the database name, and the
collection name separated by |. |
Data Size | Size of data for each dataset. |
Last Run Time | Date and time when the pipeline ran to ingest data for
each dataset. |
Status | Status of the pipeline. Value can be one of the following for a pipeline:
|
Frequency | Frequency at which cluster data is ingested and stored
for querying. |
Actions | Actions you can take for each pipeline. You can click one of the following:
|
View Atlas Data Lake Pipelines from the API
To retrieve all your Data Lake pipelines for a project through the API,
send a GET request to the Data Lake pipelines endpoint. To learn more about
the pipelines endpoint syntax and parameters for retrieving all of
your Data Lake pipelines, see Return All Data Lake
Pipelines from One Project.
To retrieve one of your Data Lake pipelines through the API, send a
GET request to the Data Lake
pipelines endpoint with the name of the Data Lake pipeline that you
want to retrieve. To learn more about the pipelines endpoint syntax
and parameters for retrieving one of your Data Lake pipelines, see
Return One Data Lake Pipeline.
View Atlas Data Lake Pipeline Runs from the API
To retrieve all the completed Data Lake pipeline data ingestion jobs for a
project through the API, send a GET request to the
Data Lake runs endpoint. To
learn more about the API syntax and options for the runs
endpoint, see Return All Data Lake Pipeline Runs from
One Project.
To retrieve the details of one of your completed Data Lake pipeline data
ingestion jobs through the API, send a GET request to the
Data Lake runs endpoint with
the unique identifier of the completed Data Lake pipeline data ingestion
job that you want to retrieve. To learn more about the API syntax and
options for the runs endpoint, see Return One Data
Lake Pipeline Run.