Docs Menu

View Atlas Data Lake Pipelines

You can view all of your Data Lake pipelines through the Atlas UI.

1
2

The page displays all the Data Lake pipelines in the project. For each Data Lake pipeline, the service also displays the following information:

Column Name
Description
Pipeline Name
Name of your Data Lake pipeline. Each pipeline can produce multiple datasets. You can expand the name to view the datasets in the pipeline.
Data Source
Source for the data in the pipeline datasets. For data from a collection on the Atlas cluster, this column shows the cluster name, the database name, and the collection name separated by |.
Data Size
Size of data for each dataset.
Last Updated
Date and time when the pipeline ran to extract data for each dataset.
Status

Status of the pipeline. Value can be one of the following for a pipeline:

  • Active - indicates that the pipeline is active
  • Paused - indicates that data extraction for the pipeline is paused
Frequency
Frequency at which cluster data is extracted and stored for querying.
Actions

Actions you can take for each pipeline. You can click one of the following:

  • to delete a pipeline. You can't undo this action. If you delete a pipeline, Atlas Data Lake deletes the datasets, including the data, and removes the datasets from the Federated Database Instances where they are referenced. If you delete a dataset inside a pipeline, Atlas Data Lake removes the dataset from the Federated Database Instance storage configuration where the dataset is referenced.
  • to edit the data extraction schedule for the pipeline.
  • to pause data extraction.
←  Manage Atlas Data Lake PipelinePause Data Extraction for Your Data Lake Pipeline →
Give Feedback
© 2022 MongoDB, Inc.

About

  • Careers
  • Investor Relations
  • Legal Notices
  • Privacy Notices
  • Security Information
  • Trust Center
© 2022 MongoDB, Inc.