Docs Menu

Docs HomeMongoDB Atlas Data Lake

Trigger Data Ingestion On Demand

You can manually trigger an ingestion of snapshot data from the Atlas cluster to Atlas Data Lake datasets if you configured On Demand extraction in your Data Lake pipeline. You can trigger data ingestion from the Atlas UI and Data Lake Pipelines API.

1
2
3
4

The dropdown shows a list of all the snapshots on your Atlas cluster. However, you can select only the snapshots from which Data Lake hasn't yet ingested data; the grayed-out snapshots are snapshots from which your Data Lake has already ingested data.

You can also send a GET request to the Data Lake availableSnapshots endpoint to retrieve the list of backup snapshots that you can use to trigger an on-demand pipeline run. To learn more about the API syntax and options for the availableSnapshots endpoint, see Return Available Backup Snapshots for One Data Lake Pipeline.

5

Atlas displays a blue banner at the top of the page that shows the data ingestion status.

To trigger data ingestion through the API, send a POST request to the Data Lake trigger endpoint with the name of the pipeline for which you want to trigger data ingestion. To learn more about the API syntax and parameters for the trigger endpoint, see Trigger On-Demand Snapshot Ingestion.

Tip

You can send a GET request to the Data Lake availableSnapshots endpoint to retrieve the list of backup snapshots that you can use to trigger an on-demand pipeline run. To learn more about the API syntax and options for the availableSnapshots endpoint, see Return Available Backup Snapshots for One Data Lake Pipeline.

←  Edit an Atlas Data Lake PipelinePause Data Ingestion for Your Data Lake Pipeline →
Share Feedback
© 2023 MongoDB, Inc.

About

  • Careers
  • Investor Relations
  • Legal Notices
  • Privacy Notices
  • Security Information
  • Trust Center
© 2023 MongoDB, Inc.