You incur Atlas Data Lake costs for the following items:
- Storage on the cloud object storage
- Data processed by Data Lake
- Data returned by Data Lake
Atlas charges for the total number of bytes that Data Lake processes from your AWS S3 buckets, rounded up to the nearest megabyte. Atlas charges $5.00 per TB of processed data, with a minimum of 10 MB or $0.00005 per query.
You incur "Data Processed" costs for the amount of data that Atlas Data Lake processes to return results for your queries in addition to the "Data Returned" cost for the amount of data that Atlas Data Lake returns. For example, for a 10 GB file, you incur the following "Data Processed" cost in addition to the "Data Returned" cost:
- If you have no partitions, Atlas Data Lake reads the entire file to return results for the query. Therefore, you incur 10 GB of "Data Processed" cost.
- If you have 10 partitions of 1 GB each, Atlas Data Lake targets and reads a single partition. Therefore, you incur 1 GB of "Data Processed" cost.
You can use partitioning strategies and compression in AWS S3 to reduce the amount of processed data.
Atlas charges for the total number of bytes returned and transferred by Data Lake. This total is the sum of all the following data transfers:
- The number of bytes transferred between internal Data Lake service nodes
- The number of bytes transferred from Data Lake to the client
- The number of bytes written by Data Lake during
Returned data is billed as outlined in the Data Transfer Fees section of the Atlas pricing page. The cost of data transfer depends on the Cloud Service Provider charges for same-region, region-to-region, or region-to-internet data transfer.