> This page location: /docs.md > /docs/development.md > /docs/atlas/release-notes.md

> For the complete MongoDB documentation index, see www.mongodb.com/docs/llms.txt

# Data Federation Changelog

**Note: Release notes mention only releases with feature changes**

MongoDB releases Atlas Data Federation every week, continuously improving Atlas Data Federation performance and stability. These release notes capture only those releases that contain feature changes. If a particular Atlas Data Federation release contains only performance and stability improvements, it is not included in these release notes. To identify which release version you are using, check the release version string for the release date.

## 2024 Releases

### 18 June 2024 Release:

- Supports the ability to read [Parquet](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/data-formats/parquet-data-files.md#std-label-adf-parquet-data-format) files with [zstd](https://www.mongodb.com/docs/manual/reference/glossary/#std-term-zstd) column compression.

### 21 May 2024 Release:

- Adds support for programmatic workloads via OIDC (OpenID Connect) for Atlas Data Federation. To learn more, see [Set up Workload Identity Federation with OAuth 2.0.](https://www.mongodb.com/docs/atlas/workload-oidc.md#std-label-oidc-authentication-workload)

- If you're an Admin user or a user with the [`killop`](https://www.mongodb.com/docs/manual/reference/privilege-actions.md#mongodb-authaction-killop) privilege, you can use the [killOp](https://www.mongodb.com/docs/manual/reference/command/killOp/) command to [terminate any query](https://www.mongodb.com/docs/atlas/data-federation/admin/terminate-running-query.md#std-label-terminate-running-query) on a federated database. The user who issued the query can also terminate the query.

### 14 May 2024 Release:

- Changes which regions process data for unsupported regions:

  - `ca-central-1 (Montreal)` will process data from `ca-west-1 (Alberta)` instead of `eu-west-1 (Ireland)`.

  - `ap-northeast-1 (Tokyo)` will process data:

    - from `ap-northeast-2 (Seoul)` instead of `eu-west-1 (Ireland)`.

    - from `ap-northeast-3 (Osaka)` instead of `eu-west-1 (Ireland)`.

    - from `ap-east-1 (Hong Kong)` instead of `ap-southeast-2 (Sydney)`.

- Fixes an issue where the [killOp](https://www.mongodb.com/docs/manual/reference/command/killOp/) command was prevented from terminating a query.

### 9 April 2024 Release:

- Adds support for the `$sql` stage on Atlas Data Federation views.

- Fixes an issue where, when creating a view, Atlas Data Federation was not properly checking permissions.

### 26 March 2024 Release

- Resolves an issue where generated dates in the ISO 8602 format caused incorrect query results.

### 19 March 2024 Release

- Fixes an issue that prevented the Python driver from failing to connect when using AWS (Amazon Web Services) IAM authentication.

- Fixes an issue that caused [`$limit`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/limit.md#mongodb-pipeline-pipe.-limit) queries to fail with an `InternalError`.

- Improves template partition filtering in the query planner, which improves query performance in certain cases against multiple blob storage sources.

### 28 February 2024 Release

- Makes [Azure data stores](https://www.mongodb.com/docs/atlas/data-federation/config/adf-config-file-formats.md#std-label-adf-configuration-file-azure) generally available for both your development and production deployments.

### 14 February 2024 Release

- Supports separate connection strings for private endpoint connections for [Atlas Data Federation](https://www.mongodb.com/docs/atlas/data-federation/tutorial/config-private-endpoint.md#std-label-config-private-endpoint) and [Online Archive.](https://www.mongodb.com/docs/atlas/online-archive/config-private-endpoint.md#std-label-oa-config-private-endpoint)

### 31 January 2024 Release

- Supports AWS (Amazon Web Services) IAM if you [configure AWS IAM](https://www.mongodb.com/docs/atlas/security/aws-iam-authentication.md#std-label-set-up-pwdless-auth) for authentication. This is currently unsupported in the Atlas UI.

## 2023 Releases

### 05 December 2023 Release

- Changes the error `CommandNotSupported` to `CommandNotFound`.

### 28 November 2023 Release

- Supports OIDC (OpenID Connect) for Microsoft Entra ID, Okta, and Ping Identity as IdPs (Identity Providers). To learn more, see [Authentication and Authorization with OIDC/OAuth 2.0.](https://www.mongodb.com/docs/atlas/security-oidc.md#std-label-oidc-authentication-authorization)

### 31 October 2023 Release

- Improves performance when reading from [Parquet](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/data-formats/parquet-data-files.md#std-label-adf-parquet-data-format) files.

- Adds support for modifying views with `collMod`.

- Adds automatic recognition of `.jsonl` files as JSON Lines files.

- Fixes an issue with [sqlGenerateSchema](https://www.mongodb.com/docs/sql-interface/schema/adf.md#std-label-sqlgenerateschema-cmd) where it wouldn't run on Online Archive source.

### 22 August 2023 Release

- Adds a `lastModified` timestamp field to S3 (Simple Storage Service) object provenance metadata. To learn more, see [`databases.[n].collections.[n].dataSources.[n].provenanceFieldName`.](https://www.mongodb.com/docs/atlas/data-federation/config/adf-config-file-formats.md#mongodb-datalakeconf-aws-datalakeconf-aws.databases.-n-.collections.-n-.dataSources.-n-.provenanceFieldName)

- Supports provenance metadata for Online Archive datasets.

### 08 August 2023 Release

- Improves error message for exceeding the [maxTimeMS](https://www.mongodb.com/docs/manual/reference/method/cursor.maxTimeMS/) limit.

- Improves [explain() results](https://www.mongodb.com/docs/manual/reference/explain-results/) for queries that target Atlas Data Lake datasets and Online Archives.

### 01 August 2023 Release

- Improves performance for queries that utilize the [$ne](https://www.mongodb.com/docs/manual/reference/operator/query/ne/) operator.

### 25 July 2023 Release

- Allows you to set [read concern](https://www.mongodb.com/docs/manual/reference/read-concern/) for [Atlas cluster](https://www.mongodb.com/docs/atlas/data-federation/config/adf-config-file-formats.md#std-label-adf-configuration-file-atlas) data store.

### 27 June 2023 Release

- Supports the `$$SEARCH_META` aggregation variable when you run [`$search`](https://www.mongodb.com/docs/search/query/aggregation-stages/search.md#mongodb-pipeline-pipe.-search) queries on an Atlas cluster through Atlas Data Federation.

### 13 June 2023 Release

- Introduces new [onboarding experience](https://www.mongodb.com/docs/atlas/data-federation/tutorial/getting-started.md#std-label-adf-getting-started) with templates for the most common Atlas Data Federation use cases.

- Improves error message for [$out to S3](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage) queries to provide more detail.

### 09 May 2023 Release

- Optimizes partition attributes for selecting files on S3 (Simple Storage Service) when using the [$in](https://www.mongodb.com/docs/manual/reference/operator/aggregation/in/) operator in aggregation pipelines.

### 18 April 2023 Release

- Modifies the behavior of `$queryHistory` to indicate a query is complete when all batches have been uploaded as cursor files, all batches have been returned to the user, or there is an error.

- Adds the ability to use BSON data for the comment field in commands.

### 04 April 2023 Release

- Improves error messages when querying a document over 16MB.

- Fixes a correctness issue for [$getFields](https://www.mongodb.com/docs/manual/reference/operator/aggregation/getField/) where Atlas Data Federation differed from MongoDB when querying an empty sub-document.

- Improves stability and performance for [$out](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage) to S3 (Simple Storage Service) when writing to Parquet.

### 21 February 2023 Release

- Fixes an issue with `$match` queries that resulted in documents not being returned when querying on nested documents within an array where any nested document was missing the target field.

- Improves performance and stability when writing to Parquet using [$out](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage) to S3 (Simple Storage Service).

- Adds the ability to use any BSON type with the `$comment` operator and query in `$queryHistory`. (Starting in MongoDB 5.1, the `$comment` operator was removed).

- Atlas Data Federation now returns MongoDB 6.2.0 in the [buildInfo output.](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/diagnostic-commands.md#std-label-mql-support-diagnostic-cmd)

### 15 February 2023 Release

- Adds the ability to [limit the amount of data](https://www.mongodb.com/docs/atlas/data-federation/query/manage-query-limits.md#std-label-adf-manage-query-limits) that Atlas Data Federation processes for your federated database instances to control costs.

### 07 February 2023 Release

- Improves error messages when a client attempts to insert, update, or delete a document in a federated database instance.

### 24 January 2023 Release

- Adds the application name to connections that Atlas Data Federation creates to your Atlas clusters.

- Adds the ability to set and update the storage configuration using the Atlas [API.](https://www.mongodb.com/docs/api/doc/atlas-admin-api-v2/group/endpoint-data-federation)

### 11 January 2023 Release

- Fixes an issue that caused `maxTimeMS` with a `batchSize` of `0` to fail.

## 2022 Releases

### 19 December 2022 Release

- Adds new capabilities to the storage configuration to support data provenance and improved flexibility for [federation.](https://www.mongodb.com/docs/atlas/data-federation/config/config-data-stores.md#std-label-config-adf)

- Adds [AWS region](https://www.mongodb.com/docs/atlas/data-federation/adf-overview/regions.md#std-label-atlas-data-federation-regions) `ap-southeast-1` (Singapore).

### 30 November 2022 Release

- Updates Atlas Data Federation to MongoDB 6.0.2.

### 15 November 2022 Release

- Supports [killOp](https://www.mongodb.com/docs/atlas/data-federation/admin/terminate-running-query.md#std-label-terminate-running-query) for [collStats.](https://www.mongodb.com/docs/manual/reference/command/collStats/)

### 25 October 2022 Release

- Improves performance and stability.

- Improves query performance on Atlas Data Lake Datasets using sort metadata to optimize queries.

- Fixes an issue that caused Atlas Data Federation to fail to read a Parquet file when the top-level or root schema was marked as `REPEATED` or `OPTIONAL`.

- Improves stability when writing to Parquet using [$out](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage) to S3 (Simple Storage Service).

### 13 September 2022 Release

- Fixes `$not` and `$in` pipeline issue that caused unsupported expression panic.

- Improves performance for `$out` to S3 (Simple Storage Service) queries that write to Parquet file format.

- Updates the default max row group size to 128MB for the parquet writer.

- Improves [`$group`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/group.md#mongodb-pipeline-pipe.-group) stages on Data Lake Dataset partition fields.

- Fixes aggregation pipelines with multiple `$lookup` stages where one stage defines a field and another removes the same field.

- Fixes how Atlas Data Federation handles files in S3 (Simple Storage Service) that end with the delimiter character (e.g. '/').

### 23 August 2022 Release

- Improves performance and stability.

- Adds support for optionally specifying an ISODate format to optimize performance for date-type partitions.

### 02 August 2022 Release

- Improves performance and stability.

- Performs [$merge](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/merge.md#std-label-adf-merge-stage) in chunks.

### 12 July 2022 Release

- Improves performance and stability.

- Atlas now charges for the total number of bytes that Atlas Data Federation processes from HTTP (HyperText Transport Protocol) sources.

- Adds support for the background option on the [$merge](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/merge.md#std-label-adf-merge-stage) aggregation stage.

### 21 June 2022 Release

- Improves performance and stability.

- Adds support for Atlas Data Lake as a "Store Type" to the `createStore` command.

- Improves error messaging for Federated `$search` queries.

### 07 June 2022 Release

- Renames and relaunches Atlas Data Lake as Atlas Data Federation.

  **Important:**

  The federated query engine service previously called Atlas Data Lake is now called Atlas Data Federation. To learn more about Atlas Data Federation, see [Atlas Data Federation.](https://www.mongodb.com/docs/atlas/data-federation.md#std-label-atlas-data-federation)

### 31 May 2022 Release

- Improves performance and stability.

- Disables support for the MySQL dialect.

### 10 May 2022 Release

- Improves performance and stability.

### 19 April 2022 Release

- Improves performance and stability.

- Supports the following new MongoDB 5.2 aggregation operators:

  - `$sortArray`

  - `$topN`

  - `$bottomN`

  - `$maxN`

  - `$firstN`

  - `$lastN`

- Fixes a bug to allow you to use read preference for sharded clusters.

### 29 March 2022 Release

- Improves performance and stability.

### 15 March 2022 Release

- Improves performance and stability.

- Imposes an upper [limit](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/limitations.md#std-label-df-limitations) on `maxRowGroupSize`.

### 15 February 2022 Release

- Improves performance and stability.

- Renames the `matchComments` field to `queryFilterComments` . To learn more, see [Retrieve Federated Database Instance Query History.](https://www.mongodb.com/docs/atlas/data-federation/query/view-query-history.md#std-label-adf-query-history-stage)

### 18 January 2022 Release

- Improves performance and stability.

- Adds `matchComments` field to query history. To learn more, see [Retrieve Data Lake Query History.](https://www.mongodb.com/docs/atlas/data-federation/query/view-query-history.md#std-label-adf-query-history-stage)

## 2021 Releases

### 28 December 2021 Release

- Improves performance and stability.

- Supports queries on collections prefixed with `system`, but doesn't support queries on collections prefixed with `system.`.

### 07 December 2021 Release

- Improves performance and stability.

- Adds support for the [$maxTimeMS](https://www.mongodb.com/docs/manual/reference/operator/meta/maxTimeMS/) option.

### 16 November 2021 Release

- Improves performance and stability.

- Allows connections to Data Lakes via [private endpoints.](https://www.mongodb.com/docs/atlas/data-federation/admin/manage-private-endpoint.md#std-label-manage-private-endpoint)

- Adds support for X.509 authorization.

- Adds support for empty `field` parameters with the [$setField](https://www.mongodb.com/docs/manual/reference/operator/aggregation/setField/) aggregation expression.

- Fixes an issue where commands returned zero exit codes on failure.

- Fixes an issue where documents with empty subdocuments written to Parquet contained empty parquet groups.

- Updates `EstimateRowGroupSize` to report `UncompressedSize` for documents stored in Parquet.

- Adjusts the minimum value for `maxRowGroupSize` when using [$out](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage) to Parquet to 16MB.

- Removes support for using [$out](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage) to write documents that contain duplicate fields to Parquet.

- Improves error messages for [$out.](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage)

### 27 October 2021 Release

- Improves performance and stability.

- Includes X.509 users in the [usersInfo](https://www.mongodb.com/docs/manual/reference/command/usersInfo/) command output.

- Improves SCRAM authentication performance.

### 05 October 2021 Release

- Improves performance and stability.

- Adds support for the `authenticate` command.

- Preserves binary subtypes in the parquet reader/writer.

### 14 September 2021 Release

- Provides various stability and performance improvements.

- Adds support for `ap-south-1` [region.](https://www.mongodb.com/docs/atlas/data-federation/adf-overview/regions.md#std-label-atlas-data-federation-regions)

- Outputs customer query logs into multiple lines.

- Includes `background` field in [$queryHistory output.](https://www.mongodb.com/docs/atlas/data-federation/query/view-query-history.md#std-label-adf-query-history-stage-output)

- Supports [wildcard databases and collections](https://www.mongodb.com/docs/atlas/data-federation/config/config-data-stores.md#std-label-generate-wildcard-collections) for Atlas data store.

### 25 August 2021 Release

- Provides various stability improvements.

- Improves `collStats` and `dbStats` [command](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/diagnostic-commands.md#std-label-mql-support-diagnostic-cmd) performance and stability.

- Adds support for the [`$merge`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/merge.md#mongodb-pipeline-pipe.-merge) aggregation pipeline stage.

- Allows `localField` and `foreignField` with a more expressive [$lookup](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/lookup-stage.md#std-label-adf-lookup-stage) aggregation pipeline stage syntax.

- Implements the `$count` accumulator.

### 03 August 2021 Release

- Improves performance.

- Improves error messaging.

- Adds `computeTime` and `automaticRefreshInProgress` fields to the `collStats` and `dbStats` [command](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/diagnostic-commands.md#std-label-mql-support-diagnostic-cmd) outputs.

### 12 July 2021 Release

- Supports dropping non-existent [stores](https://www.mongodb.com/docs/atlas/data-federation/admin/cli/stores/drop-store.md#std-label-adf-drop-store-cmd) and [databases](https://www.mongodb.com/docs/atlas/data-federation/admin/cli/database/drop-database.md#std-label-adf-drop-database-cmd) from the storage configuration.

- Includes `partitions.count` in [collStats](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/diagnostic-commands.md#std-label-mql-support-diagnostic-cmd) command output.

### 23 June 2021 Release

- Allows downloading Data Federation query logs from the [UI](https://www.mongodb.com/docs/atlas/data-federation/query/query-federated-database.md#std-label-query-fdi) and [API.](https://www.mongodb.com/docs/api/doc/atlas-admin-api-v2/operation/operation-downloadgroupclusteronlinearchivequerylogs)

- Removes restriction on large collection namespaces.

- Adds option to bypass cache for [collStats](https://www.mongodb.com/docs/manual/reference/command/collStats/) and [dbStats](https://www.mongodb.com/docs/manual/reference/command/dbStats/) to fetch the most recent statistics.

- Supports [serverStatus](https://www.mongodb.com/docs/manual/reference/command/serverStatus/) command.

### 8 June 2021 Release

- Improves stability and performance.

- Supports public S3 data stores with the `public` configuration flag.

- Supports Zstandard compression when federating queries to Atlas clusters.

- Adds `db` field to `dbStats` result.

### 11 May 2021 Release

- Supports selecting read preference, read tags, and max staleness through the [storage configuration](https://www.mongodb.com/docs/atlas/data-federation/config/config-data-stores.md#std-label-config-adf) for Atlas Cluster stores.

- Rejects commands sent with a Versioned API set.

- Enables the `count` parameter in the Data lake [`$collStats` Stage (Atlas Data Federation)](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/collstats.md#std-label-adf-collstats-stage) aggregation stage.

- No longer permits [`$collStats` Stage (Atlas Data Federation)](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/collstats.md#std-label-adf-collstats-stage) in `$facet` sub-pipelines.

- Enforces maximum document size for `$facet` after processing each item.

- Improves performance for `$match` stages.

- Improves error messaging.

### 21 April 2021 Release

- Improves stability and performance.

- Includes improved support for Parquet.

- Supports `M0`, `M2`, & `M5` Atlas clusters as data sources.

- Adds regex pattern matching option for wildcard collections from Atlas Clusters.

- Includes updated error messages for query execution limit.

### 30 March 2021 Release

- Generates storage configuration automatically for the first time after user authentication.

- Returns connection ID through the `hello` command.

- Supports `$geoNear` on Atlas Data Lake collections that span multiple Atlas clusters.

- Includes various performance improvements.

- Includes improved error messages for terminated queries.

### 09 March 2021 Release

- Includes new onboarding and storage configuration interface.

- Improved SQL schema error message.

- Support query pushdown to collections comprised of multiple Atlas collections.

- Improves stability and performance.

### 16 February 2021 Release

- Adds [SQL schema generation](https://www.mongodb.com/docs/sql-interface.md#std-label-connect-with-sql-overview) for wildcard collections.

- Fixes stability and performance issues.

### 26 January 2021 Release

- Adds a new [$sql](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/sql.md#std-label-adf-sql-stage) `formatVersion` to reduce the data size of the result set.

- Improves performance of [`$lookup` Stage (Atlas Data Federation).](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/lookup-stage.md#std-label-adf-lookup-stage)

- Adds `"verbosity": "queryPlannerExtended"` support to the [explain](https://www.mongodb.com/docs/manual/reference/command/explain/) command to filter out non-matching partitions.

- Adds support for [$$NOW.](https://www.mongodb.com/docs/manual/reference/aggregation-variables/#variable.NOW)

- Reports Atlas Data Lake as MongoDB version 4.4 to tools.

### 5 January 2021 Release

- Adds support for the background option on the [$out to Atlas](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage) aggregation stage.

- Includes stability and performance improvements.

## 2020 Releases

### 16 December 2020 Release

- Adds `{background: true}` option, which allows queries to run in the background for [$out](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage) to S3 (Simple Storage Service) stage.

- Introduces `$queryHistory` aggregation stage to view past queries.

- Includes various performance and stability improvements.

### 24 November 2020 Release

- Supports Parquet, CSV, and TSV formats for [`$out`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/out.md#mongodb-pipeline-pipe.-out) to S3 (Simple Storage Service).

- Adds a rolling limit for cursors.

- Improves error messages for commands that cannot be parsed.

### 03 November 2020 Release

- Supports the [`$geoNear`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/geoNear.md#mongodb-pipeline-pipe.-geoNear) and [`$graphLookup`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/graphLookup.md#mongodb-pipeline-pipe.-graphLookup) [aggregation pipeline stages](https://www.mongodb.com/docs/manual/reference/operator/aggregation-pipeline/) in queries on federated database instance collections that reference a single Atlas collection.

- Updates summary information in [explain](https://www.mongodb.com/docs/manual/reference/command/explain/) output.

### 13 October 2020 Release

- Supports `defaultFormat` for files in publicly accessible URL (Uniform Resource Locator)s in HTTP (HyperText Transport Protocol) stores.

- Limits the number of simultaneous queries to 30 per federated database instance.

- Supports `bzip2` compression format.

- Supports `comment` option for the [aggregate](https://www.mongodb.com/docs/manual/reference/command/aggregate/) command.

- Includes various performance and stability improvements.

### 22 September 2020 Release

- Supports [killOp](https://www.mongodb.com/docs/atlas/data-federation/admin/terminate-running-query.md#std-label-terminate-running-query) command for terminating a long-running query.

- Adds [`configuration`](https://www.mongodb.com/docs/atlas/data-federation/config/adf-config-file-formats.md#mongodb-datalakeconf-aws-datalakeconf-aws.databases.-n-.maxWildcardCollections) for maximum number of wildcard collections for S3 (Simple Storage Service) federated database instance stores.

### 01 September 2020 Release

- Supports [HTTP URLs](https://www.mongodb.com/docs/atlas/data-federation/config/config-data-stores.md#std-label-config-adf) as a data source.

- Supports AWS (Amazon Web Services) S3 (Simple Storage Service) [Intelligent Tiering](https://aws.amazon.com/s3/storage-classes/#Unknown_or_changing_access) and [Standard-Infrequent Access](https://aws.amazon.com/s3/storage-classes/#Infrequent_access) storage classes.

- Supports [`$unionWith`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/unionWith.md#mongodb-pipeline-pipe.-unionWith) aggregation stage.

- Restricts federated database instance [connection string](https://www.mongodb.com/docs/atlas/data-federation/tutorial/connect.md#std-label-fdi-connect) authentication to one user at a time.

- Includes general performance and stability improvements.

### 18 August 2020 Release

- Improves [$out](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage) to S3 (Simple Storage Service) write performance.

- Includes general performance and stability improvements.

### 13 August 2020 Release

- Adds `correlationID` to the [$currentOp](https://www.mongodb.com/docs/atlas/data-federation/admin/determine-query-status.md#std-label-determine-query-status) output.

- Includes general performance and stability improvements.

### 28 July 2020 Release

- Relaxes [$out](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage) S3 (Simple Storage Service) region requirement.

- Includes improved [storage configuration](https://www.mongodb.com/docs/atlas/data-federation/config/config-data-stores.md#std-label-config-adf) error messages.

- Includes general performance and stability improvements.

### 14 July 2020 Release

- Supports [`$collStats`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/collStats.md#mongodb-pipeline-pipe.-collStats) aggregation pipeline stage.

- Includes performance optimizations for [ORC](https://orc.apache.org/docs/) files.

- Includes general performance and stability improvements.

### 07 July 2020 Release

- Adds support for the `skip` and `limit` fields to the `count()` command.

### 16 June 2020 Release

- Adds `storageValidateConfig` command to validate your federated database instance [storage configuration.](https://www.mongodb.com/docs/atlas/data-federation/config/config-data-stores.md#std-label-config-adf)

- Includes bug fixes and performance improvements.

### 02 June 2020 Release

- Includes general performance and stability improvements.

### 26 May 2020 Release

- Adds support for [Atlas Clusters](https://www.mongodb.com/docs/atlas/scale-cluster/) as a data source.

- Improves performance for the [`$lookup` Stage (Atlas Data Federation)](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/lookup-stage.md#std-label-adf-lookup-stage) aggregation pipeline stage.

- Adds support for evaluating string [$convert](https://www.mongodb.com/docs/manual/reference/operator/aggregation/convert/) expressions in the `filename` for [$out](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage) to S3 (Simple Storage Service).

- Updates [Parquet](https://parquet.apache.org/docs/) support for [MAP types.](https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#nested-types)

- Improves error messaging for [$out](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/pipeline/out.md#std-label-adf-out-stage) to S3 (Simple Storage Service).

- Adds a command to generate a storage configuration.

### 12 May 2020 Release

- Automates storage configuration generation for newly created federated database instances.

- Allows write partitioning-aware data to S3 using the [`$out`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/out.md#mongodb-pipeline-pipe.-out) in Data Federation.

### 05 May 2020 Release

- Generates Storage Configs when Atlas creates a federated database instance.

- Adds support for [`$out`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/out.md#mongodb-pipeline-pipe.-out) to S3 (Simple Storage Service).

- Updates support for [Apache Parquet](https://parquet.apache.org/) [LIST](https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#lists) element.

- Upgrades [wire protocol](https://www.mongodb.com/docs/manual/reference/mongodb-wire-protocol/) support to 4.2 from 3.6.

- Adds support for verbosity in the explain plan.

### 26 April 2020 Release

- Fixes stability issues.

### 14 April 2020 Release

- Improves performance.

- Supports the [$currentOp](https://www.mongodb.com/docs/manual/reference/operator/aggregation/currentOp/) stage so that you can monitor query progress on long-running queries.

- Updates the [isodate](https://www.mongodb.com/docs/atlas/data-federation/supported-unsupported/supported-partition-attributes.md#std-label-adf-path-attribute-types) attribute to accept additional formats.

- Refreshes the metadata catalog when you use [Storage Configuration](https://www.mongodb.com/docs/atlas/data-federation/config/config-data-stores.md#std-label-config-adf) commands.

### 26 March 2020 Release

- Includes various performance and stability improvements.

- Supports filename field references for [`$out`.](https://www.mongodb.com/docs/manual/reference/operator/aggregation/out.md#mongodb-pipeline-pipe.-out)

- Supports [$toString](https://www.mongodb.com/docs/manual/reference/operator/aggregation/toString/) in [`$out`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/out.md#mongodb-pipeline-pipe.-out) to S3 (Simple Storage Service).

### 09 March 2020 Release

- Supports optionally granting federated database instance write access to S3 buckets, enabling use of [`$out`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/out.md#mongodb-pipeline-pipe.-out) semantics to write directly to those buckets.

- Adds incremental [store](https://www.mongodb.com/docs/atlas/data-federation/admin/manage-federated-database.md#std-label-adf-cli), [database](https://www.mongodb.com/docs/atlas/data-federation/admin/manage-federated-database.md#std-label-adf-cli), [collection](https://www.mongodb.com/docs/atlas/data-federation/admin/manage-federated-database.md#std-label-adf-cli), and [view](https://www.mongodb.com/docs/atlas/data-federation/admin/manage-federated-database.md#std-label-adf-cli) commands for storage configuration management.

- Limits collections returned for wildcard collections to 1,000.

- Updates the storage configuration format.

### 11 February 2020 Release

- Supports cross-database [`$lookup`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/lookup.md#mongodb-pipeline-pipe.-lookup) queries.

- Supports lowercase and uppercase file extensions.

- Template segments now support dot-separated attribute names that correspond to nested fields.

### 21 January 2020 Release

- Allows the [defaultFormat](https://www.mongodb.com/docs/atlas/data-federation/config/adf-config-file-formats.md#std-label-adf-aws-databases-reference) to be specified without a leading dot.

- Supports filtering based on stripes for files in ORC format.

- Allows query attributes to be extracted after the first stage.

## 2019 Releases

### 10 December 2019 Release

- Includes several performance and stability improvements.

- Supports partition definition for the following:

  - `epoch_secs`, which is seconds since the Unix Epoch

  - `epoch_millis`, which is milliseconds since the Unix Epoch

  - `UUID`, which is binary subtype 4

### 11 November 2019 Release

- Includes several performance and stability improvements.

- Adds support for reading Apache ORC files.

### 29 October 2019 Release

- Supports filtering partitions by [Parquet file row group](https://parquet.apache.org/docs/) statistics.

- Supports [ObjectIds](https://www.mongodb.com/docs/manual/reference/method/ObjectId/) in the path when specifying partition `databases.<database>.<collection>.[n].definition`.

### 08 October 2019 Release

- Returns an error if a query produces a document larger than 16 MiB.

- The [`$indexStats`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/indexStats.md#mongodb-pipeline-pipe.-indexStats) stage now produces an empty list of indexes instead of an error.

- Supports [`$out`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/out.md#mongodb-pipeline-pipe.-out) to S3 storage format in JSON.

- [`$match`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/match.md#mongodb-pipeline-pipe.-match) now implicitly treats all terms as conjunctions.

- No longer parses empty files.

- Fixes an issue that caused the `{$match: {$expr: {$and: []}}}` expression to terminate the connection.

### 17 September 2019 Release

- Allows nested fields in partition [definitions.](https://www.mongodb.com/docs/atlas/data-federation/config/path-syntax-examples.md#std-label-adf-path-syntax)

- No longer enumerates directories on S3 when a single subdirectory containing all the partitions matching the query is identified.

- Fixes an issue where the new storage configuration did not appear on the issuing connection after running [setStorageConfig.](https://www.mongodb.com/docs/atlas/data-federation/config/config-data-stores.md#std-label-adf-setstorageconfig)

### 21 August 2019 Release

- Adds support for the [`getLastError`](https://www.mongodb.com/docs/manual/reference/command/getLastError.md#mongodb-dbcommand-dbcmd.getLastError) database command.

- Fixes a bug with how union types are handled in Avro.

- Supports [`$out`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/out.md#mongodb-pipeline-pipe.-out) aggregation pipeline stage to S3.

- [`listIndexes`](https://www.mongodb.com/docs/manual/reference/command/listIndexes.md#mongodb-dbcommand-dbcmd.listIndexes) now always returns an empty list.

- Translates dot-delimited CSV and TSV keys into subdocuments.

- Storage configuration error message now includes a link to the documentation.

- Supports the XLSX file format.

- Includes the correlation ID in query execution error messages.

- Returns an error to the client when the cursor storage limit is reached.

- Returns an error to the client on the last [`getMore`](https://www.mongodb.com/docs/manual/reference/command/getMore.md#mongodb-dbcommand-dbcmd.getMore) if the cursor storage limit is exceeded.

### 30 July 2019

- Supports [`listCommands`](https://www.mongodb.com/docs/manual/reference/command/listCommands.md#mongodb-dbcommand-dbcmd.listCommands). For example: `db.runCommand({"listCommands": 1})`

- Includes partition size information in the output of [`explain()`.](https://www.mongodb.com/docs/manual/reference/method/db.collection.explain.md#mongodb-method-db.collection.explain)

### 08 July 2019

- Returns the first batch of cursor results more quickly.

- Improves performance of [`$lookup`](https://www.mongodb.com/docs/manual/reference/operator/aggregation/lookup.md#mongodb-pipeline-pipe.-lookup) when combined with [`$unwind`.](https://www.mongodb.com/docs/manual/reference/operator/aggregation/unwind.md#mongodb-pipeline-pipe.-unwind)

- Automatically supports `SCRAM-SHA-1` credentials without requiring drivers to specify this authentication mechanism.

- Provides a descriptive error message when the file format is unknown.

- Provides additional validation on [setStorageConfig.](https://www.mongodb.com/docs/atlas/data-federation/config/config-data-stores.md#std-label-adf-setstorageconfig)

### 18 June 2019

Initial public preview release of [Atlas Data Federation.](https://www.mongodb.com/docs/atlas/data-federation.md#std-label-atlas-data-federation)
