Database Tools Changelog
On this page
100.5.3 Changelog
Released 2022-06-14
This release contains a number of bug fixes and changes. Highlights include support for clustered collections in mongorestore, updating our Go version from 1.16.7 to 1.17.8 to address CVEs, and supported platform updates.
Build Failure
- TOOLS-3119 - All builds are failing on RHEL6.2
- TOOLS-3126 - The unit tests for options processing segfault on macOS
- TOOLS-3127 - The dist CI task is failing on Windows
Bug
- TOOLS-2958 - An index deletion or collMod in the oplog can be applied to the wrong index
- TOOLS-2961 - The RHEL82 ARM release does not use the correct architecture
- TOOLS-2963 - Tools are not prompting for a password in many cases where they should
- TOOLS-3044 - The zip file for tools on Windows contains invalid paths
- TOOLS-3071- Tools installed by RPM packages to /usr/bin are owned by mongod:mongod instead of root:root
Task
- TOOLS-2906 - Update Evergreen config to use new merge key format
- TOOLS-3001 - bsondump should allow documents up to the internal max bson size (16mb + 16kb)
- TOOLS-3028 - Remove evergreen batchtimes from ZAP
- TOOLS-3049 - Update the Go version used to build mongo-tools to address several critical and high CVEs
- TOOLS-3050 - Add Debian 11 to platforms we publish tools packages for
- TOOLS-3095 - Remove Ubuntu 14.04 from CI and release platforms
- TOOLS-3104 - Add tests for 5.3 to evergreen
- TOOLS-3105 - Pin Go driver to version 1.9.1
- TOOLS-3106 - Remove tests for 5.1 and 5.2 for most platforms
- TOOLS-3108 - Update mongorestore to support clustered indexes
- TOOLS-3116 - Change Windows build to run on windows-vsCurrent-large
100.5.2 Changelog
Released 2022-02-03
This release fixes an issue where inserting large documents with or could cause extremely high memory usage (TOOLS-2875). It also fixes a few minor bugs.
Bug
- TOOLS-2745 Tools don't support setting
retryWrites=false
in URI parameter - TOOLS-2983 Some error messages for conflicting URI/CLI arguments are misleading
Task
- TOOLS-2875 Limit the
BufferedBulkInserter
batch size by bytes
100.5.1 Changelog
Released 2021-10-12
This release fixes an issue where certain config
collections which
should generally be ignored were included by mongodump
and mongorestore
. This release also ensures that any
operations on these collections will not be applied during the oplog
replay phase of mongorestore
.
Bug
- TOOLS-2952 Filter config collections in dump/restore
100.5.0 Changelog
Released 2021-08-10
This release includes support for the loadbalanced URI option, which provides compatibility with MongoDB Atlas Serverless.
Build Failure
- TOOLS-2938 Re-add Ubuntu 16.04 PowerPC platform
Release
- TOOLS-2880 Release Database Tools 100.5.0
Bug
- TOOLS-2863 cs.AuthMechanismProperties is not initialized when mechanism set by --authenticationMechanism
New Feature
- TOOLS-2937 Set loadbalanced option in db.configureClient()
Task
- TOOLS-2932 Upgrade to Go Driver 1.7.1
100.4.1 Changelog
Released 2021-07-23
This patch fixes a bug (:issue:` TOOLS-2931`) that was introduced in
version 100.4.0
which causes mongodump
to skip any
document that contains an empty field name (e.g. { "": "foo" }
).
Documents with empty field names were not skipped by default if the
--query
or --queryFile
options were specified. No tools other
than mongodump
were affected. It is highly recommended to
upgrade to 100.4.1
if it is possible that your database contains
documents with empty field names.
Build Failure
- TOOLS-2927 Clean up the platforms list inside platform.go
Release
- TOOLS-2929 Release Database Tools 100.4.1
Bug
- TOOLS-2931 mongodump skips documents with empty field names
Task
- TOOLS-2926 Run release on 'test' and 'development' linux repo separately.
100.4.0 Changelog
Released 2021-07-19
This release includes MongoDB Server 5.0 support, including dump/restoring of timeseries collections.
Build Failure
- TOOLS-2892 aws-auth tests failing on all variants
- TOOLS-2893 legacy-js-tests 4.4 and 5.0 failing on all variants
Release
- TOOLS-2845 Release Database Tools 100.4.0
Bug
- TOOLS-2041 Mongorestore should handle duplicate key errors during oplog replay
- TOOLS-2833 Creating an index with partialFilterExpression during oplogReplay fails
- TOOLS-2925 RPM packages are only signed with the 4.4 auth token
New Feature
- TOOLS-2857 Dump timeseries collections
- TOOLS-2858 Mongodump can query timeseries collections by metadata
- TOOLS-2859 Restore timeseries collections
- TOOLS-2860 Include/Exclude/Rename timeseries collections in mongorestore
Task
- TOOLS-2719 Add Enterprise RHEL 8 zSeries to Tools
- TOOLS-2721 Add RHEL8 ARM to Tools
- TOOLS-2777 Generate Full JSON variant should not be running on every commit
- TOOLS-2823 Build with go 1.16
- TOOLS-2824 Add static analysis task that runs "evergreen validate"
- TOOLS-2849 Mongodump should fail during resharding
- TOOLS-2850 Mongorestore should fail when restoring geoHaystack indexes to 4.9.0
- TOOLS-2851 importCollection command should cause mongodump to fail
- TOOLS-2853 Hide deprecated --slaveOk option
- TOOLS-2866 Drop support for zSeries platforms
- TOOLS-2873 Run full test suite on all supported distros in evergreen
- TOOLS-2881 Push tools releases to 4.9+ linux repos
- TOOLS-2921 Upgrade to Go Driver 1.6
100.3.1 Changelog
Released 2021-03-17
This release includes various bug fixes. Particularly notable is
TOOLS-2783, where we reverted a change from 100.2.1
(TOOLS-1856: use a memory pool in mongorestore
)
after discovering that it was causing memory usage issues.
Build Failure
- TOOLS-2796 mongotop_sharded.js failing on all versions of the qa-tests
- TOOLS-2815 Development build artifacts accidentally uploaded for versioned release
Release
- TOOLS-2791 Release Database Tools 100.3.1
Bug
- TOOLS-2584 Restoring single BSON file should use db set in URI
- TOOLS-2783 Mongorestore uses huge amount of RAM
Task
- TOOLS-704 Remove system.indexes collection dumping from mongodump
- TOOLS-2801 Migrate from dep to Go modules and update README
- TOOLS-2802 Make mongo-tools-common a subpackage of mongo-tools
- TOOLS-2805 Add mod tidy static analysis check for Go modules
- TOOLS-2806 Migrate mongo-tools-common unit tests to mongo-tools
- TOOLS-2807 Migrate mongo-tools-common integration tests to mongo-tools
- TOOLS-2808 Migrate mongo-tools-common IAM auth tests to mongo-tools
100.3.0 Changelog
Released 2021-02-04
This release includes support for PKCS8-encrypted client private keys, support for providing secrets in a config file instead of on the command line, and a few small bug fixes.
Build Failure
- TOOLS-2795 Tools failing to build on SUSE15-sp2
- TOOLS-2800 RPM creation failing on amazon linux 1
Release
- TOOLS-2790 Release Database Tools 100.3.0
Investigation
- TOOLS-2771 SSL connection problems mongodump
Bug
- TOOLS-2751 Deferred query EstimatedDocumentCount helper incorrect with filter
- TOOLS-2760 rpm package should not obsolete itself
- TOOLS-2775 --local does not work with multi-file get or get_regex
New Feature
- TOOLS-2779 Add --config option for password values
Task
- TOOLS-2013 Support PKCS8 encrypted client private keys
- TOOLS-2707 Build mongo-tools and mongo-tools-common with go 1.15
- TOOLS-2780 Add warning when password value appears on command line
- TOOLS-2798 Add Amazon Linux 2 Arm64 to Tools
100.2.1 Changelog
Released 2020-11-13
This release includes a mongorestore
performance
improvement, a fix for a bug affecting highly parallel
mongorestore
instances, and an observability improvement
to mongodump
and mongoexport
, in addition
to a number of internal build/release changes.
Build Failure
- TOOLS-2767 Windows 64 dist task fails
Release
- TOOLS-2741 Release Database Tools 100.2.1
Bug
- TOOLS-2744 mongorestore not scaling due to unnecessary incremental sleep time
New Feature
- TOOLS-2750 Log before getting collection counts
Task
- TOOLS-1856 use a memory pool in mongorestore
- TOOLS-2651 Simplify build scripts
- TOOLS-2687 Add archived releases JSON feed for Database Tools
- TOOLS-2735 Move server vendoring instructions to a README in the repo
- TOOLS-2748 Add a String() to OpTime
- TOOLS-2758 Bump Go driver to 1.4.2
100.2.0 Changelog
Released 2020-10-15
This release deprecates the --sslAllowInvalidHostnames
and
--sslAllowInvalidCertificates
flags in favor of a new
--tlsInsecure
flag. The mongofiles
put
and
mongofiles
get
commands can now accept a list of file
names. There is a new mongofiles
get_regex
command to
retrieve all files matching a regex pattern. The 100.2.0
release
also contains fixes for several bugs. It fixes a bug introduced in
version 100.1.0
that made it impossible to connect to clusters with
an SRV connection string (TOOLS-2711).
Build Failure
- TOOLS-2693 Most tasks failing on race detector variant
- TOOLS-2737 Fix TLS tests on Mac and Windows
- TOOLS-2747 Git tag release process does not work
Release
- TOOLS-2704 Release Database Tools 100.2.0
Bug
- TOOLS-2587 sslAllowInvalidHostnames bypass ssl/tls server certification validation entirely
- TOOLS-2688
mongodump
does not handle EOF when passing in the password as STDIN - TOOLS-2706 tar: implausibly old time stamp error on Amazon Linux/RHEL
- TOOLS-2708 Atlas recommended connection string for
mongostat
doesn't work - TOOLS-2710 Non-zero index key values are not preserved in ConvertLegacyIndexes
- TOOLS-2711 Tools fail with "a direct connection cannot be made if multiple hosts are specified" if mongodb+srv URI or a legacy uri containing multiple
mongos
is specified - TOOLS-2716
mongodb-database-tools
package should break older versions ofmongodb-*-tools
New Feature
- TOOLS-2667 Support list of files for
put
andget
subcommands inmongofiles
- TOOLS-2668 Create regex interface for getting files from remote FS in
mongofiles
Task
- TOOLS-2674 Clarify contribution guidelines
- TOOLS-2700 Use git tags for triggering release versions
- TOOLS-2701 Log target linux repo in push task
100.1.1 Changelog
Released 2020-07-31
This release contains a fix for a linux packaging bug and a
mongorestore
bug related to the
--convertLegacyIndexes
flag.
Release
- TOOLS-2685 Release Database Tools 100.1.1
Bug
- TOOLS-2645 Check for duplicate index keys after converting legacy index definitions
- TOOLS-2683 Ubuntu 16.04 DB Tools 100.1.0 DEB depends on
libcom-err2
, should belibcomerr2
100.1.0 Changelog
Released 2020-07-24
This release officially adds support for MongoDB 4.4. In addition to
various bug fixes, it adds support for MongoDB 4.4's new MONGODB-AWS
authentication mechanism.
The full list of changes is below:
Build Failure
- TOOLS-2604 integration-4.4-cluster is failing on master
- TOOLS-2638 Test-case failure for mongorestore
- TOOLS-2643 New linux distros missing from repo-config.yaml
Release
- TOOLS-2630 Release Database Tools 100.1.0
Bug
- TOOLS-2287 URI parser incorrectly prints unsupported parameter warnings
- TOOLS-2337 nsInclude does not work with percent encoded namespaces
- TOOLS-2366 ^C isn't handled by mongodump
- TOOLS-2494 mongorestore thorw error "panic: close of closed channel"
- TOOLS-2531 mongorestore hung if restoring views with --preserveUUID --drop options
- TOOLS-2596 DBTools --help links to old Manual doc pages
- TOOLS-2597 swallows errors from URI parsing
- TOOLS-2609 Detached signatures incorrectly appearing in download JSON
- TOOLS-2622 Tools do not build following README instructions
- TOOLS-2669 macOS zip archive structure incorrect
- TOOLS-2670 Troubleshoot IAM auth options errors
New Feature
- TOOLS-2369 IAM Role-based authentication
Task
- TOOLS-2363 Update warning message for "mongorestore"
- TOOLS-2476 Notarize builds for macOS catalina
- TOOLS-2505 Add missing 4.4 Platforms
- TOOLS-2534 Ignore startIndexBuild and abortIndexBuild oplog entries in oplog replay
- TOOLS-2535 commitIndexBuild and createIndexes oplog entries should build indexes with the createIndexes command during oplog replay
- TOOLS-2554 Remove ReplSetTest file dependencies from repo
- TOOLS-2569 Update tools to go driver 1.4.0
- TOOLS-2618 Refactor AWS IAM auth testing code
- TOOLS-2628 Add 3.4 tests to evg
- TOOLS-2644 Update barque authentication
- TOOLS-2650 Create changelog for tools releases
100.0.2 Changelog
This release contains several bugfixes. It also adds support for dumping and restoring collections with long names since the 120 byte name limit will be raised to 255 bytes in MongoDB version 4.4.
The full list of changes is below:
Bug
- TOOLS-1785 Typo in mongodump help
- TOOLS-2495 Oplog replay can't handle entries > 16 MB
- TOOLS-2498 Nil pointer error mongodump
- TOOLS-2559 Error on uninstalling database-tools 99.0.1-1 RPM
- TOOLS-2575 mongorestore panic during convertLegacyIndexes from 4.4 mongodump
- TOOLS-2593 Fix special handling of $admin filenames
Task
- TOOLS-2446 Add MMAPV1 testing to Tools tests
- TOOLS-2469 Accept multiple certs in CA
- TOOLS-2530 Mongorestore can restore from new mongodump format
- TOOLS-2537 Ignore config.system.indexBuilds namespace
- TOOLS-2544 Add 4.4 tests to Evergreen
- TOOLS-2551 Split release uploading into per-distro tasks
- TOOLS-2555 Support directConnection option
- TOOLS-2561 Sign mongodb-tools tarballs
- TOOLS-2605 Cut 100.0.2 release
100.0.1 Changelog
This release was a test of our new release infrastructure and contains no changes from 100.0.0.
Task
- TOOLS-2493 Cut tools 100.0.0 and 100.0.1 GA releases
100.0.0 Changelog
This is the first separate release of the Database Tools from the
Server. We decided to move to a separate release so we can ship new
features and bugfixes more frequently. The new separate release version
starts from 100.0.0
to make it clear the versioning is separate from
the Server. You can read more about this on the
MongoDB blog.
This release contains bugfixes, some new command-line options, and quality of life improvements. A full list can be found below, but here are some highlights:
- There are no longer restrictions on using
--uri
with other connection options such as--port
and--password
as long as the URI and the explicit option don't provide conflicting information. Connection strings can now be specified as a positional argument without the--uri
option. - The new
--useArrayIndexFields
flag formongoimport
interprets natural numbers in fields as array indexes when importing csv or tsv files. - The new
--convertLegacyIndexes
flag formongorestore
removes any invalid index options specified in the correspondingmongodump
output, and rewrites any legacy index key values to use valid values. - A new
delete
mode
formongoimport
. With--mode
delete
,mongoimport
deletes existing documents in the database that match a document in the import file.
Build Failure
- TOOLS-2489 format-go task failing on master
Bug
- TOOLS-1493 Tools crash running help when terminal width is low
- TOOLS-1786 mongodump does not create metadata.json file for views dumped as collections
- TOOLS-1826 mongorestore panic in archive mode when replay oplog failed
- TOOLS-1909 mongoimport does not report that it supports the decimal type
- TOOLS-2275 autoIndexId:false is not supported in 4.0
- TOOLS-2334 Skip system collections during oplog replay
- TOOLS-2336 Wrong deprecation error message printed when restoring from stdin
- TOOLS-2346 mongodump --archive to stdout corrupts archive when prompting for password
- TOOLS-2379 mongodump/mongorestore error if source database has an invalid index option
- TOOLS-2380 mongodump fails against hidden node with authentication enabled
- TOOLS-2381 Restore no socket timeout behavior
- TOOLS-2395 Incorrect message for oplog overflow
- TOOLS-2403 mongorestore hang while replaying last oplog failed in archive mode
- TOOLS-2422 admin.tempusers is not dropped by mongorestore
- TOOLS-2423 mongorestore does not drop admin.tempusers if it exists in the dump
- TOOLS-2455 mongorestore hangs on invalid archive
- TOOLS-2462 Password prompt does not work on windows
- TOOLS-2497 mongorestore may incorrectly validate index name length before calling createIndexes
- TOOLS-2513 Creating client options results in connection string validation error
- TOOLS-2520 Fix options parsing for SSL options
- TOOLS-2547 Installing database tools fails on rhel 7.0
- TOOLS-2548 Installing database tools fails on SLES 15
New Feature
- TOOLS-1954 Support roundtrip of mongoexport array notation in mongoimport
- TOOLS-2268 Add remove mode to mongoimport
- TOOLS-2412 Strip unsupported legacy index options
- TOOLS-2430 mongorestore: in dotted index keys, replace "hashed" with "1"
- TOOLS-2459 Allow --uri to be used with other connection string options
- TOOLS-2460 A connection string can be set as a positional argument
- TOOLS-2521 Add support for the tlsDisableOCSPEndpointCheck URI option
- TOOLS-2529 Mongodump outputs new file format for long collection names
Task
- TOOLS-2418 Remove mongoreplay from mongo-tools
- TOOLS-2421 Maintain test coverage after moving tools tests from server
- TOOLS-2438 Create MSI installer in dist task
- TOOLS-2439 Tools formula included in homebrew tap
- TOOLS-2440 Sign MSI installer
- TOOLS-2441 Update release process documentation
- TOOLS-2442 Automate release uploads
- TOOLS-2443 Generate tarball archive in dist task
- TOOLS-2444 Generate deb packages in dist task
- TOOLS-2449 Create sign task
- TOOLS-2464 Update platform support
- TOOLS-2470 Sign linux packages
- TOOLS-2471 Automate JSON download feed generation
- TOOLS-2472 Automate linux package publishing
- TOOLS-2473 Consolidate community and enterprise buildvariants
- TOOLS-2475 Manually verify tools release
- TOOLS-2480 Generate rpm packages in dist task
- TOOLS-2488 Update package naming and versioning
- TOOLS-2493 Cut tools 100.0.0 and 100.0.1 GA releases
- TOOLS-2506 Update maintainer in linux packages
- TOOLS-2523 Remove Ubuntu 12.04 and Debian 7.1 variants
- TOOLS-2536 ignoreUnknownIndexOptions option in the createIndexes command for servers >4.1.9
- TOOLS-2538 Move convertLegacyIndexKeys() from mongorestore to mongo-tools-common
- TOOLS-2539 Publish linux packages to curator with correct names
- TOOLS-2549 Push GA releases to server testing repo
- TOOLS-2550 Push GA releases to the 4.4 repo
- TOOLS-2551 Split release uploading into per-distro tasks