MongoDB 6.0.4: Secondary replicaset node crash

We are facing a weird issue in our 3 node replica-set cluster

Environment details:

MongoDB version: 6.0.4
OS: Amazon Linux 2

Installation using : yum

We stopped and started one of the secondary node on AWS cloud; and the systemctl mongodb service failed to start after booting-up with error code 51.

We tried below approaches for recovery of the secondary node; but all ended with the same error as mentioned in error logs:
a. create new snapshot of /data directory from working replicaset node; and start the replicaset node
b. restore from last EBS snapshot
c. Remove /data/mongodb.lock file and restart the mongodb server
d. Tried starting it as standalone node
e. Tried with --repair option with starting as standalone node

The only solution worked was to re-initialise the secondary node. However; this makes the EBS snapshot backup/restore process in-feasible.

Please advise.

Error logs observed on the node

{"t":{"$date":"2025-06-20T15:33:20.526+00:00"},"s":"I",  "c":"NETWORK",  "id":4915701, "ctx":"-","msg":"Initialized wire specification","attr":{"spec":{"incomingExternalClient":{"minWireVersion":0,"maxWireVersion":17},"incomingInternalClient":{"minWireVersion":0,"maxWireVersion":17},"outgoing":{"minWireVersion":6,"maxWireVersion":17},"isInternalClient":true}}}
{"t":{"$date":"2025-06-20T15:33:20.528+00:00"},"s":"I",  "c":"NETWORK",  "id":4648601, "ctx":"main","msg":"Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize."}
{"t":{"$date":"2025-06-20T15:33:20.530+00:00"},"s":"I",  "c":"REPL",     "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"TenantMigrationDonorService","namespace":"config.tenantMigrationDonors"}}
{"t":{"$date":"2025-06-20T15:33:20.530+00:00"},"s":"I",  "c":"REPL",     "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"TenantMigrationRecipientService","namespace":"config.tenantMigrationRecipients"}}
{"t":{"$date":"2025-06-20T15:33:20.530+00:00"},"s":"I",  "c":"REPL",     "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"ShardSplitDonorService","namespace":"config.tenantSplitDonors"}}
{"t":{"$date":"2025-06-20T15:33:20.530+00:00"},"s":"I",  "c":"CONTROL",  "id":5945603, "ctx":"main","msg":"Multi threading initialized"}
{"t":{"$date":"2025-06-20T15:33:20.530+00:00"},"s":"I",  "c":"CONTROL",  "id":4615611, "ctx":"initandlisten","msg":"MongoDB starting","attr":{"pid":6996,"port":27017,"dbPath":"/data/","architecture":"64-bit","host":"ip-xxxxxxxx.xxxx.compute.internal"}}
{"t":{"$date":"2025-06-20T15:33:20.530+00:00"},"s":"I",  "c":"CONTROL",  "id":23403,   "ctx":"initandlisten","msg":"Build Info","attr":{"buildInfo":{"version":"6.0.4","gitVersion":"44ff59461c1353638a71e710f385a566bcd2f547","openSSLVersion":"OpenSSL 1.0.2k-fips  26 Jan 2017","modules":[],"allocator":"tcmalloc","environment":{"distmod":"amazon2","distarch":"x86_64","target_arch":"x86_64"}}}}
{"t":{"$date":"2025-06-20T15:33:20.530+00:00"},"s":"I",  "c":"CONTROL",  "id":51765,   "ctx":"initandlisten","msg":"Operating System","attr":{"os":{"name":"Amazon Linux release 2 (Karoo)","version":"Kernel 5.10.178-162.673.amzn2.x86_64"}}}
{"t":{"$date":"2025-06-20T15:33:20.530+00:00"},"s":"I",  "c":"CONTROL",  "id":21951,   "ctx":"initandlisten","msg":"Options set by command line","attr":{"options":{"storage":{"dbPath":"/data/"}}}}
{"t":{"$date":"2025-06-20T15:33:20.531+00:00"},"s":"W",  "c":"STORAGE",  "id":22271,   "ctx":"initandlisten","msg":"Detected unclean shutdown - Lock file is not empty","attr":{"lockFile":"/data/mongod.lock"}}
{"t":{"$date":"2025-06-20T15:33:20.531+00:00"},"s":"I",  "c":"STORAGE",  "id":22270,   "ctx":"initandlisten","msg":"Storage engine to use detected by data files","attr":{"dbpath":"/data/","storageEngine":"wiredTiger"}}
{"t":{"$date":"2025-06-20T15:33:20.531+00:00"},"s":"W",  "c":"STORAGE",  "id":22302,   "ctx":"initandlisten","msg":"Recovering data from the last clean checkpoint."}
{"t":{"$date":"2025-06-20T15:33:20.531+00:00"},"s":"I",  "c":"STORAGE",  "id":22315,   "ctx":"initandlisten","msg":"Opening WiredTiger","attr":{"config":"create,cache_size=3330M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,remove=true,path=journal,compressor=snappy),builtin_extension_config=(zstd=(compression_level=6)),file_manager=(close_idle_time=600,close_scan_interval=10,close_handle_minimum=2000),statistics_log=(wait=0),json_output=(error,message),verbose=[recovery_progress:1,checkpoint_progress:1,compact_progress:1,backup:0,checkpoint:0,compact:0,evict:0,history_store:0,recovery:0,rts:0,salvage:0,tiered:0,timestamp:0,transaction:0,verify:0,log:0],"}}
{"t":{"$date":"2025-06-20T15:33:22.735+00:00"},"s":"I",  "c":"STORAGE",  "id":4795906, "ctx":"initandlisten","msg":"WiredTiger opened","attr":{"durationMillis":2204}}
{"t":{"$date":"2025-06-20T15:33:22.735+00:00"},"s":"I",  "c":"RECOVERY", "id":23987,   "ctx":"initandlisten","msg":"WiredTiger recoveryTimestamp","attr":{"recoveryTimestamp":{"$timestamp":{"t":1750426063,"i":63}}}}
{"t":{"$date":"2025-06-20T15:33:22.735+00:00"},"s":"I",  "c":"RECOVERY", "id":5380106, "ctx":"initandlisten","msg":"WiredTiger oldestTimestamp","attr":{"oldestTimestamp":{"$timestamp":{"t":1750425773,"i":4}}}}
{"t":{"$date":"2025-06-20T15:33:22.755+00:00"},"s":"I",  "c":"STORAGE",  "id":22383,   "ctx":"initandlisten","msg":"The size storer reports that the oplog contains","attr":{"numRecords":43691619,"dataSize":15895285350}}
{"t":{"$date":"2025-06-20T15:33:22.755+00:00"},"s":"I",  "c":"STORAGE",  "id":22386,   "ctx":"initandlisten","msg":"Sampling the oplog to determine where to place markers for truncation"}
{"t":{"$date":"2025-06-20T15:33:22.760+00:00"},"s":"I",  "c":"STORAGE",  "id":22389,   "ctx":"initandlisten","msg":"Sampling from the oplog to determine where to place markers for truncation","attr":{"from":{"$timestamp":{"t":1750326649,"i":2805}},"to":{"$timestamp":{"t":1750426070,"i":6}}}}
{"t":{"$date":"2025-06-20T15:33:22.760+00:00"},"s":"I",  "c":"STORAGE",  "id":22390,   "ctx":"initandlisten","msg":"Taking samples and assuming each oplog section contains","attr":{"numSamples":994,"minBytesPerStone":159854315,"containsNumRecords":439395,"containsNumBytes":159854660}}
{"t":{"$date":"2025-06-20T15:33:22.865+00:00"},"s":"I",  "c":"STORAGE",  "id":22393,   "ctx":"initandlisten","msg":"Oplog sampling complete"}
{"t":{"$date":"2025-06-20T15:33:22.865+00:00"},"s":"I",  "c":"STORAGE",  "id":22382,   "ctx":"initandlisten","msg":"WiredTiger record store oplog processing finished","attr":{"durationMillis":109}}
{"t":{"$date":"2025-06-20T15:33:23.511+00:00"},"s":"W",  "c":"CONTROL",  "id":22120,   "ctx":"initandlisten","msg":"Access control is not enabled for the database. Read and write access to data and configuration is unrestricted","tags":["startupWarnings"]}
{"t":{"$date":"2025-06-20T15:33:23.511+00:00"},"s":"W",  "c":"CONTROL",  "id":22138,   "ctx":"initandlisten","msg":"You are running this process as the root user, which is not recommended","tags":["startupWarnings"]}
{"t":{"$date":"2025-06-20T15:33:23.511+00:00"},"s":"W",  "c":"CONTROL",  "id":22140,   "ctx":"initandlisten","msg":"This server is bound to localhost. Remote systems will be unable to connect to this server. Start the server with --bind_ip <address> to specify which IP addresses it should serve responses from, or with --bind_ip_all to bind to all interfaces. If this behavior is desired, start the server with --bind_ip 127.0.0.1 to disable this warning","tags":["startupWarnings"]}
{"t":{"$date":"2025-06-20T15:33:23.511+00:00"},"s":"W",  "c":"CONTROL",  "id":5123300, "ctx":"initandlisten","msg":"vm.max_map_count is too low","attr":{"currentValue":65530,"recommendedMinimum":104856,"maxConns":52428},"tags":["startupWarnings"]}
{"t":{"$date":"2025-06-20T15:33:23.523+00:00"},"s":"F",  "c":"ASSERT",   "id":23079,   "ctx":"initandlisten","msg":"Invariant failure","attr":{"expr":"isVersionInitialized()","file":"src/mongo/db/server_options.h","line":156}}
{"t":{"$date":"2025-06-20T15:33:23.523+00:00"},"s":"F",  "c":"ASSERT",   "id":23080,   "ctx":"initandlisten","msg":"\n\n***aborting after invariant() failure\n\n"}
{"t":{"$date":"2025-06-20T15:33:23.523+00:00"},"s":"F",  "c":"CONTROL",  "id":6384300, "ctx":"initandlisten","msg":"Writing fatal message","attr":{"message":"Got signal: 6 (Aborted).\n"}}
{"t":{"$date":"2025-06-20T15:33:23.639+00:00"},"s":"I",  "c":"CONTROL",  "id":31380,   "ctx":"initandlisten","msg":"BACKTRACE","attr":{"bt":{"backtrace":[{"a":"5626574B5084","b":"5626526D7000","o":"4DDE084","s":"_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.362","C":"mongo::stack_trace_detail::(anonymous namespace)::printStackTraceImpl(mongo::stack_trace_detail::(anonymous namespace)::Options const&, mongo::StackTraceSink*) [clone .constprop.362]","s+":"1F4"},{"a":"5626574B75C9","b":"5626526D7000","o":"4DE05C9","s":"_ZN5mongo15printStackTraceEv","C":"mongo::printStackTrace()","s+":"29"},{"a":"5626574B12A6","b":"5626526D7000","o":"4DDA2A6","s":"abruptQuit","s+":"66"},{"a":"7FD08A6308E0","b":"7FD08A61F000","o":"118E0","s":"funlockfile","s+":"50"},{"a":"7FD08A2A5CA0","b":"7FD08A272000","o":"33CA0","s":"gsignal","s+":"110"},{"a":"7FD08A2A7148","b":"7FD08A272000","o":"35148","s":"abort","s+":"148"},{"a":"5626545D5F58","b":"5626526D7000","o":"1EFEF58","s":"_ZN5mongo15invariantFailedEPKcS1_j","C":"mongo::invariantFailed(char const*, char const*, unsigned int)","s+":"F7"},{"a":"56265459F7E2","b":"5626526D7000","o":"1EC87E2","s":"_ZNK5mongo11FeatureFlag9isEnabledERKNS_18ServerGlobalParams20FeatureCompatibilityE.cold.76","C":"mongo::FeatureFlag::isEnabled(mongo::ServerGlobalParams::FeatureCompatibility const&) const [clone .cold.76]","s+":"18"},{"a":"5626556E0337","b":"5626526D7000","o":"3009337","s":"_ZNK5mongo16IndexCatalogImpl9_isSpecOkEPNS_16OperationContextERKNS_13CollectionPtrERKNS_7BSONObjE","C":"mongo::IndexCatalogImpl::_isSpecOk(mongo::OperationContext*, mongo::CollectionPtr const&, mongo::BSONObj const&) const","s+":"8C7"},{"a":"5626556E42C4","b":"5626526D7000","o":"300D2C4","s":"_ZN5mongo16IndexCatalogImpl16createIndexEntryEPNS_16OperationContextEPNS_10CollectionESt10unique_ptrINS_15IndexDescriptorESt14default_deleteIS6_EENS_21CreateIndexEntryFlagsE","C":"mongo::IndexCatalogImpl::createIndexEntry(mongo::OperationContext*, mongo::Collection*, std::unique_ptr<mongo::IndexDescriptor, std::default_delete<mongo::IndexDescriptor> >, mongo::CreateIndexEntryFlags)","s+":"84"},{"a":"5626556E3EF8","b":"5626526D7000","o":"300CEF8","s":"_ZN5mongo16IndexCatalogImpl4initEPNS_16OperationContextEPNS_10CollectionE","C":"mongo::IndexCatalogImpl::init(mongo::OperationContext*, mongo::Collection*)","s+":"848"},{"a":"5626556B7185","b":"5626526D7000","o":"2FE0185","s":"_ZN5mongo14CollectionImpl4initEPNS_16OperationContextE","C":"mongo::CollectionImpl::init(mongo::OperationContext*)","s+":"3C5"},{"a":"5626556D0831","b":"5626526D7000","o":"2FF9831","s":"_ZN5mongo12DatabaseImpl4initEPNS_16OperationContextE","C":"mongo::DatabaseImpl::init(mongo::OperationContext*)","s+":"121"},{"a":"5626556CAE3F","b":"5626526D7000","o":"2FF3E3F","s":"_ZN5mongo18DatabaseHolderImpl6openDbEPNS_16OperationContextERKNS_18TenantDatabaseNameEPb","C":"mongo::DatabaseHolderImpl::openDb(mongo::OperationContext*, mongo::TenantDatabaseName const&, bool*)","s+":"30F"},{"a":"562655BF0776","b":"5626526D7000","o":"3519776","s":"_ZN5mongo9AutoGetDb14ensureDbExistsEPNS_16OperationContextE","C":"mongo::AutoGetDb::ensureDbExists(mongo::OperationContext*)","s+":"B6"},{"a":"5626558BA81E","b":"5626526D7000","o":"31E381E","s":"_ZN5mongo27FeatureCompatibilityVersion39findFeatureCompatibilityVersionDocumentEPNS_16OperationContextE","C":"mongo::FeatureCompatibilityVersion::findFeatureCompatibilityVersionDocument(mongo::OperationContext*)","s+":"20E"},{"a":"5626558BB0DC","b":"5626526D7000","o":"31E40DC","s":"_ZN5mongo27FeatureCompatibilityVersion20initializeForStartupEPNS_16OperationContextE","C":"mongo::FeatureCompatibilityVersion::initializeForStartup(mongo::OperationContext*)","s+":"4C"},{"a":"56265482FE25","b":"5626526D7000","o":"2158E25","s":"_ZN5mongo12_GLOBAL__N_115startupRecoveryEPNS_16OperationContextEPNS_13StorageEngineENS3_17LastShutdownStateENS_16startup_recovery19StartupRecoveryModeE","C":"mongo::(anonymous namespace)::startupRecovery(mongo::OperationContext*, mongo::StorageEngine*, mongo::StorageEngine::LastShutdownState, mongo::startup_recovery::StartupRecoveryMode)","s+":"55"},{"a":"5626548305D9","b":"5626526D7000","o":"21595D9","s":"_ZN5mongo16startup_recovery25repairAndRecoverDatabasesEPNS_16OperationContextENS_13StorageEngine17LastShutdownStateE","C":"mongo::startup_recovery::repairAndRecoverDatabases(mongo::OperationContext*, mongo::StorageEngine::LastShutdownState)","s+":"269"},{"a":"5626547F3EF1","b":"5626526D7000","o":"211CEF1","s":"_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.2009","C":"mongo::(anonymous namespace)::_initAndListen(mongo::ServiceContext*, int) [clone .isra.2009]","s+":"A81"},{"a":"5626547F714D","b":"5626526D7000","o":"212014D","s":"_ZN5mongo11mongod_mainEiPPc","C":"mongo::mongod_main(int, char**)","s+":"BDD"},{"a":"5626545E714E","b":"5626526D7000","o":"1F1014E","s":"main","s+":"E"},{"a":"7FD08A29313A","b":"7FD08A272000","o":"2113A","s":"__libc_start_main","s+":"EA"},{"a":"5626547F19AA","b":"5626526D7000","o":"211A9AA","s":"_start","s+":"2A"}],"processInfo":{"mongodbVersion":"6.0.4","gitVersion":"44ff59461c1353638a71e710f385a566bcd2f547","compiledModules":[],"uname":{"sysname":"Linux","release":"5.10.178-162.673.amzn2.x86_64","version":"#1 SMP Mon Apr 24 23:34:06 UTC 2023","machine":"x86_64"},"somap":[{"b":"5626526D7000","elfType":3,"buildId":"67C698F1183D940D0AAA5CD323EFDFD057F74854"},{"b":"7FD08A61F000","path":"/lib64/libpthread.so.0","elfType":3,"buildId":"BC2E8D5CDFB0A3CC6DB42A136DD1BB61AF8EED99"},{"b":"7FD08A272000","path":"/lib64/libc.so.6","elfType":3,"buildId":"140E425DB38E5E4C2BFA7E56F3609E707B850AC5"}]}}},"tags":[]}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626574B5084","b":"5626526D7000","o":"4DDE084","s":"_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.362","C":"mongo::stack_trace_detail::(anonymous namespace)::printStackTraceImpl(mongo::stack_trace_detail::(anonymous namespace)::Options const&, mongo::StackTraceSink*) [clone .constprop.362]","s+":"1F4"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626574B75C9","b":"5626526D7000","o":"4DE05C9","s":"_ZN5mongo15printStackTraceEv","C":"mongo::printStackTrace()","s+":"29"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626574B12A6","b":"5626526D7000","o":"4DDA2A6","s":"abruptQuit","s+":"66"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"7FD08A6308E0","b":"7FD08A61F000","o":"118E0","s":"funlockfile","s+":"50"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"7FD08A2A5CA0","b":"7FD08A272000","o":"33CA0","s":"gsignal","s+":"110"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"7FD08A2A7148","b":"7FD08A272000","o":"35148","s":"abort","s+":"148"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626545D5F58","b":"5626526D7000","o":"1EFEF58","s":"_ZN5mongo15invariantFailedEPKcS1_j","C":"mongo::invariantFailed(char const*, char const*, unsigned int)","s+":"F7"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"56265459F7E2","b":"5626526D7000","o":"1EC87E2","s":"_ZNK5mongo11FeatureFlag9isEnabledERKNS_18ServerGlobalParams20FeatureCompatibilityE.cold.76","C":"mongo::FeatureFlag::isEnabled(mongo::ServerGlobalParams::FeatureCompatibility const&) const [clone .cold.76]","s+":"18"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626556E0337","b":"5626526D7000","o":"3009337","s":"_ZNK5mongo16IndexCatalogImpl9_isSpecOkEPNS_16OperationContextERKNS_13CollectionPtrERKNS_7BSONObjE","C":"mongo::IndexCatalogImpl::_isSpecOk(mongo::OperationContext*, mongo::CollectionPtr const&, mongo::BSONObj const&) const","s+":"8C7"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626556E42C4","b":"5626526D7000","o":"300D2C4","s":"_ZN5mongo16IndexCatalogImpl16createIndexEntryEPNS_16OperationContextEPNS_10CollectionESt10unique_ptrINS_15IndexDescriptorESt14default_deleteIS6_EENS_21CreateIndexEntryFlagsE","C":"mongo::IndexCatalogImpl::createIndexEntry(mongo::OperationContext*, mongo::Collection*, std::unique_ptr<mongo::IndexDescriptor, std::default_delete<mongo::IndexDescriptor> >, mongo::CreateIndexEntryFlags)","s+":"84"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626556E3EF8","b":"5626526D7000","o":"300CEF8","s":"_ZN5mongo16IndexCatalogImpl4initEPNS_16OperationContextEPNS_10CollectionE","C":"mongo::IndexCatalogImpl::init(mongo::OperationContext*, mongo::Collection*)","s+":"848"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626556B7185","b":"5626526D7000","o":"2FE0185","s":"_ZN5mongo14CollectionImpl4initEPNS_16OperationContextE","C":"mongo::CollectionImpl::init(mongo::OperationContext*)","s+":"3C5"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626556D0831","b":"5626526D7000","o":"2FF9831","s":"_ZN5mongo12DatabaseImpl4initEPNS_16OperationContextE","C":"mongo::DatabaseImpl::init(mongo::OperationContext*)","s+":"121"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626556CAE3F","b":"5626526D7000","o":"2FF3E3F","s":"_ZN5mongo18DatabaseHolderImpl6openDbEPNS_16OperationContextERKNS_18TenantDatabaseNameEPb","C":"mongo::DatabaseHolderImpl::openDb(mongo::OperationContext*, mongo::TenantDatabaseName const&, bool*)","s+":"30F"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"562655BF0776","b":"5626526D7000","o":"3519776","s":"_ZN5mongo9AutoGetDb14ensureDbExistsEPNS_16OperationContextE","C":"mongo::AutoGetDb::ensureDbExists(mongo::OperationContext*)","s+":"B6"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626558BA81E","b":"5626526D7000","o":"31E381E","s":"_ZN5mongo27FeatureCompatibilityVersion39findFeatureCompatibilityVersionDocumentEPNS_16OperationContextE","C":"mongo::FeatureCompatibilityVersion::findFeatureCompatibilityVersionDocument(mongo::OperationContext*)","s+":"20E"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626558BB0DC","b":"5626526D7000","o":"31E40DC","s":"_ZN5mongo27FeatureCompatibilityVersion20initializeForStartupEPNS_16OperationContextE","C":"mongo::FeatureCompatibilityVersion::initializeForStartup(mongo::OperationContext*)","s+":"4C"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"56265482FE25","b":"5626526D7000","o":"2158E25","s":"_ZN5mongo12_GLOBAL__N_115startupRecoveryEPNS_16OperationContextEPNS_13StorageEngineENS3_17LastShutdownStateENS_16startup_recovery19StartupRecoveryModeE","C":"mongo::(anonymous namespace)::startupRecovery(mongo::OperationContext*, mongo::StorageEngine*, mongo::StorageEngine::LastShutdownState, mongo::startup_recovery::StartupRecoveryMode)","s+":"55"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626548305D9","b":"5626526D7000","o":"21595D9","s":"_ZN5mongo16startup_recovery25repairAndRecoverDatabasesEPNS_16OperationContextENS_13StorageEngine17LastShutdownStateE","C":"mongo::startup_recovery::repairAndRecoverDatabases(mongo::OperationContext*, mongo::StorageEngine::LastShutdownState)","s+":"269"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626547F3EF1","b":"5626526D7000","o":"211CEF1","s":"_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.2009","C":"mongo::(anonymous namespace)::_initAndListen(mongo::ServiceContext*, int) [clone .isra.2009]","s+":"A81"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626547F714D","b":"5626526D7000","o":"212014D","s":"_ZN5mongo11mongod_mainEiPPc","C":"mongo::mongod_main(int, char**)","s+":"BDD"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626545E714E","b":"5626526D7000","o":"1F1014E","s":"main","s+":"E"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"7FD08A29313A","b":"7FD08A272000","o":"2113A","s":"__libc_start_main","s+":"EA"}}}
{"t":{"$date":"2025-06-20T15:33:23.640+00:00"},"s":"I",  "c":"CONTROL",  "id":31445,   "ctx":"initandlisten","msg":"Frame","attr":{"frame":{"a":"5626547F19AA","b":"5626526D7000","o":"211A9AA","s":"_start","s+":"2A"}}}
Aborted

Hi @Ritesh_Kumar6

Try with a recent version of 6.0 Also 6.0 is End of Life after July 31 upgrade to 7.0 or even better 8.0

https://jira.mongodb.org/browse/SERVER-71068 exhibits similar errors, this was fixed in 6.0.5 the latest patch revision is 6.0.24.

Looks like you started the mongod as root and with just any parameter dbpath but nothing else. So, you don’t configure any replica set.
What is your config file (if any) and how do you start the service?

Hello @chris
Thanks for your reply. Let me upgrade the node with latest version in 6 and check if that solves the issue

Hello @chris

The issue was resolved as soon as we upgraded to latest patch in version 6.0.
Thank you for your help.

1 Like

Hello @Wernfried_Domscheit

Thank you for your reply.

Yes; We tried all different approaches and all resulted in the same error. However after following instructions from @chris ; the issue is solved now

This topic was automatically closed 5 days after the last reply. New replies are no longer allowed.