Running Mongo test suites using resmoke.py

Hi,

Thanks for your response!

I followed the instructions you provided, as well as the ones found here. I used the r7.0.2 tag in the MongoDB repository and was able to install the necessary Python virtual environment, dependencies, etc.

I successfully ran a suite named query_golden_classic.

My question now is, should I expect the core suite to pass on this version? Are any failures expected?

I’m trying to establish a reference point to compare the original MongoDB with my project.

Currently, when running the core suite with resmoke, I get the following summary: “Summary of core suite: 998 test(s) ran in 321.68 seconds (995 succeeded, 763 were skipped, 2 failed, 1 errored).”

The following tests failed (with exit code):

  • jstests/core/json_schema/logical_keywords.js (1 DB Exception)
  • logical_keywords:ValidateCollections (1 DB Exception)

The following tests had errors:
job0_fixture_teardown
Traceback (most recent call last):
File “/home/pliops/mongo/buildscripts/resmokelib/testing/testcases/fixture.py”, line 71, in run_test
self.fixture.teardown(finished=True)
File “/home/pliops/mongo/buildscripts/resmokelib/testing/fixtures/interface.py”, line 133, in teardown
self._do_teardown(mode=mode)
File “/home/pliops/mongo/buildscripts/resmokelib/testing/fixtures/standalone.py”, line 145, in _do_teardown
raise self.fixturelib.ServerFailure(msg)
buildscripts.resmokelib.errors.ServerFailure: mongod on port 20000 was expected to be running, but wasn’t. Process exited with code -6.

Does this seem right?

Thanks,
Slava