A test launched by the CIME Case Control System "create_test" script goes through all the phases of configuring, building and running a case. Each phase is checked for a PASS/FAIL condition and the results are output in the TestStatus.log file in the case directory. Within the E3SM nightly test system, the TestStatus.log for each test is uploaded to cdash for examination.
PASS ERS.f09_g16_g.MPASLISIA.melvin_gnu CREATE_NEWCASE PASS ERS.f09_g16_g.MPASLISIA.melvin_gnu SETUP PASS ERS.f09_g16_g.MPASLISIA.melvin_gnu SHAREDLIB_BUILD time=164 PASS ERS.f09_g16_g.MPASLISIA.melvin_gnu NLCOMP PASS ERS.f09_g16_g.MPASLISIA.melvin_gnu MODEL_BUILD time=95 PASS ERS.f09_g16_g.MPASLISIA.melvin_gnu SUBMIT PASS ERS.f09_g16_g.MPASLISIA.melvin_gnu RUN time=17 PASS ERS.f09_g16_g.MPASLISIA.melvin_gnu COMPARE_base_rest PASS ERS.f09_g16_g.MPASLISIA.melvin_gnu BASELINE PASS ERS.f09_g16_g.MPASLISIA.melvin_gnu MEMCOMP PASS ERS.f09_g16_g.MPASLISIA.melvin_gnu TPUTCOMP PASS ERS.f09_g16_g.MPASLISIA.melvin_gnu MEMLEAK
A test will not be PASS unless ALL the phases are PASS. If even one phase is FAIL, the entire test fails.
Diagnosing test fails
If a test end result is FAIL (on the cdash dashboard the Status for the test will be "Failed" in white letters over red background) you will have to look at the TestStatus.log output to determine how it failed (click on the testname on cdash to see the TestStatus.log).
FAIL message | FAIL meaning | Setting | Control |
---|---|---|---|
| The driver computes highwater memory mark and outputs it to the coupler log. The log is parsed and if the highwater memory increased by more then TEST_MEMLEAK_TOLERANCE which is env_run.xml. | Always on | Turn off by adding --ignore-memleak to create_test. TEST_MEMLEAK_TOLERANCE is defined per machine in config_machines.xml. Can be changed in testcase directory with xmlchange. |