Manually uploading test results to cdash

Owned by Jayesh Krishna
Last updated: Jan 10, 2019
1 min read

E3SM developer and integration test suites are run nightly on a set of machines and the test results are updated on cdash. More information on these nightly test runs is available at the " Using the E3SM CDash Dashboard " page.

Users can also run the E3SM developer and integration test suites manually and upload the test results to cdash. This feature can be used to upload results from machines (or results from test suites) that are not covered by the nightly tests. The information below is my experience uploading test results from blues to cdash.

Steps to manually report test results to cdash

  • Create and run the test suite as usual. See " Running the tests " page for information on how to run the test suite.

  • Use the wait_for_tests (CIME: <E3SM_SOURCE_DIR>/cime/scripts/Tools/wait_for_tests) script to upload the results to cdash. In the case below my test results (the testroot directory) are in the testroot directory (<E3SM_SOURCE_DIR>/cime/scripts/testroot) and I named the cdash buildname as "e3sm_developer_dqwu_test_pio2_03_cori" .

    [jayesh@blogin2 scripts]$ ./Tools/wait_for_tests -n -b e3sm_developer_dqwu_test_pio2_03_cori -p ACME_Climate -g Experimental ./testroot/*/TestStatus


    • To upload the test results to E3SM PIO cdash, use the wait_for_tests (CIME: <E3SM_SOURCE_DIR>/cime/scripts/Tools/wait_for_tests) script to upload the results. In the case below my test results (the testroot directory) are in the testroot directory (<E3SM_SOURCE_DIR>/cime/scripts/testroot) and I named the cdash buildname as "e3sm_developer_dqwu_test_pio2_03_cori" .The test results are uploaded to E3SM PIO cdash dashboard (corresponds to "-p ACME_PIO"). The results are uploaded to a section in the cdash dashboard named "Experimental" (corresponds to "-g Experimental").

      [jayesh@blogin2 scripts]$ ./Tools/wait_for_tests -n -b e3sm_developer_dqwu_test_pio2_03_cori -p ACME_PIO -g Experimental ./testroot/*/TestStatus