Modifying the tests

Adding a new test to acme_developer or integration

1. Edit <ACME>/scripts/acme/update_acme_tests.py

2. You'll see a python dict at the top of the file called TEST_SUITES, find the test category you want to change in this dict and add your testcase to the list

3. cd <ACME>/scripts/ccsm_utils/Testlistxml
4. ../../acme/update_acme_tests <category> ./testlist.xml

NOTE: acme_integration is a superset of acme_developer (IE, every test in acme_developer automatically goes into acme_integration as well), so if acme_developer is changed then acme_integration will also need to be updated.

Adding a testcase to a non-acme category

1. cd <ACME>/scripts/ccsm_utils/Testlistxml

2. manage_xml_entries -query -outputlist -machine <machine> -compiler <compiler> -category <category> > SOME_FILE

3. edit SOME_FILE
4. add a line for you new test anywhere in the file, save

5. manage_xml_entries -addlist -file SOME_FILE -category <category>

6. The above command will produce a new file: "testlist-<date>-<time>.xml"
7. Replace testlist.xml with the above file
8. If a test is being run on a machine for the first time, you'll need to generate a baseline for it
   1. ./create_test -testname <new-test-case>.<machine>_<compiler> -testroot <any-path> -project <batch-project> -generate <some-name-for-your-baselines>

Adding a new compset to a test XML file

If you need to add a test for a new compset, you can code that looks like the following into your Testlistxml file. This example is brought to you by Doug Jacobsen (Unlicensed), who just merged MPAS-O into ACME's master branch!

<compset name="CMPASO-NYF">

    <grid name="T62_m120">

        <test name="ERS">

            <machine compiler="intel" testtype="mpas_developer">mustang</machine>

            <machine compiler="gnu" testtype="mpas_developer">mustang</machine>

            <machine compiler="pgi" testtype="mpas_developer">mustang</machine>

        </test>

    </grid>

</compset>

Related articles