Draft version - open for comments 2015-10-1
The E3SM testing system includes several types of functional tests, such as testing if the restart capability is working. It also has "comparison" tests, which compares simulation output with baseline output, where the baseline output was produced by a "blessed" version of the code. If the new code produces output which is not BFB identical with the baseline output, the test will fail and be flagged as a DIFF. There are many issues which can cause these failures, and this confluence page gives the guidelines for what is needed to accept the new code, and "rebaseline" our tests.
...