...
- The "Site" column is the machine where the tests ran
- The "Build Name" column is the name of the build and should be in the format <acme_test_suite_name>_<branch>_<compiler>, e.g. acme_developer_master_gnu
- The Update, Configure and Build columns can be ignored for us at this time
- The "Test" column is where things get interesting for us, it is split into three sub-columns:
- Not Run - For us, this is a misnomer. We put tests in Not Run if the only thing wrong with them is a namelist diff
- Fail - This is the worst result for a test. Could mean: failed to build, failed during run, or a non-BFB change in results
- Pass - The test is in good shape
- The "Build Time" column is the time when the test finished.
All our tests go into the ACME_Latest test group. The ACME_Latest group will continue to show the most recent test results for a test on the front page dashboard until new results for that test arrive. The upside is that we have a number of tests, like acme_integration on edison, that take several days to complete. Therefore, there should always be results for edison on the dashboard, even if they are a couple of days old. The downside is that users may see results on the front page and assume that they are up to date. Please pay special attention to the "Build Time" column on the far right to see how recent a result is.
...