The Design Document page provides a description of the algorithms, implementation and planned testing including unit, verification, validation and performance testing. Please read Step 1.3 Performance Expectations that explains feature documentation requirements from the performance group point of view.
...
Date:
Summary
A set of Python scripts is being included in the ACME Land Model v1 (ALMv1) to perform basic forward uncertainty quantification tasks, such as surrogate model construction and variance-based sensitivity analysis. Besides pre- and post-processing steps, the scripts heavily utilize functionalities of Uncertainty Quantification Toolkit (UQTk) being developed at SNL-CA as a lightweight C++/Python UQ library. Version 3.0 of UQTk will be available publicly in spring - any time before that the library is available upon request (see http://www.sandia.gov/uqtoolkit/). The general workflow consists of three steps (a) pre-processing: input parameter sampling, (b) ensemble simulation of ALM, (c) post-processing: for each output quantity of interest, build a polynomial surrogate and compute Sobol sensitivity indices.
Requirements
Requirement: Generate input parameter ensemble
Date last modified:
Contributors: Khachik Sargsyan, Daniel Ricciuto
One needs a selection of ALM parameters with associated value ranges for each parameter in order to generate ensemble input. Some inputs are dependent...
Requirement: Perform ALM ensemble simulations
Date last modified:
Contributors: Daniel Ricciuto
Add text here...
Requirement: Polynomial Chaos surrogate model construction
Date last modified:
Contributors: Khachik Sargsyan
Add text here...
Requirement: Variance-based uncertainty decomposition
Date last modified:
Contributors: Khachik Sargsyan
Add text here...
Algorithmic Formulations
For each requirement, there is a design solution that is intended to meet that requirement. Design solutions can include detailed technical discussions of PDEs, algorithms, solvers and similar, as well as technical discussion of performance issues. In general, this section should steer away from a detailed discussion of low-level software issues such as variable declarations, interfaces and sequencing.
Design solution: Generate input parameter ensemble
Date last modified:
Contributors: Khachik Sargsyan, Daniel Ricciuto
The MaxEnt principle requires uniform sampling on the feasible input parameter space that respects the input constraints. Rosenblatt transformation (RT) is employed. For linear constraints such as a_1+a_2+a_3=1, one can avoid using RT by simply removing a_3 from the varying parameter list, and enforcing a_3=1-a_1-a_2 in order to prepare the input set for ALM.
Design solution: Perform ALM ensemble simulations
Date last modified:
Contributors: Daniel Ricciuto
Add text here...
Design solution: Polynomial Chaos surrogate model construction
Date last modified:
Contributors: Khachik Sargsyan
Add text here...
Design solution: Variance-based uncertainty decomposition
Date last modified:
Contributors: Khachik Sargsyan
Add text here...
Design and Implementation
Implementation: Generate input parameter ensemble
Date last modified:
Contributors: Khachik Sargsyan, Daniel Ricciuto
Add text here...The samples are generated as a preprocessing step, via Python script prepr.py. The syntax is prepr.py <csv file> <number of samples> [parameters to exclude]. For example,
prepr.py Parameters_TitanUQ_ACME.csv 10000 lf_flig fr_flig generates the following output files:
- pdomain_x.dat - input ranges for the unconstrained parameters
- pnames_clm.dat, pnames_x.dat - parameter names, the full list, and the unconstrained list, respectively.
- input_clm.dat, input_x.dat - input ensembles, the full input for ALM, and the 'computational' unconstrained input in [-1,1] for surrogate construction.
Implementation: Perform ALM ensemble simulations
Date last modified:
Contributors: Daniel Ricciuto
Add text here...
Implementation: Polynomial Chaos surrogate model construction
Date last modified:
Contributors: Khachik Sargsyan
Add text here...
Implementation: Variance-based uncertainty decomposition
Date last modified:
Contributors: Khachik Sargsyan
Add text here...
Planned Verification and Unit Testing
Verification and Unit Testing: short-desciption-of-testing-here
Date last modified:
Contributors: (add your name to this list if it does not appear)
How will XXX be tested? i.e. how will be we know when we have met requirement XXX. Will these unit tests be included in the ongoing going forward?
Planned Validation Testing
Validation Testing: short-desciption-of-testing-here
Date last modified:
Contributors: (add your name to this list if it does not appear)
How will XXX be tested? What observational or other dataset will be used? i.e. how will be we know when we have met requirement XXX. Will these unit tests be included in the ongoing going forward?
Planned Performance Testing
Performance Testing: short-desciption-of-testing-here
Date last modified:
Contributors: (add your name to this list if it does not appear)
How will XXX be tested? i.e. how will be we know when we have met requirement XXX. Will these unit tests be included in the ongoing going forward?
...