...
The LLNL E3SM Archives will retain the state of simulation output as released by the corresponding project groups (transferred “as is” from NERSC HPSS). Certain “mapping functions” will be conducted to identify the publishable content within the (often variably-structured) archives in order to facilitate survey and extraction of individual native-output datasets.
Data not already published will be prepared for publication by being extracted to a staging area, whereupon occasional data irregularities (missing data, overlapping data from unusual restarts) as well as will be addressed, and default post processing (regridding for selected time-series, climatology generation) will proceed. The data will reside in staging under a pre-publication “warehouse” directory, with faceted subdirectory locations exactly matching the eventual publication directory hierarchies. Where data is not yet requested for publication, it will reside indefinitely in the pre-publication warehouse.
Where data is thereafter (or already) scheduled for publication, it need only be moved (relinked) to the corresponding publication directory path, mapfile generated, and the formal ESGF publication process engaged.
...