E3SM Archive - Data Source and Transfer Status
All E3SM production simulations' data will be backed up in the long-term archive that is being established at LLNL. The zstash tar files are transferred from the indicated HPSS storage to LLNL petabyte disk for permanent archive. In case of the simulations at the HP centers that do not have HPSS tape availability, the data will be compressed with zstash and then the tar files will be transferred to LLNL.
All the data in long-term storage will go through zstash to calculate and log checksums, before archiving.
The following pages detail the source HPSS and other data locations that will serve to populate the LLNL archives
Summary of simulation data size by Model/Campaign:
Model-Campaign | Archive Volume | Notes |
|---|---|---|
1_0-DECK | 290.4 TB |
|
1_0-HR | 742.0 TB | growing |
1_1-BGC | 172.7 TB |
|
1_1_ECA-BGC | 135.3 TB |
|
1_2-CRYO | 54.4 TB |
|
1_2_1-CRYO | 19.7 TB |
|
1_3-CRYO | 15.2 TB |
|
TOTAL ALL MODELS-CAMPAIGNS | 1429.7 TB |
|