E3SM Archive - Data Source and Transfer Status

All E3SM production simulations' data will be backed up in the long-term archive that is being established at LLNL. The zstash tar files are transferred from the indicated HPSS storage to LLNL petabyte disk for permanent archive. In case of the simulations at the HP centers that do not have HPSS tape availability, the data will be compressed with zstash and then the tar files will be transferred to LLNL.

All the data in long-term storage will go through zstash to calculate and log checksums, before archiving.

The following pages detail the source HPSS and other data locations that will serve to populate the LLNL archives

 

Summary of simulation data size by Model/Campaign:

Model-Campaign

Archive Volume

Notes

Model-Campaign

Archive Volume

Notes

1_0-DECK

290.4 TB

 

1_0-HR

742.0 TB

growing

1_1-BGC

172.7 TB

 

1_1_ECA-BGC

135.3 TB

 

1_2-CRYO

54.4 TB

 

1_2_1-CRYO

19.7 TB

 

1_3-CRYO

15.2 TB

 

TOTAL ALL MODELS-CAMPAIGNS

1429.7 TB

 

 

Archive detail by Campaign