NERSC
DECK v1 simulation original model output has been archived on NERSC HPSS using zstash. See below for some examples on how to retrieve files using zstash. For a more information, refer to the zstash documentation. Please contact Zeshawn Shaheen (Unlicensed) for help with zstash. The table below lists output location for the various simulations.
Simulation | HPSS location | Approximate size | Failed files and tarballs | zstash check output |
---|---|---|---|---|
piControl |
New location of repaired archives:
| 37 TB |
| |
abrupt-4xCO2 | /home/t/tang30/2018/E3SM_simulations/20180215.DECKv1b_abrupt4xCO2.ne30_oEC.edison | 12 TB | abrupt-4xCO2-failed.txt | |
1pctCO2 | /home/g/golaz/2018/E3SM_simulations/20180215.DECKv1b_1pctCO2.ne30_oEC.edison | 11 TB | 1pctCO2-failed.txt | |
Historical H1 | /home/t/tang30/2018/E3SM_simulations/20180215.DECKv1b_H1.ne30_oEC.edison | 12 TB | Historical_H1-failed.txt | |
Historical H2 | /home/t/tang30/2018/E3SM_simulations/20180220.DECKv1b_H2.ne30_oEC.edison | 12 TB | Historical_H2-failed.txt | Historical_H2.txt |
Historical H3 | /home/g/golaz/2018/E3SM_simulations/20180302.DECKv1b_H3.ne30_oEC.edison | 12 TB | Historical_H3-failed.txt | |
Historical H4 | /home/t/tang30/2018/E3SM_simulations/20180305.DECKv1b_H4.ne30_oEC.edison | 12 TB | No failures out of 49 tar files. | Historical_H4.txt |
Historical H5 | /home/g/golaz/2018/E3SM_simulations/20180307.DECKv1b_H5.ne30_oEC.edison | 12 TB | No failures out of 50 tar files. | |
AMIP A1 | /home/t/tang30/2018/E3SM_simulations/20180316.DECKv1b_A1.ne30_oEC.edison | 4 TB | No failures out of 15 tar files. | |
AMIP A1 1850allF |
| 5 TB | No failures out of 15 tar files. | |
AMIP A1 1850aeroF | /home/t/tang30/2018/E3SM_simulations/20180508.DECKv1b_A1_1850aeroF.ne30_oEC.edison | 5 TB | No failures out of 15 tar files. | |
AMIP A2 | /home/t/tang30/2018/E3SM_simulations/20180622.DECKv1b_A2.ne30_oEC.edison | 4 TB | No failures out of 16 tar files. | |
AMIP A2 1850allF | /home/t/tang30/2018/E3SM_simulations/20180622.DECKv1b_A2_1850allF.ne30_oEC.edison | 4 TB | No failures out of 15 tar files. | AMIP_A2_1850allF.txt |
AMIP A2 1850aeroF | /home/t/tang30/2018/E3SM_simulations/20180622.DECKv1b_A2_1850aeroF.ne30_oEC.edison | 4 TB | No failures out of 15 tar files. | AMIP_A2_1850aeroF.txt |
AMIP A3 | /home/t/tang30/2018/E3SM_simulations/20180716.DECKv1b_A3.ne30_oEC.edison | 5 TB | No failures out of 20 tar files. | |
AMIP A3 1850allF | /home/t/tang30/2018/E3SM_simulations/20180716.DECKv1b_A3_1850allF.ne30_oEC.edison | 5 TB | No failures out of 19 tar files. | AMIP_A3_1850allF.txt |
AMIP A3 1850aeroF | /home/t/tang30/2018/E3SM_simulations/20180716.DECKv1b_A3_1850aeroF.ne30_oEC.edison | 5 TB | No failures out of 19 tar files. | AMIP_A3_1850aeroF.txt |
Total | 161 TB | 18/634 = 2.839% tar files failed. |
Known bad data
Some users have reported errors when trying to extract from HPSS archive. The cause of the bad data is currently unknown; possibilities include a bug in zstash or data file being corrupted to/on HPSS.
...