NERSC
DECK v1 simulation original model output has been archived on NERSC HPSS using zstash. See below for some examples on how to retrieve files using zstash. For a more information, refer to the zstash documentation. Please contact Zeshawn Shaheen (Unlicensed) for help with zstash. The table below lists output location for the various simulations.
| Simulation | HPSS location | Approximate size | Failed files and tarballs | zstash check output |
|---|---|---|---|---|
| piControl |
New location of repaired archives:
| 37 TB |
| |
| abrupt-4xCO2 |
New location of repaired archives:
| 12 TB |
| |
| 1pctCO2 | /home/g/golaz/2018/E3SM_simulations/20180215.DECKv1b_1pctCO2.ne30_oEC.edison | 11 TB | 1pctCO2-failed.txt | |
| Historical H1 |
New location of repaired archives:
| 12 TB |
| |
| Historical H2 |
New location of repaired archives:
| 12 TB |
| |
| Historical H3 | /home/g/golaz/2018/E3SM_simulations/20180302.DECKv1b_H3.ne30_oEC.edison | 12 TB | Historical_H3-failed.txt | |
| Historical H4 | /home/t/tang30/2018/E3SM_simulations/20180305.DECKv1b_H4.ne30_oEC.edison | 12 TB | No failures out of 49 tar files. | Historical_H4.txt |
| Historical H5 | /home/g/golaz/2018/E3SM_simulations/20180307.DECKv1b_H5.ne30_oEC.edison | 12 TB | No failures out of 50 tar files. | |
| AMIP A1 | /home/t/tang30/2018/E3SM_simulations/20180316.DECKv1b_A1.ne30_oEC.edison | 4 TB | No failures out of 15 tar files. | |
| AMIP A1 1850allF |
| 5 TB | No failures out of 15 tar files. | |
| AMIP A1 1850aeroF | /home/t/tang30/2018/E3SM_simulations/20180508.DECKv1b_A1_1850aeroF.ne30_oEC.edison | 5 TB | No failures out of 15 tar files. | |
| AMIP A2 | /home/t/tang30/2018/E3SM_simulations/20180622.DECKv1b_A2.ne30_oEC.edison | 4 TB | No failures out of 16 tar files. | |
| AMIP A2 1850allF | /home/t/tang30/2018/E3SM_simulations/20180622.DECKv1b_A2_1850allF.ne30_oEC.edison | 4 TB | No failures out of 15 tar files. | AMIP_A2_1850allF.txt |
| AMIP A2 1850aeroF | /home/t/tang30/2018/E3SM_simulations/20180622.DECKv1b_A2_1850aeroF.ne30_oEC.edison | 4 TB | No failures out of 15 tar files. | AMIP_A2_1850aeroF.txt |
| AMIP A3 | /home/t/tang30/2018/E3SM_simulations/20180716.DECKv1b_A3.ne30_oEC.edison | 5 TB | No failures out of 20 tar files. | |
| AMIP A3 1850allF | /home/t/tang30/2018/E3SM_simulations/20180716.DECKv1b_A3_1850allF.ne30_oEC.edison | 5 TB | No failures out of 19 tar files. | AMIP_A3_1850allF.txt |
| AMIP A3 1850aeroF | /home/t/tang30/2018/E3SM_simulations/20180716.DECKv1b_A3_1850aeroF.ne30_oEC.edison | 5 TB | No failures out of 19 tar files. | AMIP_A3_1850aeroF.txt |
| Total | 161 TB | 18/634 = 2.839% tar files failed. |
Known bad data
Some users have reported errors when trying to extract from HPSS archive. The cause of the bad data is currently unknown; possibilities include a bug in zstash or data file being corrupted to/on HPSS.
...