Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 36 Next »

NERSC

DECK v1 simulation original model output has been archived on NERSC HPSS using zstash. See below for some examples on how to retrieve files using zstash. For a more information, refer to the zstash documentation. Please contact Zeshawn Shaheen (Unlicensed) for help with zstash. The table below lists output location for the various simulations. Note that some archives initially contained a few corrupted files. These problems have all been corrected.

SimulationHPSS locationApproximate size
piControl

/home/g/golaz/2018/E3SM_simulations/repaired/20180129.DECKv1b_piControl.ne30_oEC.edison
Alternate location:
/home/t/tang30/2018/E3SM_simulations/repaired/20180129.DECKv1b_piControl.ne30_oEC.edison

37 TB
abrupt-4xCO2

/home/g/golaz/2018/E3SM_simulations/repaired/20180215.DECKv1b_abrupt4xCO2.ne30_oEC.edison
Alternate location:
/home/t/tang30/2018/E3SM_simulations/repaired/20180215.DECKv1b_abrupt4xCO2.ne30_oEC.edison

12 TB
1pctCO2

/home/g/golaz/2018/E3SM_simulations/repaired/20180215.DECKv1b_1pctCO2.ne30_oEC.edison
Alternate location:
/home/t/tang30/2018/E3SM_simulations/repaired/20180215.DECKv1b_1pctCO2.ne30_oEC.edison

11 TB
Historical H1

/home/g/golaz/2018/E3SM_simulations/repaired/20180215.DECKv1b_H1.ne30_oEC.edison
Alternate location:
/home/t/tang30/2018/E3SM_simulations/repaired/20180215.DECKv1b_H1.ne30_oEC.edison

12 TB
Historical H2

/home/g/golaz/2018/E3SM_simulations/repaired/20180220.DECKv1b_H2.ne30_oEC.edison
Alternate location:
/home/t/tang30/2018/E3SM_simulations/repaired/20180220.DECKv1b_H2.ne30_oEC.edison

12 TB
Historical H3

/home/z/zshaheen/2018/E3SM_simulations/repaired/20180302.DECKv1b_H3.ne30_oEC.edison

Alternate locations:

/home/g/golaz/2018/E3SM_simulations/repaired/20180302.DECKv1b_H3.ne30_oEC.edison

12 TB
Historical H4

/home/t/tang30/2018/E3SM_simulations/20180305.DECKv1b_H4.ne30_oEC.edison
Alternate location:
/home/g/golaz/2018/E3SM_simulations/20180305.DECKv1b_H4.ne30_oEC.edison

12 TB
Historical H5/home/g/golaz/2018/E3SM_simulations/20180307.DECKv1b_H5.ne30_oEC.edison
Alternate location:
/home/t/tang30/2018/E3SM_simulations/20180307.DECKv1b_H5.ne30_oEC.edison		12 TB
AMIP A1

/home/t/tang30/2018/E3SM_simulations/20180316.DECKv1b_A1.ne30_oEC.edison

Alternate location:

/home/g/golaz/2018/E3SM_simulations/20180316.DECKv1b_A1.ne30_oEC.edison

4 TB
AMIP A1 1850allF

/home/t/tang30/2018/E3SM_simulations/20180508.DECKv1b_A1_1850allF.ne30_oEC.edison

Alternate location:

/home/g/golaz/2018/E3SM_simulations/20180508.DECKv1b_A1_1850allF.ne30_oEC.edison

5 TB
AMIP A1 1850aeroF

/home/t/tang30/2018/E3SM_simulations/20180508.DECKv1b_A1_1850aeroF.ne30_oEC.edison

Alternate location:

/home/g/golaz/2018/E3SM_simulations/20180508.DECKv1b_A1_1850aeroF.ne30_oEC.edison

5 TB
AMIP A2

/home/t/tang30/2018/E3SM_simulations/20180622.DECKv1b_A2.ne30_oEC.edison

Alternate location:

/home/g/golaz/2018/E3SM_simulations/20180622.DECKv1b_A2.ne30_oEC.edison

4 TB
AMIP A2 1850allF

/home/t/tang30/2018/E3SM_simulations/20180622.DECKv1b_A2_1850allF.ne30_oEC.edison

Alternate location:

/home/g/golaz/2018/E3SM_simulations/20180622.DECKv1b_A2_1850allF.ne30_oEC.edison

4 TB
AMIP A2 1850aeroF

/home/t/tang30/2018/E3SM_simulations/20180622.DECKv1b_A2_1850aeroF.ne30_oEC.edison

Alternate location:

/home/g/golaz/2018/E3SM_simulations/20180622.DECKv1b_A2_1850aeroF.ne30_oEC.edison

4 TB
AMIP A3

/home/t/tang30/2018/E3SM_simulations/20180716.DECKv1b_A3.ne30_oEC.edison

Alternate location:

/home/g/golaz/2018/E3SM_simulations/20180716.DECKv1b_A3.ne30_oEC.edison

5 TB
AMIP A3 1850allF

/home/t/tang30/2018/E3SM_simulations/20180716.DECKv1b_A3_1850allF.ne30_oEC.edison

Alternate location:

/home/g/golaz/2018/E3SM_simulations/20180716.DECKv1b_A3_1850allF.ne30_oEC.edison

5 TB
AMIP A3 1850aeroF

/home/t/tang30/2018/E3SM_simulations/20180716.DECKv1b_A3_1850aeroF.ne30_oEC.edison

Alternate location:

/home/g/golaz/2018/E3SM_simulations/20180716.DECKv1b_A3_1850aeroF.ne30_oEC.edison

5 TB
DAMIP hist-GHG H1

/home/t/tang30/2019/E3SM_simulations/20190404.DECKv1b_H1_hist-GHG.ne30_oEC.edison

Alternate location:

/home/g/golaz/2019/E3SM_simulations/20190404.DECKv1b_H1_hist-GHG.ne30_oEC.edison

12 TB
DAMIP hist-GHG H2

/home/t/tang30/2019/E3SM_simulations/20190404.DECKv1b_H2_hist-GHG.ne30_oEC.edison

Alternate location:

/home/g/golaz/2019/E3SM_simulations/20190404.DECKv1b_H2_hist-GHG.ne30_oEC.edison

12 TB
DAMIP hist-GHG H3

/home/t/tang30/2019/E3SM_simulations/20190404.DECKv1b_H3_hist-GHG.ne30_oEC.edison

Alternate location:

/home/g/golaz/2018/E3SM_simulations/repaired/20180302.DECKv1b_H3.ne30_oEC.edison

12 TB
Total
197 TB

Retrieving data with zstash

Below are some basic examples on how to retrive DECK output data on NERSC. You can retrieve directly from NERSC Edison or Cori machines, but you may see better performance if you log in to one of the NERSC DTN nodes. The examples below assume that you have installed a conda environment with the latest version of zstash (see zstash quickstart guide).

Activate environment

source activate zstash

Examples

Retrieve selected cam.h0 files from piControl

Let's say you want to retrieve all cam.h0 (monthly atmosphere output files) between years 0030 and 0069 for the piControl simulation. The zstash command would be

zstash extract --hpss=/home/g/golaz/2018/E3SM_simulations/repaired/20180129.DECKv1b_piControl.ne30_oEC.edison "*.cam.h0.00[3-6]?-??.nc"

where /home/g/golaz/2018/E3SM_simulations/repaired/20180129.DECKv1b_piControl.ne30_oEC.edison is the path on HPSS listed in the table above, and "*.cam.h0.00[3-6]?-??.nc" is a matching pattern to select all cam.h0 files between years 0030 and 0069, enclosing it in double quotes avoids shell level substitution.

The extracted files will be stored in a sub-directory structure that preserves the original structure:

archive/atm/hist/20180129.DECKv1b_piControl.ne30_oEC.edison.cam.h0.0030-01.nc                              
archive/atm/hist/20180129.DECKv1b_piControl.ne30_oEC.edison.cam.h0.0030-02.nc                              
archive/atm/hist/20180129.DECKv1b_piControl.ne30_oEC.edison.cam.h0.0030-03.nc                              
archive/atm/hist/20180129.DECKv1b_piControl.ne30_oEC.edison.cam.h0.0030-04.nc

[...]

archive/atm/hist/20180129.DECKv1b_piControl.ne30_oEC.edison.cam.h0.0069-09.nc
archive/atm/hist/20180129.DECKv1b_piControl.ne30_oEC.edison.cam.h0.0069-10.nc
archive/atm/hist/20180129.DECKv1b_piControl.ne30_oEC.edison.cam.h0.0069-11.nc
archive/atm/hist/20180129.DECKv1b_piControl.ne30_oEC.edison.cam.h0.0069-12.nc















  • No labels