BGC-v1 -- Archive Source and Transfer Status

Owned by Renata McCoy
Last updated: Nov 17, 2021 by Anthony Bartoletti
2 min read

BGC-v1 HPSS Archives documentation page: https://acme-climate.atlassian.net/wiki/spaces/EBGC/pages/1056145509 (details on all simulations and all data paths are in https://acme-climate.atlassian.net/wiki/spaces/EBGC/pages/170295297 )

  • Total volume in archive: 308 TB (280 TIB)

  • Files are in:

    • /p/user_pub/e3sm/archive/1_1/BGC-v1/ (CTC only)

    • /p/user_pub/e3sm/archive/1_1_ECA/BGC-v1/ (ECA only)

  • Globus transfer rate (when active) was 1.275 TB/hr (88.9 hrs = 3.7 days, out of 6.7 days clock time for the job - CTC only .

 

Simulation

HPSS Root Directory

HPSS Leaf Directory

Size

Status

Notes

CTC Control

/home/s/shix/E3SM/

20181217.CNTL_CNPCTC1850_OIBGC.ne30_oECv3.edison/

22.2 TB

Completed

Globus 0.84 TB/hr. Issues with dual-run (cam.h1,2,3), some missing ocn_5day

CTC BCRC

/home/m/maltrud/E3SM/

20181217.BCRC_CNPCTC20TR_OIBGC.ne30_oECv3.edison/

22.6 TB

Completed

Globus 1.33 TB/hr. Issues with dual-run (cam.h1,2,3)

CTC BCRD

/home/s/shix/E3SM/

 

/home/m/maltrud/E3SM/

20181217.BCRD_CNPCTC20TR_OIBGC.ne30_oECv3.edison/

S20072017/20181217.BCRD_CNPCTC20TR_OIBGC.ne30_oECv3.edison/ (2007-2014)

20190812.BCRD_CNPCTC20TR_OIBGC.ne30_oECv3.compy/archive/ (2000-2014)

20.5 TB

0.85 TB

2.1 TB

Completed

Completed

Completed

Globus 1.30 TB/hr Issues with dual-run (cam.h1,2,3)

(missing all ocean data)

Globus 1.04 TB/hr

CTC BDRC

/home/m/maltrud/E3SM/

20181217.BDRC_CNPCTC20TR_OIBGC.ne30_oECv3.edison/

22.6 TB

Completed

Globus 1.00 TB/hr. Issues with dual-run (cam.h1,2,3)

CTC BDRD

/home/s/shix/E3SM/

20181217.BDRD_CNPCTC20TR_OIBGC.ne30_oECv3.edison/

23.3 TB

Completed

Globus 1.62 TB/hr. Issues with dual-run (cam.h1,2,3), some missing ocn_5day

ECA Control

/home/q/qzhu/

20190308.CNTL.1850-2014 (1850-2014)

16.0 TB

Completed(?)

??? (1850-2013, but missing mpaso.hist.am.timeSeriesStatsMonthly.nc files)

??? (Years 2010-2013 missing for cam.h*)

ECA BCRC

/home/j/jinyun/CBGCv1/

BCRC_CNPECACNT_20TR.ne30_oECv3.edison/ (1850-2006)

BCRC_CNPECACNT_20TR.ne30_oECv3.cori-knl/ (2007-2014)

16.9 TB

Completed

Globus 1.46 TB/hr.

Issues with dual run (cam.*, lnd_mon, river_mon)

ECA BCRD

/home/j/jinyun/CBGCv1/

BCRD_CNPECACNT_20TR.ne30_oECv3.edison/  (1850-2006)

BCRD_CNPECACNT_20TR.ne30_oECv3.cori-knl/ (2007-2014)

16.9 TB

Completed

Globus 1.46 TB/hr

Issues with dual run (cam.*, lnd_mon, river_mon)

ECA BDRC

/home/q/qzhu/CBGCv1

20190308.BDRC.1850-2014 (1850-2014)

18.3 TB

Completed

 

ECA BDRD

/home/q/qzhu/CBGCv1

20190308.BDRD.1850-2014 (1850-2014)

18.3 TB

Completed

 

CTC Control (ext)

/home/s/shix/E3SM

20191204.CNTL_CNPCTC1850_OIBGC.ne30_oECv3.compy (2015-2100)

12.1 TB

Completed

47 tarfiles + index.db

CTC ssp585-BCRC

/home/m/maltrud/E3SM/

20191107.BCRC_CNPCTC_SSP585_OIBGC.ne30_oECv3.compy (2015-2100)

11.8 TB

Completed

45 tarfiles + index.db

CTC ssp585-BCRD

/home/s/shix/E3SM

20191204.BCRD_CNPCTC_SSP585_OIBGC.ne30_oECv3.compy (2015-2100)

11.7 TB

Completed

45 tarfiles + index.db

CTC ssp585-BDRC

/home/m/maltrud/E3SM/

20191107.BDRC_CNPCTC_SSP585_OIBGC.ne30_oECv3.compy (2015-2100)

11.8 TB

Completed

46 tarfiles + index.db

CTC ssp585-BDRD

/home/s/shix/E3SM

20191204.BDRD_CNPCTC_SSP585_OIBGC.ne30_oECv3.compy (2015-2100

11.7 TB

Completed

44 tarfiles + index.db

ECA Control (ext)

/home/j/jinyun/CBGCv1/

CNTL_CNPECACNT_SSP85.ne30_oECv3.cori-knl(2015-2100)

9.8 TB

Completed

36 tarfiles + index.db

ECA ssp585-BCRC

/home/j/jinyun/CBGCv1/

BCRC_CNPECACNT_SSP85.ne30_oECv3.cori-knl (2015-2100)

9.8 TB

Completed

36 tarfiles + index.db

ECA ssp585-BCRD

/home/j/jinyun/CBGCv1/

BCRD_CNPECACNT_SSP85.ne30_oECv3.cori-knl (2015-2100)

9.8 TB

Completed

36 tarfiles + index.db

ECA ssp585-BDRC

/home/q/qzhu/CBGCv1/

20191108.BDRC.SSP85 (2015-2100)

9.4 TB

Completed

69 tarfiles + index.db

ECA ssp585-BDRD

/home/q/qzhu/CBGCv1/

20191108.BDRD.SSP85 (2015-2100)

9.4 TB

Completed

69 tarfiles + index.db