Versions Compared

Old Version 70

changes.mady.by.user Qi Tang

Saved on

compared with

New Version Current

changes.mady.by.user Qi Tang

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • : configuration and test of future projection run P1 (first ensemble member)
  •  : completed tests and submitted all 5 ensemble members
  •  : on hold due to quota issues
  •  : quota issue solved
  • : P2 simulation completed
  •  : P1 simulation completed
  •  : P3 simulation completed
  •  : P4 simulation completed
  • : P5 simulation completed

20190807.DECKv1b_P1_SSP5-8.5.ne30_oEC.cori-knl

...

#Simulation periodYearsNodesBFBFLAGTime stampDuration (hr)Raw core hoursCost per yearEffective SYPDNotes

1

2015-01-01 - 2021-05-01


125

true

190822-131413






22021-05-01 - 2021-08-21
125true190824-224204




32021-07-01 - 2023-08-02
125true190825-013247




42023-07-01 - 2023-10-08
125true190825-201045




52023-09-01 - 2023-11-22
125true190825-231312




62023-11-01 - 2024-01-01
125true190827-0047021.21
57,6993.33
72024-01-01 - 2030-01-016125true190827-10411446.34
61,7903.11
82030-01-01 - 2036-01-016125true190829-11133744.17
58,8983.26
92036-01-01 - 2038-09-172125true190906-005305



  • slurmstepd: error: *** STEP 24372975.0 ON nid06667 CANCELLED AT 2019-09-08T00:53:47 DUE TO TIME LIMIT ***

102038-01-01 - 2044-01-016125true190914-11502442.97
57,2953.35
112044-01-01 - 2050-01-016125true190916-13235142.78
57,0353.37
122050-01-01 - 2056-01-016125true190920-07140945.09
60,1133.19
132056-01-01 -
125true190922-162447



  • forrtl: error (65): floating invalid
142056-01-01 - 2057-01-061125true190925-133248



  • srun: error: Node failure on nid03307
152057-01-01 - 2063-01-016125true190928-22011143.75
58,3373.29
162063-01-01 - 2069-01-016125true191002-21510346.00
61,3383.13
172069-01-01 - 2075-01-016125true191006-02290343.11
57,4803.34
182075-01-01 - 2077-11-052125true191008-005323



  • power outage
192077-01-01 - 2083-01-016125true191013-20034344.44
59,2493.24
202083-01-01 -  2089-01-016125true191016-074721

20190821.DECKv1b_P2_SSP5-8.5.ne30_oEC.cori-knl

Cori-knl jobs

2015 201511231908221328512015-112017
#Simulation periodYearsNodesBFBFLAGTime stampDuration (hr)Raw core hoursCost per yearEffective SYPDNotes

1

42.93
57,2463.35
212089-01-01 - 2095-01-016125true191018-090935242.58
56,7683.38
222095-01-01 - 20162101-1001-11016125true190823-055056191020-10263344.99
59,98832016-09-01 - 2016-12-22125true190823-14515542016-11-01 - 2017-02-22125true190823-1910535.20

20190821.DECKv1b_P2_SSP5-8.5.ne30_oEC.cori-knl

Cori-knl jobs

201704221908240129156
#Simulation periodYearsNodesBFBFLAGTime stampDuration (hr)Raw core hoursCost per yearEffective SYPDNotes

1

2015-01-01 - 2015-11-23


125

true

190822-

132851






6220172015-0311-01 - 20222016-10-2111
125true190824190823-112956055056




7320222016-09-01 - 20232016-0112-0122
125true190827190823-0047021451552.4859,3503.248




2023-0142016-11-01 - 20292017-0102-01226
125true190827190823-10301319105345.9961,3213.13




9202952017-01-01 - 20292017-0104-2522
125true190829190824-092132012915
  • node failure
10




2029-0162017-03-01 - 2022-10-21
125true190824-112956




72022-09-01 - 20352023-01-01
125true190829190827-133812004702422.48
5956,7823503.3824
11820352023-01-01 - 20402029-1101-140156125true190906190827-012450

  • slurmstepd: error: *** STEP 24373034.0 ON nid05169 CANCELLED AT 2019-09-08T01:25:10 DUE TO TIME LIMIT ***

12204010301345.99
61,3213.13
92029-01-01 - 2029-01-25
125true190829-092132



  • node failure
102029-01-01 - 20462035-01-016125true190914190829-1150241338124342.4659
5756,9447823.3138
131120462035-01-01 - 20522040-0111-011465125true190916190906-19505242.5256,6953.39142052012450



  • slurmstepd: error: *** STEP 24373034.0 ON nid05169 CANCELLED AT 2019-09-08T01:25:10 DUE TO TIME LIMIT ***

122040-01-01 - 20582046-01-016125true190920190914-07140911502443.5246
5857,0259443.31
151320582046-01-01 - 20642052-01-016125true190922190916-1624471950524342.6452
5856,1906953.3039
161420642052-01-01 - 20702058-01-016125true190928190920-2116560714094443.5052
5958,3280253.2431
171520702058-01-01 - 20762064-01-016125true191003190922-1425311624474443.6564
5958,5331903.2330
181620762064-01-01 - 20822070-01-016125true191006190928-02291021165644.1150
5859,8083283.2624
191720822070-01-01 - 20842076-0801-160126125true191008-023343
  • power outage
202084191003-14253144.65
59,5333.23
182076-01-01 - 20902082-01-016125true191013191006-2120030229104344.5911
58,1208083.326
211920902082-01-01 -  2084-08-162125true191016-083433

20190821.DECKv1b_P3_SSP5-8.5.ne30_oEC.cori-knl

Cori-knl jobs

2015 20150419
#Simulation periodYearsNodesBFBFLAGTime stampDuration (hr)Raw core hoursCost per yearEffective SYPDNotes

1

191008-023343



  • power outage
202084-01-01 - 2090-01-016125true191013-21200343.59
58,1203.30
212090-01-01 - 2096-01-016125true

190822-163651

22015-03191016-08343344.53
59,3683.23
222096-01-01 - 20162100-1001-09014125true190823191018-08142332016-09-01 - 2018-04-09125true190823-20203842018-03-01 - 2022-05-28125true190824-11431852022-05-01 - 2023-04-1709093530.22
60,4503.18

20190821.DECKv1b_P3_SSP5-8.5.ne30_oEC.cori-knl

Cori-knl jobs

190825222549
#Simulation periodYearsNodesBFBFLAGTime stampDuration (hr)Raw core hoursCost per yearEffective SYPDNotes

1

2015-01-01 - 2015-04-19


125

true

190822-

163651






6220232015-03-01 - 20292016-0410-1409
125true190827190823-030655081423




7320292016-0309-01 - 20292018-1204-0709
125true190830190823-072152202038




8420292018-1103-01 - 20362022-0405-1128
125true190830190824-170340114318




9520362022-0305-01 - 20362023-0904-1517
125true190905190825-204900222549




10620362023-0903-01 - 20372029-0504-1714
125true190906190827-115943030655




11720372029-0503-01 - 20432029-1112-0607
125true190906190830-191152072152




12820432029-11-01 - 20442036-0104-1811
125true190908190830-193432170340




13920442036-0103-01 - 20442036-0609-1715
125true190909190905-063024204900




141020442036-0509-01 - 20442037-1205-1017
125true190909190906-102354115943




151120442037-1105-01 - 20462043-0811-2906
125true190909190906-160140191152




161220462043-0711-01 - 20482044-0501-0118
125true190913190908-150410193432




171320482044-0301-01 - 20482044-0806-1617
125true190915190909-200640063024




181420482044-0705-01 - 20502044-0212-2810
125true190915190909-234117102354




191520502044-0111-01 - 20542046-0508-1829
125true190917190909-080701160140




201620542046-0507-01 - 20552048-05-2101
125true190918190913-170706150410




211720552048-0503-01 - 20552048-1208-16
125true190920190915-021029200640




221820552048-1107-01 - 20582050-0102-2628
125true190921190915-154950234117




231920582050-01-01 - 2054- 205905-082718
125true190924190917-034141080701




242020592054-0705-01 - 20602055-0105-0921
125true190925190918-143757170706




252120602055-0105-01 - 20602055-0812-0916
125true190926190920-012525021029




262220602055-0711-01 - 20602058-1101-2226
125true190926190921-075728154950




272320602058-1101-01 - 20612059-09-160827
125true190928190924-064331034141




282420612059-0907-01 - 20622060-1101-1809
125true190929190925-122208143757




292520622060-1101-01 - 20642060-0108-09
125true191001190926-234801012525




302620642060-0107-01 - 20642060-0611-2422
125true191005190926-220429075728




312720642060-0511-01 - 20642061-0709-3116
125true191007190928-020816064331




322820642061-0709-01 - 20652062-0111-0118
125true191007190929-095553122208




332920652062-0111-01 - 20652064-0701-0509
125true191013191001-184928234801




343020652064-0701-01 - 20662064-0106-0324
125true191013191005-234708220429




353120662064-05-01 - 2064-01 07-31
125true

20190821.DECKv1b_P4_SSP5-8.5.ne30_oEC.cori-knl

Cori-knl jobs

2015 201504141908222103222016-112035-03-01 - 2035-10-302041-05-01 - 2043-01-31
#Simulation periodYearsNodesBFBFLAGTime stampDuration (hr)Raw core hoursCost per yearEffective SYPDNotes

1

191007-020816




322064-07-01 - 2065-01-01
125true191007-095553




332065-01-01 - 2065-07-05
125true191013-184928




23420152065-0307-01 - 20162066-01-2903
125true190823191013-102928234708




33520162066-01-01 - 20162072-1101-29016125true190823191020-190051013628443.42
57,8953.32
362072-01-01 - 20222078-0501-10016125true190824-11430952022-05191022-04474245.25
60,3293.18
372078-01-01 - 20282084-0601-20016125true190827-03070262028-05191024-05343044.71
59,6103.22
382084-01-01 - 20342090-0901-12016125true190830191029-13153319502972034-09-01 - 2035-03-07125true190905-204900844.69
59,5893.22
392090-01-01 - 2095-12-275125true190906191031-12074492035-09-01 - 2036-09-19125true190907-040452102036-09-01 - 2040-08-30203215



  • slurmstepd: error: *** STEP 25464109.0 ON nid02751 CANCELLED AT 2019-11-02T20:32:32 DUE TO TIME LIMIT
402095-01-01 - 2100-01-015125true190907191102-161648212350112040-07-01 - 2040-12-14125true190909-063058122040-11-01 - 2041-06-06125true190909-1023541335.03
56,0463.43

20190821.DECKv1b_P4_SSP5-8.5.ne30_oEC.cori-knl

Cori-knl jobs

190909160135
#Simulation periodYearsNodesBFBFLAGTime stampDuration (hr)Raw core hoursCost per yearEffective SYPDNotes

1

2015-01-01 - 2015-04-14


125

true

190822-

210322






14220432015-0103-01 - 20442016-1001-0829
125true190913190823-150400102928




15320442016-0901-01 - 20452016-0811-2029
125true190914190823-044011190051




16420452016-0711-01 - 20512022-1105-1610
125true190914190824-130126114309




17520512022-1105-01 - 20562028-0106-2220
125true190917190827-080706030702




18620562028-0105-01 - 20572034-0109-2112
125true190918190830-170706131533




19720572034-0109-01 - 20572035-0803-0907
125true190920190905-021028204900




20820572035-0703-01 - 20592035-0810-30
125true190921-155954212059-07-01 - 2061-03-04190906-120744




92035-09-01 - 2036-09-19
125true190907-040452




102036-09-01 - 2040-08-30
125true190924190907-033938161648




221120612040-0307-01 - 20612040-09-14125true190925-143757232061-09-01 - 2062-04-02125true190926-010555242062-03-01 - 2062-07-01125true190926-080008252062-07-01 - 2062-07-01125true190928-064333

  • rof_run_mct :: MOSART clock is not in sync with Master Sync

262062-05-01 - 2063-03-17125true190929-144003272063-03-01 - 2066-11-15125true191001-043933282066-11-01 - 2067-04-13125true191005-220559292067-03-01 - 2067-09-20125true191007-093820302067-09-01 - 2068-03-02125true191013-185844312068-03-01 - 2068-06-08125true191014-003023322068-05-01 -125true

20190821.DECKv1b_P5_SSP5-8.5.ne30_oEC.cori-knl

Cori-knl jobs

true
#Simulation periodYearsNodesBFBFLAGTime stampDuration (hr)Raw core hoursCost per yearEffective SYPDNotes

1

2015-01-01 - 2021-01-01

6

125

true

190821-163236

43.9058,5363.2822021-01-01 - 2027-01-016125true190823-12452543.7158,2863.2932027-01-01 - 2033-01-016125true190826-23064745.6960,9263.1542033-01-01 - 2036-03-033125true190829-050543
  • slurmstepd: error: *** STEP 24201048.0 ON nid02756 CANCELLED AT 2019-08-31T05:05:54 DUE TO TIME LIMIT ***
52036-01-01 - 2042-01-016125true190906-16342843.8358,4423.2962042-01-01 - 2048-01-016125true190916-13231642.3056,4003.4072048-01-01 - 2048-10-30125true190918-18242382048-09-01 - 2049-05-10125true190920-01400092049-05-01 - 2051-08-02125true190921-154950102051-07-01 - 2052-12-10125true190924-052724112052-11-01 - 2055-05-27125true190925-000334122055-05-01 - 2056-09-14125true190926-010605132056-09-01 - 2057-12-21125true190928-052549142057-11-01 - 2059-01-01125true190929-122203152058-11-01 - 2062-09-06125true191001-045303162062-09-01 - 2062-12-29125true191005-230906172062-11-01 - 2063-03-11125true191007-014139182063-03-01 - 2063-08-07125true191007-101710192063-07-01 - 2064-02-05125true191013-181415202064-01-01 - 2064-08-01125true191013-233743212064-07-01 -12512-14
125true190909-063058




122040-11-01 - 2041-06-06
125true190909-102354




132041-05-01 - 2043-01-31
125true190909-160135




142043-01-01 - 2044-10-08
125true190913-150400




152044-09-01 - 2045-08-20
125true190914-044011




162045-07-01 - 2051-11-16
125true190914-130126




172051-11-01 - 2056-01-22
125true190917-080706




182056-01-01 - 2057-01-21
125true190918-170706




192057-01-01 - 2057-08-09
125true190920-021028




202057-07-01 - 2059-08-30
125true190921-155954




212059-07-01 - 2061-03-04
125true190924-033938




222061-03-01 - 2061-09-14
125true190925-143757




232061-09-01 - 2062-04-02
125true190926-010555




242062-03-01 - 2062-07-01
125true190926-080008




252062-07-01 - 2062-07-01
125true190928-064333



  • rof_run_mct :: MOSART clock is not in sync with Master Sync

262062-05-01 - 2063-03-17
125true190929-144003




272063-03-01 - 2066-11-15
125true191001-043933




282066-11-01 - 2067-04-13
125true191005-220559




292067-03-01 - 2067-09-20
125true191007-093820




302067-09-01 - 2068-03-02
125true191013-185844




312068-03-01 - 2068-06-08
125true191014-003023




322068-05-01 - 2068-08-05
125true191019-191622




332068-07-01 - 2069-02-01
125true191026-063501




342069-01-01 - 2075-01-016125true191030-12585847.17
62,8953.05
352075-01-01 - 2081-01-016125true191101-14301845.87
61,1583.14
362081-01-01 - 2087-01-016125true191103-12424743.09
57,4473.34
372087-01-01 - 2093-01-016125true191106-07184446.07
61,4213.13
382093-01-01 - 2099-01-016125true191108-22340446.00
61,3393.13
392099-01-01 - 2100-01-011125true191111-1214327.49
59,8913.21

20190821.DECKv1b_P5_SSP5-8.5.ne30_oEC.cori-knl

Cori-knl jobs

#Simulation periodYearsNodesBFBFLAGTime stampDuration (hr)Raw core hoursCost per yearEffective SYPDNotes

1

2015-01-01 - 2021-01-01

6

125

true

190821-163236

43.90
58,5363.28
22021-01-01 - 2027-01-016125true190823-12452543.71
58,2863.29
32027-01-01 - 2033-01-016125true190826-23064745.69
60,9263.15
42033-01-01 - 2036-03-033125true190829-050543



  • slurmstepd: error: *** STEP 24201048.0 ON nid02756 CANCELLED AT 2019-08-31T05:05:54 DUE TO TIME LIMIT ***
52036-01-01 - 2042-01-016125true190906-16342843.83
58,4423.29
62042-01-01 - 2048-01-016125true190916-13231642.30
56,4003.40
72048-01-01 - 2048-10-30
125true190918-182423




82048-09-01 - 2049-05-10
125true190920-014000




92049-05-01 - 2051-08-02
125true190921-154950




102051-07-01 - 2052-12-10
125true190924-052724




112052-11-01 - 2055-05-27
125true190925-000334




122055-05-01 - 2056-09-14
125true190926-010605




132056-09-01 - 2057-12-21
125true190928-052549




142057-11-01 - 2059-01-01
125true190929-122203




152058-11-01 - 2062-09-06
125true191001-045303




162062-09-01 - 2062-12-29
125true191005-230906




172062-11-01 - 2063-03-11
125true191007-014139




182063-03-01 - 2063-08-07
125true191007-101710




192063-07-01 - 2064-02-05
125true191013-181415




202064-01-01 - 2064-08-01
125true191013-233743




212064-07-01 - 2070-12-04
125true191024-111729




222070-11-01 - 2077-05-11
125true191102-140804




232077-01-01 - 2083-01-016125true191104-16385547.03
62,7073.06
242083-01-01 - 2089-01-016125true191106-18523147.10
62,4263.08
252089-01-01 - 2094-12-065125true191109-034314



  • slurmstepd: error: *** STEP 25643536.0 ON nid02543 CANCELLED AT 2019-11-11T03:43:22 DUE TO TIME LIMIT ***
262094-01-01 - 2099-11-245125true191111-121432



  • slurmstepd: error: *** STEP 25700921.0 ON nid02554 CANCELLED AT 2019-11-13T12:14:36 DUE TO TIME LIMIT ***
272099-01-01 - 2100-01-011125true191113-1739418.09
64,7192.97


Output files on Cori scratch:

/global/cscratch1/sd/tang30/E3SM_simulations/20190807.DECKv1b_P1_SSP5-8.5.ne30_oEC.cori-knl
/global/cscratch1/sd/tang30/E3SM_simulations/20190821.DECKv1b_P2_SSP5-8.5.ne30_oEC.cori-knl
/global/cscratch1/sd/tang30/E3SM_simulations/20190821.DECKv1b_P3_SSP5-8.5.ne30_oEC.cori-knl
/global/cscratch1/sd/tang30/E3SM_simulations/20190821.DECKv1b_P4_SSP5-8.5.ne30_oEC.cori-knl
/global/cscratch1/sd/tang30/E3SM_simulations/20190821.DECKv1b_P5_SSP5-8.5.ne30_oEC.cori-knl

Files on

...

NERSC HPSS:

v1 DECK output HPSS archive

...

Net TOA radiation:

Surface air temperature:

Image Modified

Net TOA SW and LW:

Image Modified