Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

#Description

Run directory
(under /global/cscratch1/sd/tang30/E3SM_simulations/F2010C5-CMIP6-HR_tst)

Errors
1Default F2010C5-CMIP-HR

cori-knl.20190214_maint-1.0.tst_F2010C5-CMIP6-HR.ne120_oRRS18v3/run
log time stamp: 190227-155927

  • ERROR: PFT weights are SIGNIFICANTLY different between the restart (finidat) file and the surface dataset (fsurdat).
2
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.

cori-knl.20190214_maint-1.0.tst_F2010C5-CMIP6-HR.ne120_oRRS18v3/run
log time stamp: 190227-181936

  • Failed during atm initialization
  • forrtl: severe (174): SIGSEGV, segmentation fault occurred
  • Atm stops after "nstep, te 0" at "READ_NEXT_TRCDATA ALL"
3
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • 1950 MAM4 aerosols
cori-knl.20190214_maint-1.0.tst_F2010C5-CMIP6-HR_1950aero.ne120_oRRS18v3/run
  • Failed during atm initialization
  • *** longjmp causes uninitialized stack frame ***
  • forrtl: error (65): floating invalid
  • Atm stops before "nstep, te 0"
4
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • 1950 MAM4 aerosols
  • 1955 tracer_cnst_cycle_yr
cori-knl.20190214_maint-1.0.tst_F2010C5-CMIP6-HR_All1950aero.ne120_oRRS18v3/run
  • Same as #3
5
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • 1955 tracer_cnst_cycle_yr

cori-knl.20190214_maint-1.0.tst_F2010C5-CMIP6-HR_1950tracer.ne120_oRRS18v3/run

  • Same as #2
  • Seems that tracer year is not the cause of failure.
6
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • 1950 MAM4 aerosols
  • 1955 tracer_cnst_cycle_yr
  • 1950 ocn and sea ice
cori-knl.20190214_maint-1.0.tst_F2010C5-CMIP6-HR_All1950aero_ocn.ne120_oRRS18v3/run
  • Failed after "Model initialization complete"
  • Atm died at nstep = 4
  • ERROR: negative layer thickness. timestep or remap time too large
  • No NetCDF output
7Default F1950C5-CMIP-HRcori-knl.20190103.tst_F1950C5-CMIP6-HR.ne120_oRRS18v3/run
  • Failed at land initialization
  • pio_support::pio_die:: myrank= -1 : ERROR: nf_mod.F90: 1288 :

  • NetCDF: Invalid dimension ID or name

8
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • 1950 ocn and sea ice
cori-knl.20190214_maint-1.0.tst_F2010C5-CMIP6-HR_1950ocn.ne120_oRRS18v3/run
  • Same as #2
9
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • 1950 MAM4 aerosols
  • 1950 ocn and sea ice
cori-knl.20190214_maint-1.0.tst_F2010C5-CMIP6-HR_1950aero_ocn.ne120_oRRS18v3/run
  • Same as #6
  • Requires 1950 MAM4 aerosols and ocean and sea ice to pass the initialization stage
10
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • 1950 MAM4 aerosols
  • 1950 ocn and sea ice
  • ATM_NCPL=192 (2x shorter timestep)
cori-knl.20190214_maint-1.0.F2010C5-CMIP6-HR_1950aero_ocn_2x.ne120_oRRS18v3/run
  • ERROR: negative layer thickness. timestep or remap time too large
  • Output 1 record in the NetCDF history file
11Default F1950C5-CMIP-HR with master on  cori-knl.20190306.tst_F1950C5-CMIP6-HR.ne120_oRRS18v3/run
  • ERROR: Unstructured grids require drydep_srf_file
12
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • 1950 MAM4 aerosols
  • 1950 ocn and sea ice
  • ATM_NCPL=384 (2x shorter timestep)
cori-knl.20190214_maint-1.0.F2010C5-CMIP6-HR_1950aero_ocn_4x.ne120_oRRS18v3/run
  • ERROR: negative layer thickness. timestep or remap time too large
13
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • 1950 MAM4 aerosols
  • 1950 ocn and sea ice
  • Atm IC from ne120 coupled run rather than interpolation from a LR run
    (Thanks Wuyin Lin for the suggestion)
cori-knl.20190214_maint-1.0.F2010C5-CMIP6-HR_1950aero_ocn_atmIC.ne120_oRRS18v3/old/run
  • Passed all previous failing points
  • Died due to time limit of debug queue
14
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • 1950 MAM4 aerosols
  • 1950 ocn and sea ice
  • Atm IC from ne120 coupled run rather than interpolation from a LR run
cori-knl.20190214_maint-1.0.F2010C5-CMIP6-HR_1950aero_ocn_atmIC.ne120_oRRS18v3/run
  • Successfully finished 3 days.
15
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • 1950 ocn and sea ice
  • Atm IC from ne120 coupled run rather than interpolation from a LR run
cori-knl.20190214_maint-1.0.F2010C5-CMIP6-HR_1950ocn_atmIC.ne120_oRRS18v3/run
  • forrtl: severe (174): SIGSEGV, segmentation fault occurred
16
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • 1950 MAM4 aerosols
  • 2010 ocn and sea ice at monthly and 1 deg x 1 deg resolutions
  • Atm IC from ne120 coupled run rather than interpolation from a LR run
cori-knl.20190214_maint-1.0.F2010C5-CMIP6-HR_1950aero_2010ocn1x1_atmIC.ne120_oRRS18v3/run
  • Successfully finished 1 day.
17
  • F2010C5-CMIP-HR
  • check_finidat_pct_consistency = .false.
  • new 2010 MAM4 aerosol files (with individual sectors) from Hailong Wang
  • 2010 ocn and sea ice at monthly and 1 deg x 1 deg resolutions
  • Atm IC from ne120 coupled run rather than interpolation from a LR run
cori-knl.20190214_maint-1.0.F2010C5-CMIP6-HR_2010aero_2010ocn1x1_atmIC.ne120_oRRS18v3/run
  • Successfully finished 3 days.
18
  • Same as #17, but with
  • land IC from the restart file of #17
  • check_finidat_pct_consistency = .true.
  • check_finidat_year_consistency = .false.
cori-knl.20190214_maint-1.0.F2010C5-CMIP6-HR_2010aero_2010ocn1x1_atmIC_lndIC.ne120_oRRS18v3/run
  • ERROR: PFT weights are SIGNIFICANTLY different between the restart (finidat) file and the surface dataset (fsurdat).

19
  • Same as #17, but with
  • default HR 2010 ocn and sea ice
cori-knl.20190214_maint-1.0.F2010C5-CMIP6-HR_2010aero_atmIC.ne120_oRRS18v3/run
  • forrtl: error (65): floating invalid

...