V0 Documentation

Recommended CAM tuning and dycore parameters for use in

CAM3_5_07 (ACMEv0)

1.1 Source Code for both runs

For complete details, see Appendix 1 below

CESM1_2_rel06 (same as CESM1_2 release)

CAM updated to CAM 5_3_07 (which has homme1_3_33 and the needed IBM xlf RRTMG

bugfix)

Source code changes applied to svn checkout ( see svndiff.out )

● For Mira: add compiler option to Macros: -qxlf2003=polymorphic

● Patch so CAM-SE can use the physics package energy fixer

● CICE bugfix involving “aice” (for coupled only)

● Optional, non-answer changing patches:

Source code changes in SourceMods in case directory:

● micro_mg1_0.F90 (to change “Dcs” in source code)

● progseasalts_intr.F90 (to change sea salt scalefactor=0.65)

● ice_dyn_evp.F90 CICE change from Mat and aice bugfix

● POP_HaloMod.F90 optional. support for new POP decompositions

1.2 Dycore and Physics settings recommended for all resolutions:

Set in ‘user_nl_cam’, except for DCS, Sea salt scalefactor and zmconv_tau.

NE120 Physics settings (from NE120 tuning)

convection:

● cldfrc_rhminl = .91 ! ne120 tuned value

● cldfrc_dp1 = 0.025 ! default 0.10

● zmconv_c0_lnd=.0035

● zmconv_c0_ocn=.0035

● zmconv_tau = 3000 ! requires source code change in zm_conv.F90

● dcs=600e-6 ! requires source code change in micro_mg1_0.F90

aerosols:

● soil_erod = '/your/system/path/inputdata/atm/cam/dst/dst_1.9x2.5_c090203.nc'

● SEASALT:scalefactor=0.65 ! NCAR default: 1.35

● dust_emis_fact = 1.05D0 ! NCAR ne30 default: 0.55

NE30 Physics settings for CSSEF project (atmosphere test-bed )

● Use same as NE120. See Forcing and I/O additions below

NE30 Tuned physics. (for F1850 RESTOM=0)

● Use NE120 aerosol tunings

● dtime=1800 (ATM_NCPL=48) ! NCAR default, set in env_run.xml

● cldfrc_rhminl = .8975 ! NCAR default

● cldfrc_dp1=.035 ! tuned for RESTOM=0

● zmconv_c0_lnd=.0035 ! NE120 values

● zmconv_c0_ocn=.0035 ! NE120 values

● zmconv_tau = 3600 ! NCAR default

● dcs=400e-6 ! NCAR default. hardcoded in micro_mg1_0.F90

Dycore settings for all resolutions:

energy_fixer = -1 ! requires CAM physics energy fixer enabled via source code patch

 ! in physpkg.F90

statefreq = 1200

! optional: turn on interpolation of history output:

! interpolate_analysis = .true.,.true.,.true.,.true.,.true.,.true.,

! interp_gridtype = 2 ! to interpolate to a Gauss grid. (default is FV fixed)

! dycore settings

se_ftype=0

rsplit = 3

qsplit=1 tstep_type=5 ! add tstep_type to CAM’s namelist_definition.xml file.

vert_remap_q_alg = 1 ! I think this is the default, may not be needed

Dycore resolution specific settings:

! ne30 (1 degree):

se_nsplit=2 hypervis_subcycle=3 ! dtime=1800

se_nsplit=1 rsplit=2 hypervis_subcycle=3 ! dtime= 600. rsplit=3 is ok, just slower

nu=1e15 nu_div=2.5e15 nu_q=1e15 nu_p=1e15

! ne120 (¼ degree):

se_nsplit = 4 hypervis_subcycle=4 ! dtime=900

se_nsplit = 3 hypervis_subcycle=3 ! dtime=600

nu=1e13 nu_div=2.5e13 nu_q=1e13 nu_p=1e13

ncdata = '/gpfs/mira-fs0/projects/ClimEndStation/taylorm/cam_ic/f1850c5_m3.cam.i.0007-01-01-

00000.nc'

bnd_topo = '/gpfs/mira-fs0/projects/ClimEndStation/taylorm/cam_ic/USGS-
gtopo30_ne120np4_16xconsistentSGH.nc'

! ne240 (1/8 degree):

se_nsplit = 5 hypervis_subcycle=4 ! dtime=600

nu=1e12 nu_div=2.5e12 nu_q=1e12 nu_p=1e12

! armx8v3 (1 degree -> 1/8 degree):

se_nsplit = 5 hypervis_subcycle=8 ! dtime=600

nu=8.0e-8 nu_div=20.0e-8 nu_p=8.0e-8 nu_q=-1 (uses 8.0e-8)

CSSEF runs: all resolutions (NE30 and var-res) will use the NE120

physics tunings and physics timestep (dtime) as above with the

following additions:

ne30 (1 degree) Free-Running simulation for January to August 2011

Use the same settings for physics as high resolution runs

RUN_STARTDATE = “2011-01-01” ! set in env_run.xml

dtime=600 ! set in env_run.xml by ATM_NCPL=144, “dtime” in user_nl_cam will be ignored

**user_nl_cam changes**

soil_erod = '/global/u2/t/tang30/CSSEF/inputdata/dst_1.9x2.5_c090203.nc'

! output settings

 mfilt = 30,121,121,121,

 nhtfrq = 0,-1,-1,-1,

 fincl2

= 'PRECT','PRECC','PRECL','FLUT','PS','TREFHT','RHREFHT','UBOT','VBOT','PBLH','C

APE','CIN','FSNS','FSDS','FLNS','FLDS','CLDTOT','TMQ','SHFLX','LHFLX','TGCLDCWP','TGCL

DLWP','TGCLDIWP','QREFHT','TS'

 fincl3 = 'PS','T','Q','U','V','CLOUD','RELHUM'

 fincl4 = 'PS','DCQ','DTCOND','DTV','VD01'

 interpolate_analysis = .true.,.true.,.true.,.true.,.true.,.true.,

 interp_nlat = 0

 interp_nlon = 0

**user_nl_docn changes** (use the weekly SST data)

streams = 'docn.streams.txt.prescribed 1990 1990 2013 '

**user_nl_cice changes** (use the weekly SST data)

model_year_align = 1990

stream_fldfilename =

'/project/projectdirs/mp193/CAPT/BC/SST/sst_weekly_cdcunits_1x1_1990-01-01-

2013-08-11.nc'

stream_fldvarname = 'ice_cov'

stream_year_first = 1990

stream_year_last = 2013

Appendix 1

General steps and atrributions in generating acme_v0 from

cesm1_2_rel06 (June 15, 2014) (per email from P. Worley, 6/15/2014)

 

1) svn checkout https://svn-ccsm-models.cgd.ucar.edu/cesm1/tags/cesm1_2_rel06

cesm1_2_rel06

 cd cesm1_2_rel06

2) (newer CAM, with homme1_3_33 and the needed IBM xlf RRTMG bugfix [Taylor])

 cd models/atm/cam

 svn switch https://svn-ccsm-models.cgd.ucar.edu/cam1/trunk_tags/cam5_3_07/models/atm/

cam

3) (newer timing library [Worley])

 cd models/utils/timing

 svn switch https://svn-ccsm-models.cgd.ucar.edu/timing/trunk_tags/timing_130827

4) (glimmer-cism2 file format differences)

 cd models/glc/cism/glimmer-cism2

 - change files from DOS to UNIX format

5) (Patch to allow zmconv_tau and tstep_type to be set in namelist [Taylor])

 models/atm/cam/bld/namelist_files/namelist_definition.xml

 models/atm/cam/src/physics/cam/zm_conv.F90

6) (Patch so CAM-SE can use the physics package energy fixer [Taylor])

 models/atm/cam/src/physics/cam/cam_diagnostics.F90

 models/atm/cam/src/physics/cam/physpkg.F90

7) (Applied suite of patches to remove unneeded information from log files [Taylor])

 models/csm_share/shr/shr_stream_mod.F90

 models/drv/driver/seq_map_mod.F90

 models/ice/cice/src/source/ice_init.F90

 models/lnd/clm/src/clm4_0/main/histFileMod.F90

 models/lnd/clm/src/util_share/spmdMod.F90

 models/drv/driver/ccsm_comp_mod.F90 (see also (15))

8) (CICE bugfix involving “aice” (for coupled only) [Hunke, Maltrud, Taylor, Worley, ...])

 models/ice/cice/src/source/ice_dyn_evp.F90

9) (Patch to speedup CLM initialization [T. Craig; part of more recent versions of CLM])

 models/lnd/clm/src/util_share/decompInitMod.F90

10) (??? [Talyor?])

 models/drv/driver/seq_domain_mct.F90

 33c33

 new: real(R8), parameter :: eps_frac_samegrid = 1.0e-9_R8 ! epsilon for fractions for

samegrid

 ---

 old: real(R8), parameter :: eps_frac_samegrid = 1.0e-14_R8 ! epsilon for fractions for

samegrid

 models/drv/driver/seq_frac_mct.F90

 714c714

 new: if (error .or. seq_frac_debug > 2) then

 ---

 old: if (error .or. seq_frac_debug > 1) then

11) (format fixes??? [??? - clearly needed])

 models/ocn/pop2/input_templates/tx0.1v2_movie_contents

12) (format fix? [???])

 models/rof/rtm/bld/rtm.buildnml.csh

 62,63c62

 new: #set nrevsn_rtm = "${RUN_REFCASE}.rtm.r.${RUN_REFDATE}-

${RUN_REFTOD}.nc"

 new: set nrevsn_rtm = "nrevsn_rtm = '${RUN_REFCASE}.rtm.r.${RUN_REFDATE}-

${RUN_REFTOD}.nc'"

 ---

 old: set nrevsn_rtm = "${RUN_REFCASE}.rtm.r.${RUN_REFDATE}-

${RUN_REFTOD}.nc"

13) (additional POP optimization options [Worley])

 models/ocn/pop2/mpi/POP_HaloMod.F90

14) (performance instrumentation changes [Worley])

 models/atm/cam/src/dynamics/se/share/bndry_mod.F90

 models/atm/cam/src/dynamics/se/share/prim_advance_mod.F90

 models/atm/cam/src/dynamics/se/share/prim_advection_mod.F90

 models/atm/cam/src/dynamics/se/share/spelt_mod.F90

 models/atm/cam/src/dynamics/se/share/viscosity_mod.F90

 models/atm/cam/src/dynamics/se/stepon.F90

 models/ocn/pop2/source/baroclinic.F90

 models/ocn/pop2/source/barotropic.F90

 models/ocn/pop2/source/POP_SolversMod.F90

15) (modified performance output and archive logic [Worley])

 models/drv/bld/build-namelist

 models/drv/bld/namelist_files/namelist_defaults_drv.xml

 models/drv/bld/namelist_files/namelist_definition_drv.xml [Taylor]

 models/drv/driver/ccsm_comp_mod.F90 (see also (7))

 scripts/ccsm_utils/Case.template/config_definition.xml

 scripts/ccsm_utils/Machines/config_machines.xml

 scripts/ccsm_utils/Machines/env_mach_specific.edison

 scripts/ccsm_utils/Machines/env_mach_specific.hopper

 scripts/ccsm_utils/Machines/env_mach_specific.titan

 scripts/ccsm_utils/Machines/mkbatch.edison

 scripts/ccsm_utils/Machines/mkbatch.hopper

 scripts/ccsm_utils/Machines/mkbatch.mira

 scripts/ccsm_utils/Machines/mkbatch.titan

 scripts/ccsm_utils/Tools/cesm_buildexe

 scripts/ccsm_utils/Tools/cesm_postrun_setup

 scripts/create_newcase

 (new files)

 scripts/ccsm_utils/Tools: mdiag_reduce.csh

 scripts/ccsm_utils/Tools: mdiag_reduce.pl

 scripts/ccsm_utils/Machines: syslog.edison

 scripts/ccsm_utils/Machines: syslog.generic

 scripts/ccsm_utils/Machines: syslog.hopper

 scripts/ccsm_utils/Machines: syslog.mira

 scripts/ccsm_utils/Machines: syslog.titan

16) Only in ACME (from ???)

Only in ACME/models/atm/cam/src/chemistry/utils: drv_input_data.F90

Only in ACME/models/atm/cam/src/chemistry/utils: offline_driver.F90

Only in ACME/models/atm/cam/src/chemistry/utils: unit_driver.F90

Only in ACME/models/atm/cam/src/physics/cam: cosp_share.F90

Only in ACME/models/atm/cam/src/physics/waccm: gw_drag.F90

Only in ACME/models/atm/cam/src: unit_drivers

Only in ACME/models/atm/cam/test/system: tests_pretag_frankfurt_lahey

Only in ACME: README_svn_branches.txt

17) deleted empty directories

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/atm/cam/chem_proc: bin

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/atm/cam/chem_proc: output

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/atm/cam/chem_proc/src: OBJ

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/atm/cam/chem_proc: tmp

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/atm/cam/src/utils/cam_aqua:

cpl_esmf

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/atm/cam/src/utils/cam_dom:

cpl_esmf

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/dome: scratch

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/ismip-hom: output

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/ismip-hom: scratch

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/livv: data

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/ross: output

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/ross: scratch

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/shelf: scratch

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/clm4_5/

mksurfdata_map/unit_testers: inputs

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/ocn/pop2: doc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/ocn/pop2/test: system

Only in cesm1_2_rel06_cam5_3_7_timing_130827/scripts/ccsm_utils/Tools: atm

Only in cesm1_2_rel06_cam5_3_7_timing_130827/scripts/ccsm_utils/Tools: glc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/scripts/ccsm_utils/Tools: ice

Only in cesm1_2_rel06_cam5_3_7_timing_130827/scripts/ccsm_utils/Tools: ocn

Only in cesm1_2_rel06_cam5_3_7_timing_130827/scripts/ccsm_utils/Tools/perl5lib/t: usrfiles

18) deleted miscellaneous?

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/ice/cice/docs/UsersGuide/

ice_usrdoc: images.aux

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/ice/cice/docs/UsersGuide/

ice_usrdoc: images.bbl

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/ice/cice/docs/UsersGuide/

ice_usrdoc: images.log

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/ice/cice/docs/UsersGuide/

ice_usrdoc: images.out

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/utils/esmf_wrf_timemgr/unittests:

test.out.base

 Only in ACME/models/utils/esmf_wrf_timemgr/unittests: test.out.base.REMOVED.git-id

19) deleted binaries

Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs: control.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs: copy.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs: diffs_in_fill.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs:

diffs_in_vals_and_diffs_in_fill.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs:

diffs_in_vals_and_fill.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs: diffs_in_vals.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs:

vals_differ_by_1.1.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs:

vals_differ_by_1.1_somewhere.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs:

vals_differ_by_varying_amounts2.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs:

vals_differ_by_varying_amounts.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/eis/fenscan: europe.20km.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/EISMINT-3/EISMINT-3: EISMINT3GL.input.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/simple_bisicles/src/tests/dome: dome.0032.config.log

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/simple_bisicles/src/tests/dome: dome.1024.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/simple_bisicles/src/tests/dome: dome.out.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/simple_bisicles/src/tests/shelf: circular-shelf.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/simple_bisicles/src/tests/shelf: confined-shelf.BISICLES.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/

EISMINT/EISMINT-2: mound.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/

EISMINT/EISMINT-2: trough.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/

EISMINT/erosion: topo.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/clm4_0/interpinic:

clmi.BCN.1949-01-01_10x15_USGS_simyr1850_c100322.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/clm4_0/

mksurfdata_map/unit_testers: test_lookup_2d_netcdf.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/clm4_5/interpinic:

clmi.BCN.1949-01-01_10x15_USGS_simyr1850_c121113.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/shared/

mkprocdata_map: clm4054_f19g16_I2000.clm2.h0.2000-01_c121107.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/shared/

mkprocdata_map: clm4054_ne30g16_I2000.clm2.h0.2000-01_c121107.nc

Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/shared/

mkprocdata_map: map_ne30np4_nomask_to_fv1.9x2.5_nomask_aave_da_c121107.nc