Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Recommended CAM tuning and dycore parameters for use in
CAM3_5_07 (ACMEv0)
1.1 Source Code for both runs
For complete details, see Appendix 1 below
CESM1_2_rel06 (same as CESM1_2 release)
CAM updated to CAM 5_3_07 (which has homme1_3_33 and the needed IBM xlf RRTMG
bugfix)
Source code changes applied to svn checkout ( see svndiff.out )
● For Mira: add compiler option to Macros: -qxlf2003=polymorphic
● Patch so CAM-SE can use the physics package energy fixer
● CICE bugfix involving “aice” (for coupled only)
● Optional, non-answer changing patches:
Source code changes in SourceMods in case directory:
● micro_mg1_0.F90 (to change “Dcs” in source code)
● progseasalts_intr.F90 (to change sea salt scalefactor=0.65)
● ice_dyn_evp.F90 CICE change from Mat and aice bugfix
● POP_HaloMod.F90 optional. support for new POP decompositions
1.2 Dycore and Physics settings recommended for all resolutions:
Set in ‘user_nl_cam’, except for DCS, Sea salt scalefactor and zmconv_tau.
NE120 Physics settings (from NE120 tuning)
convection:
● cldfrc_rhminl = .91 ! ne120 tuned value
● cldfrc_dp1 = 0.025 ! default 0.10
● zmconv_c0_lnd=.0035
● zmconv_c0_ocn=.0035
● zmconv_tau = 3000 ! requires source code change in zm_conv.F90
● dcs=600e-6 ! requires source code change in micro_mg1_0.F90
aerosols:
● soil_erod = '/your/system/path/inputdata/atm/cam/dst/dst_1.9x2.5_c090203.nc'
● SEASALT:scalefactor=0.65 ! NCAR default: 1.35
● dust_emis_fact = 1.05D0 ! NCAR ne30 default: 0.55
NE30 Physics settings for CSSEF project (atmosphere test-bed )
● Use same as NE120. See Forcing and I/O additions below
NE30 Tuned physics. (for F1850 RESTOM=0)
● Use NE120 aerosol tunings
● dtime=1800 (ATM_NCPL=48) ! NCAR default, set in env_run.xml
● cldfrc_rhminl = .8975 ! NCAR default
● cldfrc_dp1=.035 ! tuned for RESTOM=0
● zmconv_c0_lnd=.0035 ! NE120 values
● zmconv_c0_ocn=.0035 ! NE120 values
● zmconv_tau = 3600 ! NCAR default
● dcs=400e-6 ! NCAR default. hardcoded in micro_mg1_0.F90
Dycore settings for all resolutions:
energy_fixer = -1 ! requires CAM physics energy fixer enabled via source code patch
 ! in physpkg.F90
statefreq = 1200
! optional: turn on interpolation of history output:
! interpolate_analysis = .true.,.true.,.true.,.true.,.true.,.true.,
! interp_gridtype = 2 ! to interpolate to a Gauss grid. (default is FV fixed)
! dycore settings
se_ftype=0
rsplit = 3
qsplit=1 tstep_type=5 ! add tstep_type to CAM’s namelist_definition.xml file.
vert_remap_q_alg = 1 ! I think this is the default, may not be needed
Dycore resolution specific settings:
! ne30 (1 degree):
se_nsplit=2 hypervis_subcycle=3 ! dtime=1800
se_nsplit=1 rsplit=2 hypervis_subcycle=3 ! dtime= 600. rsplit=3 is ok, just slower
nu=1e15 nu_div=2.5e15 nu_q=1e15 nu_p=1e15
! ne120 (¼ degree):
se_nsplit = 4 hypervis_subcycle=4 ! dtime=900
se_nsplit = 3 hypervis_subcycle=3 ! dtime=600
nu=1e13 nu_div=2.5e13 nu_q=1e13 nu_p=1e13
ncdata = '/gpfs/mira-fs0/projects/ClimEndStation/taylorm/cam_ic/f1850c5_m3.cam.i.0007-01-01-
00000.nc'
bnd_topo = '/gpfs/mira-fs0/projects/ClimEndStation/taylorm/cam_ic/USGS-
gtopo30_ne120np4_16xconsistentSGH.nc'
! ne240 (1/8 degree):
se_nsplit = 5 hypervis_subcycle=4 ! dtime=600
nu=1e12 nu_div=2.5e12 nu_q=1e12 nu_p=1e12
! armx8v3 (1 degree -> 1/8 degree):
se_nsplit = 5 hypervis_subcycle=8 ! dtime=600
nu=8.0e-8 nu_div=20.0e-8 nu_p=8.0e-8 nu_q=-1 (uses 8.0e-8)
CSSEF runs: all resolutions (NE30 and var-res) will use the NE120
physics tunings and physics timestep (dtime) as above with the
following additions:
ne30 (1 degree) Free-Running simulation for January to August 2011
Use the same settings for physics as high resolution runs
RUN_STARTDATE = “2011-01-01” ! set in env_run.xml
dtime=600 ! set in env_run.xml by ATM_NCPL=144, “dtime” in user_nl_cam will be ignored
**user_nl_cam changes**
soil_erod = '/global/u2/t/tang30/CSSEF/inputdata/dst_1.9x2.5_c090203.nc'
! output settings
 mfilt = 30,121,121,121,
 nhtfrq = 0,-1,-1,-1,
 fincl2
= 'PRECT','PRECC','PRECL','FLUT','PS','TREFHT','RHREFHT','UBOT','VBOT','PBLH','C
APE','CIN','FSNS','FSDS','FLNS','FLDS','CLDTOT','TMQ','SHFLX','LHFLX','TGCLDCWP','TGCL
DLWP','TGCLDIWP','QREFHT','TS'
 fincl3 = 'PS','T','Q','U','V','CLOUD','RELHUM'
 fincl4 = 'PS','DCQ','DTCOND','DTV','VD01'
 interpolate_analysis = .true.,.true.,.true.,.true.,.true.,.true.,
 interp_nlat = 0
 interp_nlon = 0
**user_nl_docn changes** (use the weekly SST data)
streams = 'docn.streams.txt.prescribed 1990 1990 2013 '
**user_nl_cice changes** (use the weekly SST data)
model_year_align = 1990
stream_fldfilename =
'/project/projectdirs/mp193/CAPT/BC/SST/sst_weekly_cdcunits_1x1_1990-01-01-
2013-08-11.nc'
stream_fldvarname = 'ice_cov'
stream_year_first = 1990
stream_year_last = 2013
Appendix 1
General steps and atrributions in generating acme_v0 from
cesm1_2_rel06 (June 15, 2014) (per email from P. Worley, 6/15/2014)
 
1) svn checkout https://svn-ccsm-models.cgd.ucar.edu/cesm1/tags/cesm1_2_rel06
cesm1_2_rel06
 cd cesm1_2_rel06
2) (newer CAM, with homme1_3_33 and the needed IBM xlf RRTMG bugfix [Taylor])
 cd models/atm/cam
 svn switch https://svn-ccsm-models.cgd.ucar.edu/cam1/trunk_tags/cam5_3_07/models/atm/
cam
3) (newer timing library [Worley])
 cd models/utils/timing
 svn switch https://svn-ccsm-models.cgd.ucar.edu/timing/trunk_tags/timing_130827
4) (glimmer-cism2 file format differences)
 cd models/glc/cism/glimmer-cism2
 - change files from DOS to UNIX format
5) (Patch to allow zmconv_tau and tstep_type to be set in namelist [Taylor])
 models/atm/cam/bld/namelist_files/namelist_definition.xml
 models/atm/cam/src/physics/cam/zm_conv.F90
6) (Patch so CAM-SE can use the physics package energy fixer [Taylor])
 models/atm/cam/src/physics/cam/cam_diagnostics.F90
 models/atm/cam/src/physics/cam/physpkg.F90
7) (Applied suite of patches to remove unneeded information from log files [Taylor])
 models/csm_share/shr/shr_stream_mod.F90
 models/drv/driver/seq_map_mod.F90
 models/ice/cice/src/source/ice_init.F90
 models/lnd/clm/src/clm4_0/main/histFileMod.F90
 models/lnd/clm/src/util_share/spmdMod.F90
 models/drv/driver/ccsm_comp_mod.F90 (see also (15))
8) (CICE bugfix involving “aice” (for coupled only) [Hunke, Maltrud, Taylor, Worley, ...])
 models/ice/cice/src/source/ice_dyn_evp.F90
9) (Patch to speedup CLM initialization [T. Craig; part of more recent versions of CLM])
 models/lnd/clm/src/util_share/decompInitMod.F90
10) (??? [Talyor?])
 models/drv/driver/seq_domain_mct.F90
 33c33
 new: real(R8), parameter :: eps_frac_samegrid = 1.0e-9_R8 ! epsilon for fractions for
samegrid
 ---
 old: real(R8), parameter :: eps_frac_samegrid = 1.0e-14_R8 ! epsilon for fractions for
samegrid
 models/drv/driver/seq_frac_mct.F90
 714c714
 new: if (error .or. seq_frac_debug > 2) then
 ---
 old: if (error .or. seq_frac_debug > 1) then
11) (format fixes??? [??? - clearly needed])
 models/ocn/pop2/input_templates/tx0.1v2_movie_contents
12) (format fix? [???])
 models/rof/rtm/bld/rtm.buildnml.csh
 62,63c62
 new: #set nrevsn_rtm = "${RUN_REFCASE}.rtm.r.${RUN_REFDATE}-
${RUN_REFTOD}.nc"
 new: set nrevsn_rtm = "nrevsn_rtm = '${RUN_REFCASE}.rtm.r.${RUN_REFDATE}-
${RUN_REFTOD}.nc'"
 ---
 old: set nrevsn_rtm = "${RUN_REFCASE}.rtm.r.${RUN_REFDATE}-
${RUN_REFTOD}.nc"
13) (additional POP optimization options [Worley])
 models/ocn/pop2/mpi/POP_HaloMod.F90
14) (performance instrumentation changes [Worley])
 models/atm/cam/src/dynamics/se/share/bndry_mod.F90
 models/atm/cam/src/dynamics/se/share/prim_advance_mod.F90
 models/atm/cam/src/dynamics/se/share/prim_advection_mod.F90
 models/atm/cam/src/dynamics/se/share/spelt_mod.F90
 models/atm/cam/src/dynamics/se/share/viscosity_mod.F90
 models/atm/cam/src/dynamics/se/stepon.F90
 models/ocn/pop2/source/baroclinic.F90
 models/ocn/pop2/source/barotropic.F90
 models/ocn/pop2/source/POP_SolversMod.F90
15) (modified performance output and archive logic [Worley])
 models/drv/bld/build-namelist
 models/drv/bld/namelist_files/namelist_defaults_drv.xml
 models/drv/bld/namelist_files/namelist_definition_drv.xml [Taylor]
 models/drv/driver/ccsm_comp_mod.F90 (see also (7))
 scripts/ccsm_utils/Case.template/config_definition.xml
 scripts/ccsm_utils/Machines/config_machines.xml
 scripts/ccsm_utils/Machines/env_mach_specific.edison
 scripts/ccsm_utils/Machines/env_mach_specific.hopper
 scripts/ccsm_utils/Machines/env_mach_specific.titan
 scripts/ccsm_utils/Machines/mkbatch.edison
 scripts/ccsm_utils/Machines/mkbatch.hopper
 scripts/ccsm_utils/Machines/mkbatch.mira
 scripts/ccsm_utils/Machines/mkbatch.titan
 scripts/ccsm_utils/Tools/cesm_buildexe
 scripts/ccsm_utils/Tools/cesm_postrun_setup
 scripts/create_newcase
 (new files)
 scripts/ccsm_utils/Tools: mdiag_reduce.csh
 scripts/ccsm_utils/Tools: mdiag_reduce.pl
 scripts/ccsm_utils/Machines: syslog.edison
 scripts/ccsm_utils/Machines: syslog.generic
 scripts/ccsm_utils/Machines: syslog.hopper
 scripts/ccsm_utils/Machines: syslog.mira
 scripts/ccsm_utils/Machines: syslog.titan
16) Only in ACME (from ???)
Only in ACME/models/atm/cam/src/chemistry/utils: drv_input_data.F90
Only in ACME/models/atm/cam/src/chemistry/utils: offline_driver.F90
Only in ACME/models/atm/cam/src/chemistry/utils: unit_driver.F90
Only in ACME/models/atm/cam/src/physics/cam: cosp_share.F90
Only in ACME/models/atm/cam/src/physics/waccm: gw_drag.F90
Only in ACME/models/atm/cam/src: unit_drivers
Only in ACME/models/atm/cam/test/system: tests_pretag_frankfurt_lahey
Only in ACME: README_svn_branches.txt
17) deleted empty directories
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/atm/cam/chem_proc: bin
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/atm/cam/chem_proc: output
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/atm/cam/chem_proc/src: OBJ
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/atm/cam/chem_proc: tmp
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/atm/cam/src/utils/cam_aqua:
cpl_esmf
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/atm/cam/src/utils/cam_dom:
cpl_esmf
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/dome: scratch
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/ismip-hom: output
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/ismip-hom: scratch
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/livv: data
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/ross: output
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/ross: scratch
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/higher-
order/shelf: scratch
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/clm4_5/
mksurfdata_map/unit_testers: inputs
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/ocn/pop2: doc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/ocn/pop2/test: system
Only in cesm1_2_rel06_cam5_3_7_timing_130827/scripts/ccsm_utils/Tools: atm
Only in cesm1_2_rel06_cam5_3_7_timing_130827/scripts/ccsm_utils/Tools: glc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/scripts/ccsm_utils/Tools: ice
Only in cesm1_2_rel06_cam5_3_7_timing_130827/scripts/ccsm_utils/Tools: ocn
Only in cesm1_2_rel06_cam5_3_7_timing_130827/scripts/ccsm_utils/Tools/perl5lib/t: usrfiles
18) deleted miscellaneous?
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/ice/cice/docs/UsersGuide/
ice_usrdoc: images.aux
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/ice/cice/docs/UsersGuide/
ice_usrdoc: images.bbl
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/ice/cice/docs/UsersGuide/
ice_usrdoc: images.log
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/ice/cice/docs/UsersGuide/
ice_usrdoc: images.out
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/utils/esmf_wrf_timemgr/unittests:
test.out.base
 Only in ACME/models/utils/esmf_wrf_timemgr/unittests: test.out.base.REMOVED.git-id
19) deleted binaries
Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs: control.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs: copy.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs: diffs_in_fill.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs:
diffs_in_vals_and_diffs_in_fill.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs:
diffs_in_vals_and_fill.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs: diffs_in_vals.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs:
vals_differ_by_1.1.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs:
vals_differ_by_1.1_somewhere.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs:
vals_differ_by_varying_amounts2.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/tools/cprnc/test_inputs:
vals_differ_by_varying_amounts.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/eis/fenscan: europe.20km.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/EISMINT-3/EISMINT-3: EISMINT3GL.input.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/simple_bisicles/src/tests/dome: dome.0032.config.log
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/simple_bisicles/src/tests/dome: dome.1024.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/simple_bisicles/src/tests/dome: dome.out.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/simple_bisicles/src/tests/shelf: circular-shelf.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/example-
drivers/simple_bisicles/src/tests/shelf: confined-shelf.BISICLES.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/
EISMINT/EISMINT-2: mound.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/
EISMINT/EISMINT-2: trough.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/glc/cism/glimmer-cism/tests/
EISMINT/erosion: topo.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/clm4_0/interpinic:
clmi.BCN.1949-01-01_10x15_USGS_simyr1850_c100322.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/clm4_0/
mksurfdata_map/unit_testers: test_lookup_2d_netcdf.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/clm4_5/interpinic:
clmi.BCN.1949-01-01_10x15_USGS_simyr1850_c121113.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/shared/
mkprocdata_map: clm4054_f19g16_I2000.clm2.h0.2000-01_c121107.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/shared/
mkprocdata_map: clm4054_ne30g16_I2000.clm2.h0.2000-01_c121107.nc
Only in cesm1_2_rel06_cam5_3_7_timing_130827/models/lnd/clm/tools/shared/
mkprocdata_map: map_ne30np4_nomask_to_fv1.9x2.5_nomask_aave_da_c121107.ncThis document describes the tunings used by the High-Res and CSSEF projects with ACMEv0  (github tag: v0.0.1 with some additional source code changes in SourceMods)

Tunings used by the High-Res and CSSEF projects

 

Our first attempt to capture the provenance of the B1850 ACMEv0 simulation is here:

tar files associated with the B1850 simulation

The V0 simulations were run with CESM1_2_rel06 (the ACME repo starting point, tag v0.0), upgraded to CAM5_3_07, and then with additional minor bug fixes.  These upgrades are captured on the ACME maint-0.0 branch, tag "v0.0.1".   Recently, Titan was upgraded and the updates necessary to run on Titan.  the maint-0.0 branch was further updated so that the code can run on Titan as of 8/2014.  These latest updates are tag "v0.0.2".   See Branch, Tag, and Version name conventions

 

Related Confluence pages links:

/wiki/spaces/SIM/pages/3245968

Location of V0.0.1 Climos on Titan

/wiki/spaces/WORKFLOW/pages/3246015

/wiki/spaces/WORKFLOW/pages/3246059

Some info on V0.0.1(HiRes) model spin up and configuration – see /wiki/spaces/ATM/pages/3246044, go to 'V0.0.1 Evaluation'

AMWG diagnostics from V0.0.1 (high-res project's cam5-se 0.25 degree) 1850 coupled run