Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Date: 14-Feb-2015
Machine: Edison  
1. Log on edison and clone E3SM repository
Code Block
languagebash
themeEmacs
ssh user-name@edison.nersc.gov
cd $SCRATCH 
git clone git@github.com:E3SM-Project/E3SM.git
cd E3SM
export E3SM_DIR=$PWD

2. Generate (or obtain pre-generated) CLM gridfile in SCRIP format
Code Block
languagebash
themeEmacs
cd $SCRATCH
mkdir inputdata
cd inputdata
export CESM_INPUTDATA_DIR=$PWD
mkdir -p ${CESM_INPUTDATA_DIR}/lnd/clm2/mappingdata/grids
cd ${CESM_INPUTDATA_DIR}/lnd/clm2/mappingdata/grids
svn export https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_ne120np4_nomask_c101123.nc
export GRIDFILE=${CESM_INPUTDATA_DIR}/lnd/clm2/mappingdata/grids/SCRIPgrid_ne120np4_nomask_c101123.nc

3. Preliminaries for mkmapdata
The mkmapdata script calls ESMF to generate mapping files. Some of the input data sets are very large and require a large memory footprint, so we need an ESMF built with MPI (note that the ESMF in the e3sm-unified conda environment will not work for this). One way to do this is to build our own. On cori or nersc, the following should be sufficient:

Code Block
languagebash
themeEmacs
# Source environment settings used when building/running E3SM
MACHINE=cori-knl

# Set paths needed to build ESMF
export ESMF_DIR=${HOME}/software/esmf
export ESMF_COMM=mpi
export ESMF_COMPILER=intel
export ESMF_INSTALL_PREFIX=${HOME}/software/esmf/${MACHINE}_${ESMF_COMPILER}_${ESMF_COMM}
export ESMF_NETCDF="split"

# Build
cd ${ESMF_DIR}
gmake clean
gmake
gmake install

We then need to load additional modules and set environment variables for mkmapdata:

Code Block
languagebash
themeEmacs
firstline1
module load nco
module load ncl
export ESMFBIN_PATH=${ESMF_INSTALL_PREFIX}/bin/binO/Unicos.intel.64.mpi.default
export REGRID_PROC=48
export MPIEXEC="srun -n ${REGRID_PROC} "
export CSMDATA=/project/projectdirs/acme/inputdata

4. Create mapping files

4.1 First determine the mapping files that would be created by mkmapdata.sh by running the mkmapdata.sh script in "debug" and "verbose" mode to
Code Block
languagebash
themeEmacs
cd ${E3SM_DIR}/models/lnd/clm/tools/shared/mkmapdata
> ./mkmapdata.sh --gridfile ${GRIDFILE} --res ne120np4 --phys clm4_5 --gridtype global --debug --batch -v
./mkmapdata.sh
Script to create mapping files required by mksurfdata_map
query command is ./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata
Using user specified scrip grid file: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
Output grid resolution is ne120np4
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 0.5x0.5 -options lmask=AVHRR,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 0.5x0.5 -options lmask=MODIS,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 3x3min -options lmask=LandScan2004,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 3x3min -options lmask=MODIS,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 3x3min -options lmask=USGS,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 5x5min -options lmask=nomask,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 5x5min -options lmask=IGBP-GSDP,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 5x5min -options lmask=ISRIC-WISE,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 10x10min -options lmask=nomask,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 10x10min -options lmask=IGBPmergeICESatGIS,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 3x3min -options lmask=GLOBE-Gardner,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 3x3min -options lmask=GLOBE-Gardner-mergeGIS,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 0.9x1.25 -options lmask=GRDC,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 360x720cru -options lmask=cruncep,glc_nec=10 -onlyfiles
./../../../bld/queryDefaultNamelist.pl -silent -namelist clmexp -phys clm4_5 -justvalue -options sim_year=2000 -csmdata /project/projectdirs/ccsm1/inputdata -var scripgriddata -res 1km-merge-10min -options lmask=HYDRO1K-merge-nomask,glc_nec=10 -onlyfiles
Running in batch mode using MPI
which: invalid option -- 'n'
which: no 48 in (/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin:/usr/common/usg/ncl/6.1.1/intel/bin:/usr/common/usg/nco/4.3.8/intel/bin:/opt/cray/netcdf/4.3.2/bin:/usr/common/usg/darshan/2.3.0/bin:/usr/common/usg/altd/2.0/bin:/usr/common/usg/bin:/usr/common/mss/bin:/usr/common/nsg/bin:/opt/moab/8.0.1/bin:/opt/moab/8.0.1/sbin:/opt/torque/5.0.1/sbin:/opt/torque/5.0.1/bin:/opt/cray/mpt/7.1.1/gni/bin:/opt/cray/atp/1.7.5/bin:/opt/cray/rca/1.0.0-2.0502.53711.3.127.ari/bin:/opt/cray/alps/5.2.1-2.0502.9041.11.6.ari/sbin:/opt/cray/alps/5.2.1-2.0502.9041.11.6.ari/bin:/opt/cray/dvs/2.5_0.9.0-1.0502.1873.1.145.ari/bin:/opt/cray/xpmem/0.1-2.0502.55507.3.2.ari/bin:/opt/cray/dmapp/7.0.1-1.0502.9501.5.219.ari/bin:/opt/cray/pmi/5.0.6-1.0000.10439.140.2.ari/bin:/opt/cray/ugni/5.0-1.0502.9685.4.24.ari/bin:/opt/cray/udreg/2.3.2-1.0502.9275.1.12.ari/bin:/opt/intel/composer_xe_2015.1.133/bin/intel64:/opt/cray/craype/2.2.1/bin:/opt/cray/switch/1.0-1.0502.54233.2.96.ari/bin:/opt/cray/eslogin/eswrap/1.1.0-1.020200.1130.0/bin:/usr/syscom/nsg/sbin:/usr/syscom/nsg/bin:/opt/modules/3.2.10.2/bin:/global/homes/g/gbisht/bin:/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/X11R6/bin:/usr/games:/usr/lib/mit/bin:/usr/lib/mit/sbin:/usr/lib/qt3/bin:/opt/cray/bin)
Running in batch mode
rm: cannot remove `PET*.Log': No such file or directory
Creating mapping file: map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_0.5x0.5_AVHRR_c110228.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_0.5x0.5_AVHRR_c110228.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_0.5x0.5_MODIS_c110228.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_0.5x0.5_MODIS_c110228.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3minx3min_LandScan2004_c120517.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3minx3min_LandScan2004_c120517.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP --64bit_offset
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_3x3min_MODIS_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3minx3min_MODIS_c110915.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3minx3min_MODIS_c110915.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_3x3min_MODIS_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP --64bit_offset
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_3x3min_MODIS_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_3x3min_MODIS_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_3x3min_MODIS_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_3x3min_MODIS_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_3x3min_MODIS_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_3x3min_MODIS_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_3x3min_USGS_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3x3_USGS_c120912.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3x3_USGS_c120912.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_3x3min_USGS_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP --64bit_offset
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_3x3min_USGS_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_3x3min_USGS_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_3x3min_USGS_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_3x3min_USGS_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_3x3min_USGS_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_3x3min_USGS_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_5x5min_nomask_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_5x5min_nomask_c110530.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_5x5min_nomask_c110530.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_5x5min_nomask_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_5x5min_nomask_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_5x5min_nomask_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_5x5min_nomask_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_5x5min_nomask_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_5x5min_nomask_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_5x5min_nomask_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_5x5min_IGBP-GSDP_c110228.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_5x5min_IGBP-GSDP_c110228.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_5x5min_ISRIC-WISE_c111114.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_5x5min_ISRIC-WISE_c111114.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_10x10min_nomask_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_10x10min_nomask_c110228.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_10x10min_nomask_c110228.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_10x10min_nomask_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_10x10min_nomask_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_10x10min_nomask_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_10x10min_nomask_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_10x10min_nomask_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_10x10min_nomask_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_10x10min_nomask_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_10x10min_IGBPmergeICESatGIS_c110818.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_10x10min_IGBPmergeICESatGIS_c110818.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3minx3min_GLOBE-Gardner_c120922.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3minx3min_GLOBE-Gardner_c120922.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP --64bit_offset
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3minx3min_GLOBE-Gardner-mergeGIS_c120922.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3minx3min_GLOBE-Gardner-mergeGIS_c120922.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP --64bit_offset
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_0.9x1.25_GRDC_c130307.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_0.9x1.25_GRDC_c130307.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_360x720_cruncep_c120830.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_360x720_cruncep_c120830.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_c150214.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Creating mapping file: map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_c150214.nc
From input grid: /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/UGRID_1km-merge-10min_HYDRO1K-merge-nomask_c130402.nc
For output grid: /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc
 
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/UGRID_1km-merge-10min_HYDRO1K-merge-nomask_c130402.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_c150214.nc --src_type UGRID --src_meshname landmesh --dst_type SCRIP --netcdf4
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a hostname,global,a,c,edison07 -h map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_c150214.nc
ncatted -a logname,global,a,c,gbisht -h map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_c150214.nc
rm -f rmdups_map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_c150214.nc
env MAPFILE=map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_c150214.nc NEWMAPFILE=rmdups_map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_c150214.nc ncl ./rmdups.ncl
Successffully created needed mapping files for ne120np4


4.2 Following are the 15 mapping files needed to create surface dataset for CLM4_5 physics @ ne120np4 resolution:
 map_3x3min_MODIS_to_ne120np4_nomask_aave_da_c150214.nc
 map_3x3min_USGS_to_ne120np4_nomask_aave_da_c150214.nc
 map_5x5min_nomask_to_ne120np4_nomask_aave_da_c150214.nc
 map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_c150214.nc
 map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_c150214.nc
 map_10x10min_nomask_to_ne120np4_nomask_aave_da_c150214.nc
 map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_c150214.nc
 map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_c150214.nc
 map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_c150214.nc
 map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_c150214.nc
 map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_c150214.nc
 map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_c150214.nc

4.2.1 Only the generation of map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_c150214.nc, requires modifying the default commands outputted by mkmapdata.sh
 - Due to large memory requirement of the source dataset (UGRID_1km-merge-10min_HYDRO1K-merge-nomask_c130402.nc), one needs to limit the number of tasks NUMA per node by "aprun -S 1"
 - Additionally, one need to change the command line option to ESMF_RegridWeightGen from '--netcdf4'to '--64bit_offset'

4.3 Generate the mapping files via interactive or batch job. Below are example of pbs scripts to create the mapping files.

4.3.1
Code Block
languagebash
themeEmacs
> cat 0.5x0.5_AVHRR.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=01:00:00
#PBS -N 0.5x0.5_AVHRR
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
 module load nco/4.3.8
module load ncl/6.1.1
 cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_0.5x0.5_AVHRR_c110228.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_0.5x0.5_AVHRR_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl

4.3.2
Code Block
languagebash
themeEmacs
> cat 0.5x0.5_MODIS.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=01:00:00
#PBS -N 0.5x0.5_MODIS
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
 module load nco/4.3.8
module load ncl/6.1.1
 cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_0.5x0.5_MODIS_c110228.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_0.5x0.5_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl

4.3.3
Code Block
languagebash
themeEmacs
>cat 3x3min_LandScan2004.pbs 
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=01:00:00
#PBS -N LandScan2004
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
 module load nco/4.3.8
module load ncl/6.1.1
 cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
 aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3minx3min_LandScan2004_c120517.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP --64bit_offset
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_3x3min_LandScan2004_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl
4.3.4 
Code Block
languagebash
themeEmacs
>cat 3x3min_MODIS.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=02:00:00
#PBS -N 3x3min_MODIS
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3minx3min_MODIS_c110915.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_3x3min_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP --64bit_offset
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_3x3min_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_3x3min_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_3x3min_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_3x3min_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_3x3min_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_3x3min_MODIS_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl

4.3.5
Code Block
languagebash
themeEmacs
>cat 3x3min_USGS.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=01:00:00
#PBS -N 3x3min_USGS
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3x3_USGS_c120912.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_3x3min_USGS_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP --64bit_offset
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_3x3min_USGS_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_3x3min_USGS_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_3x3min_USGS_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_3x3min_USGS_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_3x3min_USGS_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_3x3min_USGS_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl

4.3.6
Code Block
languagebash
themeEmacs
>cat 5x5min_nomask.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=03:00:00
#PBS -N 5x5min_nomask
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_5x5min_nomask_c110530.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_5x5min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_5x5min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_5x5min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_5x5min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_5x5min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_5x5min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_5x5min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl

4.3.7
Code Block
languagebash
themeEmacs
>cat 5x5min_IGBP-GSDP.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=01:00:00
#PBS -N 5x5min_IGBP-GSDP
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_5x5min_IGBP-GSDP_c110228.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_5x5min_IGBP-GSDP_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl
4.3.8
Code Block
languagebash
themeEmacs
>cat 5x5min_ISRIC-WISE.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=01:00:00
#PBS -N 5x5min_ISRIC-WISE
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_5x5min_ISRIC-WISE_c111114.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_5x5min_ISRIC-WISE_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl

4.3.9
Code Block
languagebash
themeEmacs
> cat 10x10min_nomask.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=01:00:00
#PBS -N 10x10min_nomask
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_10x10min_nomask_c110228.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_10x10min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_10x10min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_10x10min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_10x10min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_10x10min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_10x10min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_10x10min_nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl

4.3.10
Code Block
languagebash
themeEmacs
> cat 10x10min_IGBPmergeICESatGIS.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=01:00:00
#PBS -N 10x10min_IGBPmergeICESatGIS
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_10x10min_IGBPmergeICESatGIS_c110818.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_10x10min_IGBPmergeICESatGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl

4.3.11
Code Block
languagebash
themeEmacs
> cat 3x3min_GLOBE-Gardner.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=03:00:00
#PBS -N 3x3min_GLOBE-Gardner
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3minx3min_GLOBE-Gardner_c120922.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP --64bit_offset
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_3x3min_GLOBE-Gardner_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl

4.3.12
Code Block
languagebash
themeEmacs
> cat 3x3min_GLOBE-Gardner-mergeGIS.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=03:00:00
#PBS -N 3x3min_GLOBE-Gardner-mergeGIS
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_3minx3min_GLOBE-Gardner-mergeGIS_c120922.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP --64bit_offset
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_3x3min_GLOBE-Gardner-mergeGIS_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl

4.3.13
Code Block
languagebash
themeEmacs
> cat 0.9x1.25_GRDC.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=01:00:00
#PBS -N 0.9x1.25_GRDC
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_0.9x1.25_GRDC_c130307.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_0.9x1.25_GRDC_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl

4.3.14
Code Block
languagebash
themeEmacs
> cat 360x720cru_cruncep.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=48
#PBS -l walltime=01:00:00
#PBS -N 360x720cru_cruncep
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/SCRIPgrid_360x720_cruncep_c120830.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type SCRIP --dst_type SCRIP
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_360x720cru_cruncep_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl

4.3.15
Code Block
languagebash
themeEmacs
> cat 1km-merge-10min_HYDRO1K-merge-nomask.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=960
#PBS -l walltime=04:00:00
#PBS -N 1km-merge-10min_HYDRO1K-merge-nomask
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/shared/mkmapdata
CDATE="c"`date +%y%m%d`
aprun -n 48 -S 1 /project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen --ignore_unmapped -s /project/projectdirs/ccsm1/inputdata/lnd/clm2/mappingdata/grids/UGRID_1km-merge-10min_HYDRO1K-merge-nomask_c130402.nc -d /scratch2/scratchdirs/gbisht/inputdata/lnd/clm2/mappingdata/grids//SCRIPgrid_ne120np4_nomask_c101123.nc -m conserve -w map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc --src_type UGRID --src_meshname landmesh --dst_type SCRIP --64bit_offset
ncatted -a history,global,a,c,/project/projectdirs/ccsm1/esmf/edison/ESMF-6.3.0rp1intel14.0_netcdf4.1.3-O/bin/ESMF_RegridWeightGen map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a hostname,global,a,c,${HOST} -h map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc
ncatted -a logname,global,a,c,gbisht -h map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc
rm -f rmdups_map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc
env MAPFILE=map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc NEWMAPFILE=rmdups_map_1km-merge-10min_HYDRO1K-merge-nomask_to_ne120np4_nomask_aave_da_${CDATE}.nc ncl ./rmdups.ncl


4.4 Move the mapping netcdf files to inputdata directory
Code Block
languagebash
themeEmacs
mkdir -p ${CESM_INPUTDATA_DIR}/lnd/clm2/maps/ne120np4
mv ${ACME_DIR}/models/lnd/clm/tools/shared/mkmapdata/map*.nc ${CESM_INPUTDATA_DIR}/lnd/clm2/maps/ne120np4
5. Create surface dataset

5.1 Add the mapping in components/clm/bld/namelist_files/namelist_defaults_clm4_5.xml
Code Block
languagebash
themeEmacs
<map frm_hgrid="0.5x0.5"    frm_lmask="AVHRR"  to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="0.5x0.5"    frm_lmask="AVHRR"  to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_0.5x0.5_AVHRR_to_1x1_brazil_nomask_aave_da_c120717.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_0.5x0.5_AVHRR_to_1x1_brazil_nomask_aave_da_c120717.nc</map>
<map frm_hgrid="0.5x0.5"    frm_lmask="MODIS"  to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="0.5x0.5"    frm_lmask="MODIS"  to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_0.5x0.5_MODIS_to_1x1_brazil_nomask_aave_da_c120717.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_0.5x0.5_MODIS_to_1x1_brazil_nomask_aave_da_c120717.nc</map>
<map frm_hgrid="0.5x0.5"    frm_lmask="nomask"  to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="0.5x0.5"    frm_lmask="nomask"  to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_0.5x0.5_nomask_to_1x1_brazil_nomask_aave_da_c120717.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_0.5x0.5_nomask_to_1x1_brazil_nomask_aave_da_c120717.nc</map>
<map frm_hgrid="10x10min"    frm_lmask="nomask"  to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="10x10min"    frm_lmask="nomask"  to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_10x10min_nomask_to_1x1_brazil_nomask_aave_da_c120717.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_10x10min_nomask_to_1x1_brazil_nomask_aave_da_c120717.nc</map>
<map frm_hgrid="3x3min"    frm_lmask="MODIS"  to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="3x3min"    frm_lmask="MODIS"  to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_3x3min_MODIS_to_1x1_brazil_nomask_aave_da_c120717.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_3x3min_MODIS_to_1x1_brazil_nomask_aave_da_c120717.nc</map>
<map frm_hgrid="3x3min"    frm_lmask="USGS"   to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="3x3min"    frm_lmask="USGS"   to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_3x3min_USGS_to_1x1_brazil_nomask_aave_da_c120927.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_3x3min_USGS_to_1x1_brazil_nomask_aave_da_c120927.nc</map>
<map frm_hgrid="3x3min"    frm_lmask="LandScan2004" to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="3x3min"    frm_lmask="LandScan2004" to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_3x3min_LandScan2004_to_1x1_brazil_nomask_aave_da_c121114.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_3x3min_LandScan2004_to_1x1_brazil_nomask_aave_da_c121114.nc</map>
<map frm_hgrid="5x5min"    frm_lmask="IGBP-GSDP"  to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="5x5min"    frm_lmask="IGBP-GSDP"  to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_5x5min_IGBP-GSDP_to_1x1_brazil_nomask_aave_da_c120717.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_5x5min_IGBP-GSDP_to_1x1_brazil_nomask_aave_da_c120717.nc</map>
<map frm_hgrid="5x5min"    frm_lmask="ISRIC-WISE"  to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="5x5min"    frm_lmask="ISRIC-WISE"  to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_5x5min_ISRIC-WISE_to_1x1_brazil_nomask_aave_da_c120717.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_5x5min_ISRIC-WISE_to_1x1_brazil_nomask_aave_da_c120717.nc</map>
<map frm_hgrid="5x5min"    frm_lmask="nomask"  to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="5x5min"    frm_lmask="nomask"  to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_5x5min_nomask_to_1x1_brazil_nomask_aave_da_c120717.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_5x5min_nomask_to_1x1_brazil_nomask_aave_da_c120717.nc</map>
<map frm_hgrid="3x3min"   frm_lmask="GLOBE-Gardner" to_hgrid="1x1_brazil" to_lmask="nomask"	<map frm_hgrid="3x3min"   frm_lmask="GLOBE-Gardner" to_hgrid="1x1_brazil" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/1x1_brazil/map_3x3min_GLOBE-Gardner_to_1x1_brazil_nomask_aave_da_c120927.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_3x3min_GLOBE-Gardner_to_1x1_brazil_nomask_aave_da_c120927.nc</map>
<map frm_hgrid="3x3min"   frm_lmask="GLOBE-Gardner-mergeGIS" to_hgrid="1x1_brazil" to_lmask="nomask"	<map frm_hgrid="3x3min"   frm_lmask="GLOBE-Gardner-mergeGIS" to_hgrid="1x1_brazil" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/1x1_brazil/map_3x3min_GLOBE-Gardner-mergeGIS_to_1x1_brazil_nomask_aave_da_c120927.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_3x3min_GLOBE-Gardner-mergeGIS_to_1x1_brazil_nomask_aave_da_c120927.nc</map>
<map frm_hgrid="0.9x1.25"    frm_lmask="GRDC"  to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="0.9x1.25"    frm_lmask="GRDC"  to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_0.9x1.25_GRDC_to_1x1_brazil_nomask_aave_da_c130309.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_0.9x1.25_GRDC_to_1x1_brazil_nomask_aave_da_c130309.nc</map>
<map frm_hgrid="360x720cru"    frm_lmask="cruncep"  to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="360x720cru"    frm_lmask="cruncep"  to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_360x720_cruncep_to_1x1_brazil_nomask_aave_da_c130326.nc</map>	>lnd/clm2/mappingdata/maps/1x1_brazil/map_360x720_cruncep_to_1x1_brazil_nomask_aave_da_c130326.nc</map>
<map frm_hgrid="1km-merge-10min"    frm_lmask="HYDRO1K-merge-nomask"  to_hgrid="1x1_brazil"   to_lmask="nomask" 	<map frm_hgrid="1km-merge-10min"    frm_lmask="HYDRO1K-merge-nomask"  to_hgrid="1x1_brazil"   to_lmask="nomask" 
>lnd/clm2/mappingdata/maps/1x1_brazil/map_1km-merge-10min_HYDRO1K-merge-nomask_to_1x1_brazil_nomask_aave_da_c130403.nc</map>	


5.2 Compile surface dataset source code (Updated on 15-Nov-2016 based on Ritvik Sahajpal's comment)


Code Block
languagebash
themeEmacs
module load cray-netcdf/4.4.0
module load cray-hdf5/1.8.16
export LIB_NETCDF=/opt/cray/netcdf/4.4.0/intel/150/lib
export INC_NETCDF=/opt/cray/netcdf/4.4.0/intel/150/include
export USER_FC=ifort
export USER_CC=icc
export USER_LDFLAGS="-L/opt/cray/netcdf/4.4.0/intel/150/lib -lnetcdf -lnetcdff -lnetcdf_intel"
export USER_LDFLAGS=$USER_LDFLAGS" -L//opt/cray/hdf5/1.8.16/intel/150/lib -lhdf5 -lhdf5_fortran -lhdf5_cpp -lhdf5_fortran_intel -lhdf5_hl_intel -lhdf5hl_fortran_intel"
cd ${ACME_DIR}/models/lnd/clm/tools/clm4_5/mksurfdata_map/src
gmake


5.3 Run the mksurfdata.pl script in "debug" mode to generate the namelist
Code Block
languagebash
themeEmacs
cd ${ACME_DIR}/models/lnd/clm/tools/clm4_5/mksurfdata_map
./mksurfdata.pl -res usrspec -usr_gname ne120np4 -usr_gdate 150214 -y 1850 -d \
-dinlc /project/projectdirs/ccsm1/inputdata \
-usr_mapdir {CSMDATA}/lnd/clm2/mappingdata/maps/ne120np4

5.4 Create the surface dataset via interactive or batch job
Code Block
languagebash
themeEmacs
> cat surfdata_ne120np4_simyr1850.pbs
#PBS -A acme
#PBS -q regular
#PBS -l mppwidth=960
#PBS -l walltime=04:00:00
#PBS -N surfdata_ne120np4_simyr1850
#PBS -j oe 
#PBS -m abe
#PBS -M gbisht@lbl.gov
module load nco/4.3.8
module load ncl/6.1.1
cd /scratch2/scratchdirs/gbisht/Projects/ACME/repos/ACME/models/lnd/clm/tools/clm4_5/mksurfdata_map
aprun -n 1 ./mksurfdata_map < namelist