Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 6 Next »

When you need to make a new mpas*.part.N file because you changed the number of nodes an MPAS component runs on.  These instructions including adding the file to the repo for others to use.


Step-by-step guide

  1. Download script inputTreeDownload.sh

  2. Run inputTreeDownload.sh to check out just the directory structure of the repository. This takes about 15 minutes.  This is to avoid having to download the entire repository.

  3. See if "metis" or "gpmetis" is available on your platform and add it to your path.
    1. On Cray systems, gpmetis is available after `module load metis`.
    2. On Blues and Anvil, gpmetis is loaded with `soft add +metis-5.0.3`.
    3. On Mira, gpmetis can be loaded with `export PATH=/soft/libraries/alcf/current/xl/METIS/bin/:$PATH`
  4. You'll need to download the files for the grid you want to add a partition for:
  5. Find the base mpas graph file called "mpas-cice.graph.info.151020" or "mpas-o.graph.info.151031".  These files should be in inputdata/ice/mpas-cice and inputdata/ocn/mpas-ocn respectively.
  6. Run the metis command with the last argument being the number of nodes for the partition.
    1. Example:  "gpmetis mpas-cice.graph.info.151010 120"   will generate a *.part.120 file for mpas-cice.
  7. Place the new file in the correct inputdata subdirectory for the model to find it.
  8. svn add and svn commit


Bonus round: Making better load balanced graph files for MPAS-Seaice

MPAS-Seaice is rather poorly load balanced with standard MPAS graph partitions. This is because sea ice only exists in a very limited part of the domain. A script has been written that can generate somewhat better partitions. Each block is split into 3 non-contiguous sections: One for each polar region and a larger one for the equatorial region. For highly desired changes to this script contact Adrian Turner.

  1. Download the MPAS-Tools repo.
  2. Install the mesh conversion tools (MPAS-Tools/grid_gen/mesh_conversion_tools)
  3. Ensure that your python build includes the netCDF4 library (http://unidata.github.io/netcdf4-python/)
  4. The script uses gpmetis so make sure this is installed
  5. Run the sea ice graph generation script (MPAS-Tools/grid_gen/seaice_grid_tools)
    gen_seaice_mesh_partition.py -m mesh_file -c mpas_culler_location -n nProcs
    mesh_file: the full MPAS netcdf grid file that you wish to make graph files for

    mpas_culler_location: location of the compiled MPAS cell culler (MpasCellCuller.x)

    nProcs: Number of processors to generate the graph file for

  • No labels