Versions Compared

Old Version 49

changes.mady.by.user Ryan Forsyth

Saved on

compared with

New Version 50

changes.mady.by.user Ryan Forsyth

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Contact: Ryan Forsyth

Long Term Archiving with zstash

Key steps

  • Run e3sm script:

    • configure

    • fetch code

    • compile

    • short tests

    • start production simulation.

  • Short term archive.

  • Post-processing with zppy.

  • Document simulation on Confluence.

    • Long-term archive with zstash
    Info

    Summary

    • Useful Aliases

      • The aliases provided in this section may be useful.

    • Configuring the Model Run – Run Script

      • The run-script remains mostly the same between runs. Users can change configuration parameters in it though.

    • Running the Model

      • It is recommended to run a few short tests before starting a production simulation.

    • Short Term Archiving

      • To avoid having so many output files in one directory, we can archive output into appropriate subdirectories.

    • Performance Information

      • PACE is used to display performance information from a run.

    • Re-Submitting a Job After a Crash

      • If a job crashes, it is easy to re-submit after making a fix.

    • Post-Processing with zppy

      • zppy is a tool that brings multiple post-processing tools together – with zppy you can easily run E3SM Diags and MPAS-Analysis as well as generate global time series plots.

    • Documenting the Model Run

      • Model runs should be documented on its own Confluence page providing run details and results.

    • Long Term Archiving with zstash

      • zstash can be used to archive results for the long-term.

    Table of Contents

    Useful Aliases

    ...

    Make a bulleted list of links, e.g., for https://web.lcrc.anl.gov/public/e3sm/diagnostic_output/<username>/E3SM/v2/beta/<case_name>/mpas_analysis/ts_0001-0050_climo_0021-0050/, create a bullet “1-50 (time series), 21-50 (climatology)”.

    Long Term Archiving with zstash

    Simulations that are deemed sufficiently valuable should be archived using zstash for long-term preservation.

    ...