...

cd <simulations_dir>/<case_name>/case_scripts
# Make any changes necessary to avoid the crash
./case.submit

Before re-submitting:

• Check that the rpointer files all point to the last restart. On very rare occasions, there might be some inconsistency if the model crashed at the end.

• gzip all the *.log files from the faulty segment so that they get moved during the next short-term archiving. To gzip log files from failed jobs, run gzip *.log.<job ID>.*

• Delete core or error files if there are any. MPAS components will sometimes produce a large number of them.

Post-Processing with zppy

...