...
If you are archiving a simulation run on Compy , or LCRC (Chrysalis/Anvil), do all of the following steps. If you are archiving a simulation run on NERSC (Cori), skip to step 4.
...
Code Block |
---|
Log in to Cori
$ cd /global/cfs/cdirs/e3sm/forsyth/<username>/<case_name>
$ ls | wc -l
# Should match the number of files in the other machine's `<simulations_dir>/<case_name>/zstash`
$ ls *.tar | wc -l
# Should be two less than the previous result,
# since `index.db` and the `zstash_create` log are also present.
$ hsi
$ pwd
# Should be /home/<first letter>/<username>
$ ls E3SMv2
# Check what you already have in the directory
# You don't want to accidentally overwrite something a directory already in HPSS.
$ exit
$ cd /global/cfs/cdirs/e3sm/<username>/E3SMv2
$ screen
$ screen -ls # Output should say "Attached"
# https://www2.cisl.ucar.edu/resources/storage-and-file-systems/hpss/managing-files-hsi
# cput will not transfer file if it exists.
$ hsi "cd /home/<first letter>/<username>/E3SMv2/; cput -R <case_name>"
# Control A D to exit screen
# DO NOT CONTROL X / CONTROL C (as for emacs). This will terminate the task running in screen!!!
$ screen -ls # Output should say "Detached"
$ hostname
# If you log in on another login node,
# then you will need to ssh to this one to get back to the screen session.
# Wait for the `hsi` command to finish
# (On Chrysalis, for 165 years of data, this takes ~2 hours)
$ screen -r # Return to screen
# Check output for any errors
$ exit # Terminate screen
$ screen -ls # The screen should no longer be listed
$ hsi
$ ls /home/<first letter>/<username>/E3SMv2/<case_name>
# Should match the number of files in the other machine's `<simulations_dir>/<case_name>/zstash`
$ exit |
...
Code Block |
---|
$ ssh dtn01.nersc.gov $ screen $ screen -ls # Output should say "Attached" $ cd /global/homes/<first letter>/<username> $ ./batch_zstash_check.bash # Control A D to exit screen # DO NOT CONTROL X / CONTROL C (as for emacs). This will terminate the task running in screen!!! $ screen -ls # Output should say "Detached" $ hostname # If you log in on another login node, # then you will need to ssh to this one to get back to the screen session. # Wait for the script to finish # (On Chrysalis, for 165 years of data, this takes ~5 hours) $ screen -r # Return to screen # Check that output ends with `INFO: No failures detected when checking the files.` # as well as listing real`, `user`, `sys` time information $ exit # Terminate screen $ screen -ls # The screen should no longer be listed $ exit # exit data transfer node $ cd /global/cfs/cdirs/e3sm/<username>/E3SMv2/<case_name>/zstash $ tail zstash_check_20211004<stamp>.log # Output should match the output from the screen (without the time information) |
...