...
grep -v HEAD headset_list_first_last > archive_dataset_map_prelim
STEP 3: Then run
~/bartoletti1/outbox/archive_path_mapper_stage3.sh > update_Archive_Map
You can test the correctness of the “update_Archive_Map” by invoking
~/bartoletti1/outbox/extract_archive_files_to.sh file_with_update_archive_map_line > file_list
For each line of the “update_Archive_Map” a file-list can be produced and manually examined to ensure that only the intended files are being addressed.
Once you are satisfied that update lines are correct, issue these commands to “install” the updated Archive_Map:
cat /p/user_pub/e3sm/archive/.cfg/Archive_Map update_Archive_Map | sort | uniq > temp_Archive_Map
mv temp_Archive_Map /p/user_pub/e3sm/archive/.cfg/Archive_Map
CAVEATE: The above Archive Path-Mapping operations do not ensure that a dataset is necessarily complete or clean. The dataset may still be missing files, or contain hidden restarts with extra and overlapping files. . . (to be continued…)The path-mapping only intends to ensure that all of the files belonging to an intended “finalized run” are identified, for further analysis on coverage and cleanliness. These latter activities are covered by the publication (or pre-publication) “Staging” activities.