Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Remove Jenkins hackathon since Jayesh had to change his travel plans.

...

Idea Short TitleSubmitterTeam MembersIdea Pitch/Description/PlanProposed DeliverableSpecial Needs?Notes
Spark-on-rheaJohn HarneyJohn Harney, Ben Mayer, Valentine Anantharaj, Marcia Branstetter, Dan RicciutoOLCF is unveiling "spark-as-a-service" on Rhea. It is an elastic, on-demand type application that submits a batch script to Rhea that creates a spark cluster on the fly, reads data from lustre, performs calculations, and writes the result back to disk. This can be easily embedded into the larger ACME workflow. Not sure if there will be a need for it, but is there an analytics app that can be deployed within this framework?A small-scale, working map-reduce solution/ application that can be embedded into the workflow in some way.OLCF accounts?Note: I'm not sure if this will be useful, but it may be interesting to explore this space within the context of the workflow.
Deep learning as-a-serviceJohn HarneyJohn Harney, Ben Mayer, Valentine Anantharaj, Marcia Branstetter, Dan RicciutoSimilar to the previous entry, OLCF is also trying to unveil "deep learning as a service" on OLCF (specifically Rhea). Deep Learning is a branch of machine learning that utilizes multi-layered neural networks to provide classifications of data products. The most common application in industry is image classification and speech recognition. Perhaps we can find a use case for this as well?A small-scale working deep learning solution/application that can be embedded into the workflow in some way.OLCF accounts?Note: I'm not sure if this will be useful, but it may be interesting to explore this space within the context of the workflow. Also, deep learning is increasingly becoming a very popular ML technique. It may be crucial to get in on the ground floor.
Land model point mode/UQ hands onDan RicciutoDan Ricciuto, Khachik Sargsyan, Peter ThorntonDemonstrate python-based workflow for execution of point-mode simulations for ALM, which can be useful for diagnosis and evaluation of new model developments. We will also walk through the steps required to run a model ensemble and sensitivity analysis. We will take suggestions from users about possible new options, and implement these as time allows.Improved workflow scripts and documentation for ALM point model and UQOLCF/NERSC accounts

Interested land modelers are welcome to suggest specific questions that we can target in this breakout.

CIME integrationAndreas Wilke

Robert Jacob, James Foucar, Andreas Wilke, Jason Sarich, Anshu Dubey, Jayesh Krishna

CIME4 is undergoing some changes, e.g. new configuration and scripts, which are improving usability and performance. Those changes have to be integrated and tested within ACME.Creating a beta version of ACME and CIME4  
Jenkins Best PracticesJayesh Krishna, Jim FoucarDiscuss the current Jenkins nightly test setup with the Workflow team and integrate, if needed, any best practices used by the Workflow team to improve the current test setup.Improved Jenkins nightly test scripts and cdash nightly test reporting The workflow group has been using Jenkins for nightly testing of their code (UV CDAT). This hackathon will explore the use of Jenkins/CDash by the Workflow team and incorporate, if needed, it to ACME nightly testing setup.
End-to-end Manual WorkflowValentine Anantharaj

BenjaminM (Unlicensed) and Workflow Team

Hands-on tutorial of the end-to-end manual workflow process, demonstrating job submission, incremental data archive, publishing, diagnostics and analysis using the Classic Viewer.Documentation.OLCF user account

The process would be essentially similar for V1 production runs.

UV-CDAT Documentation SprintSam FriesSamuel Fries (Unlicensed)UV-CDAT's documentation needs some touching up; I'm going to be taking a pass through and cleaning up some of the docstrings to allow for a nice autogenerated API document, and working on getting a better documentation suite for UV-CDAT.Documentation