Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 25 Next »

Please take notes from questions and discussions and post in on this page

Session TimeDurationStart - End TimeSession / Confluence PagePlenary RoomBreakOut #1BreakOut #2

Poster Room

Thursday, Jun 9th, 2016
~ 3h 8:00 - 11:05 amCross-Group Speed Dating

Session Chair: Shaocheng Xie 

   
 30 min + 5 min change rooms8:00 - 8:30 am 

A-P: Atmosphere - Performance Groups

W-L: Workflow - Land Groups

O-S: Ocean/Ice - SE/CPL Groups

Posters Take Down
 30 min + 5 min change rooms8:35 - 9:05 am 

A-L: Atmosphere - Land Groups

W-S: Workflow - SE/CPL Groups

O-P: Ocean/Ice - Performance Groups

 
 30 min + 5 min change rooms9:10 - 9:40 am 

A-S: Atmosphere - SE/CPL Groups

W-O: Workflow - Ocean/Ice Groups

L-P: Land - Performance Groups

 
20 min 9:40 - 10:00 amBreak    
 30 min + 5 min change rooms10:00 - 10:30 am 

A-O: Atmosphere - Ocean/Ice Groups

L-S: Land - SE/CPL Groups

P-W: Performance -Workflow Groups

 
 30 min + 5 min change rooms10:35 - 11:05 am 

A-W: Atmosphere - Workflow Groups

L-O: Land - Ocean/Ice Groups

P-S: Performance -SE/CPL Groups

 

 

Workflow Group Notes:

Workflow - Land

  • EDEN - was developed for CESM - exists in ORNL, not worked on currently – need to scope the funding for it, see if it can be worked as a part of workflow
  • LMWG Diagnostic should be accessible through the web browser, Brian Smith left, not all diagnostics were implemented, someone needs to check if the existing diagnoscis 
  • ILAM - bit bucket repo, open source, no license yet, has DOI. Would like to integrate ILAM to Workflow and Classic Viewer
  • Land - need user added new diagnostics and displayed as default for this user – need description of that in the Documentation space 
  • let's have - Documentation - in Workflow space and aggregate all docs for running diagnostics
  • Peter Thornton would like to get the URL for the diagnostics from Workflow group, even if it is not complete to play with what is there.
  • Workflow needs obd data from land group, Land group will point Workflow to the subversion repo that hold the data
  • Land does not have a way to check if the obs are CF compliant, workflow should check, Land will then correct whats needed
  • Charlie Zender -- there is a CF checker called quick_and_dirty_cf_compliance_checker in the PreAndPostProcessingScripts repository (look in utils subdirectory) created by Susannah Burrows and Phil Rasch (pnl.gov).

Workflow - SE/CPL

  • SE/CPL use cdash originally for nightly tests,  was flushing the test after a night, they corrected that , display on the dashboard, works very well, Use Jenkins
  • Workflow is working on pushing test to dashboard and Jenkins
  • SE/CPL - 'create-test' - it is custom, comes with the system, reworked to by parallel to run tests (>600 tests) .
  • Workflow uses 'ctest' and cmake, Andy thinks they will work on that in the summer
  • SE - every test has its own executable ,  Anshu Dubey (Unlicensed)  says 'flashtest' has also dashboad  (reference to the FLASH paper: 

    http://onlinelibrary.wiley.com/doi/10.1002/spe.2220/abstract;jsessionid=5702A8A123ACBCE707C0721C192D9DB2.f04t03?userIsAuthenticated=false&deniedAccessCustomisedMessage= )

  • ACME license discussion - it will be modified BSD, need a discussion on how to license the data as well and restrictions, 
  • Workflow is moving into using Anaconda (python package/container manager) and Docker container for both UV-CDAT and ESGF. SE is looking at Docker. You can run docker using MPI on HPC.

Workflow - Ocean/Ice

  • Ocean wants to use Anaconda/Conda , Milena asks on how to use Classic Viewer
  • UV-CDAT is now build through Anaconda, Ocean analysis package is installable through and sits under Anaconda.
  • Ashish there is Anaconda and Conda, Conda is only for installation
  • Ocean – they do not have the name for the package yet, they will have it as a package in Anaconda
  • Ocean will have their interactive python notebooks that will be in the repo as scripts, they will be then exported and distributed through anaconda
  • Ocean do not have it under repo yet, they are working on it
  • Ocean package will distribute both notebooks and python scripts
  • Workflow asked if Ocean would like to leverage and use classic viewer to display the analysis plots
  • Samuel Fries (Unlicensed) presented a more generic viewer. Todd would like a database on top of every analysis created and run through the viewer, to keep track of the different runs and analysis as a searchable database  ('cinema' through Kitware funded through Oscar very similar) 
  • obs data - they do not have it in repo yet, not a lot of data so far ~ a GB (Ashish - d not use githab for that then)
  • Rob should be able to help to put the obs into the repo
  • publishing Ocean analysis data to ESGF, use triage hub to for publication needs

Workflow - Performance

  • provenance in implemented in CIME, fires up along the run, so even if the job dies you will get something, creates a world read/writable but some things are not, so someone has to clean it up (only works on ORNL but they will clean it up on Luster so it does need to be archived) on NERSC and MIRA it needs to be cleaned up manually users case and run directories
  • Ben parses this data and puts into a database, Mark – can we then delete all other, Pat - this is not sufficient, there is more info there
  • Pat you want stuff I am not collecting and I am collecting stuff you may not need
  • send Pat email on confluence to update documentation on the provenance
  • there are timers, profile timers per component, talk to Noel Keen about it, there are log files per simulated days it is captured in the coupler, profile timers are summaries - one text log file in case directory, only exist if the job finishes. When the jog is running you need to look at the coupler files

 

Atmosphere Group Notes

/wiki/spaces/ATM/pages/71336556

Atmosphere-Land Notes

  • Anthropogenic non-CO2 emissions: Capture the workflow. J-F Lamarque has done this for iESM cases in the past. How do we do this moving forward?

    • Phil R.: irregular grids make this more complicated. Interpolation on the fly supported in the atm code, but not well documented, maybe not always conservative. Could make this more rigorous.

    • Phillip C-S.: Haven't paid enough attention to new scenarios for ACME. Need more attention here. Maintain compatibility with CESM in terms of file formats, etc.

    • Andy Jones: what is happening for CMIP6 to translate the emissions data for new scenarios?
  • Ruby: what is the requirement for LULC?
    • Peter: we need to look at the way LULC datasets are used in transient SP cases.
  • Latent heat of fusion and ice
    • Peter Thornton: land will add this as a task to make sure we know what the land is doing with these fluxes. Compare with atmosphere.
  • clear-sky albedo
    • Phit R. is working on this, will get information to the land group for next step sensitivity testing.
    • Shaocheng Xie: is this a high priority for V1?
  • Isotopes:
    • Bill R.: oxygen isotopes and deuterium are in BeTR and CLM5, are we bringing it into ACME?
    • Peter: Also we have carbon isotopes currently active in 
  • Precip over topography:
    • both riverflow and hgih resolution precip datasets can be useful in evaluating the model precip.

Land-SE

Land needs a way to work with external libraries.   Some will have

Performance Group Notes

/wiki/spaces/PERF/pages/73793546

 

 

 

 

  • No labels