Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Idea Short TitleSubmitterTeam MembersIdea Pitch/ Description/ PlanProposed DeliverableSpecial Needs?Notes
Spark-on-rheaJohn HarneyJohn Harney, Ben Mayer, Valentine Anantharaj, Marcia Branstetter, Dan RicciutoOLCF is unveiling "spark-as-a-service" on Rhea. It is an elastic, on-demand type application that submits a batch script to Rhea that creates a spark cluster on the fly, reads data from lustre, performs calculations, and writes the result back to disk. This can be easily embedded into the larger ACME workflow. Not sure if there will be a need for it, but is there an analytics app that can be deployed within this framework?A small-scale, working map-reduce solution/ application that can be embedded into the workflow in some way.OLCF accounts?Note: I'm not sure if this will be useful, but it may be interesting to explore this space within the context of the workflow.
Deep learning as-a-serviceJohn HarneyJohn Harney, Ben Mayer, Valentine Anantharaj, Marcia Branstetter, Dan RicciutoSimilar to the previous entry, OLCF is also trying to unveil "deep learning as a service" on OLCF (specifically Rhea). Deep Learning is a branch of machine learning that utilizes multi-layered neural networks to provide classifications of data products. The most common application in industry is image classification and speech recognition. Perhaps we can find a use case for this as well?A small-scale working deep learning solution/application that can be embedded into the workflow in some way.OLCF accounts?Note: I'm not sure if this will be useful, but it may be interesting to explore this space within the context of the workflow. Also, deep learning is increasingly becoming a very popular ML technique. It may be crucial to get in on the ground floor.