1 / 10

NASA Experiment Designer and Workflow Tools

NASA Experiment Designer and Workflow Tools. NASA SIVO Code 610.3 Curator Workshop October 19, 2007 Presented By Brice Womack. Background - GEOS-5. Contains many sub-components Generally one or more option for each component. Background - GEOS-5.

nimrod
Download Presentation

NASA Experiment Designer and Workflow Tools

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NASA Experiment Designer and Workflow Tools NASA SIVO Code 610.3 Curator Workshop October 19, 2007 Presented By Brice Womack

  2. Background - GEOS-5 • Contains many sub-components • Generally one or more option for each component

  3. Background - GEOS-5 • GMAO created MAPL to automate routine aspects of ESMF component creation and coupling • Uses MAPL to create components • Import State and associated Fields • Export State and associated Fields • Internal State and associated Fields • Uses MAPL to specify component coupling and data exchange • Uses MAPL to specify the run sequence of components • Does not support concurrent execution mode of ESMF

  4. Prototype Workflow Tool Components • Runs completely within NCCS environment • Borrows workflow tools already in use at ECMWF: • SMS as scheduler • XCDP as view/control GUI • NED (NASA Experiment Designer) replaces PrepIFS • GEOS-5 workflow, based on Larry Takacs’ scripts

  5. Workflow Tool System Flow

  6. NED GUI

  7. NED Features • Experiment search: • Inside experiment configurations • Or the collection of previously run experiments • NED architecture • Client/service model, easily extensible components • Suitable for wide range of workflows • Design experiment templates • Experiment configuration persistence • Save to file or database for any user to recall later • Difference experiments for subtle changes • Version-controlled experiment templates

  8. NED Features - Experiments • Experiments are defined as units of execution with dependencies • Build/compile • Input data retrieval from archive • Model run • To end Date/Time • For x timesteps/hours/days • Ensembles 1-x • Etc • Post Processing - diagnostic generation, visualization, etc • Archival of experiment output data

  9. NED Features - Continued • Experiments are read/written as XML • Each unit of work has a corresponding XML description • New units of work can be added dynamically • Variables defined in a unit of work can be customized • Variable type • Min/Max value • Display method (list, checkbox, etc) • Uses XSLT to allow export of multiple file types including: • CSH, BASH, KSH, etc • ESMF Config/Attribute file • Fortran Namelists

  10. NED Next Steps • Consider Alternative Workflow tools (Enhydra) • Parse MAPL.RC files to integrate model metadata • Auto-Generate MAPL.RC files to specify: • components used in model • coupling of model component • Synchronize NED schemas with Curator/METAFOR

More Related