ESMF and the future of end-to-end modeling

1. ESMF and the future of end-to-end modeling Sylvia Murphy National Center for Atmospheric Research murphys@ucar.edu

2. Outline What is ESMF What is Curator Towards an Earth System Modeling Infrastructure ESMF and the advent of self-describing models Metadata lifecycle Curator and ESG support to a NCAR summer 2008 colloquium on atmospheric dynamical cores Demonstration: How to search for dynamical cores How to look at models, simulations, and experiments How to create a comparison table

3. What is ESMF? The Earth System Modeling Framework (ESMF) wrapsmodel components with standard calling interfaces, andprovides tools for coupling them together. • The components can be reused in different contexts and shared by multiple research and operational centers. • ESMF also provides toolkits for common modeling functions, so modelers don’t need to develop those utilities independently.

4. Features and News ESMF v3.1.1 beta release includes unstructured mesh class observational data streams on-line parallel regridding standard metadata packets Many (current count: 76) ESMF science components in diverse domains Consortium of U.S. operational and research centers (NOAA, NASA, DoD) is implementing next generation U.S. weather prediction system as a multi-model global ensemble of ESMF components • ESMF parallel regrid: • Grid-Grid, Grid-Mesh, Mesh-Mesh • Bilinear and higher order The Flow-Following Finite Volume Icosahedral Model (FIM) from NOAA GSD is converting to ESMF to couple to National Weather Service models NUOPC National Unified Operational Prediction Capability

5. Performance Portability 30+ platform/compiler combinations regression tested nightly, new ports include gfortran (4.3) and Solaris Performance at the petascale… The chart at right shows scaling of the ESMF sparse matrix multiply, used in regridding transformations, out to 16K processors. (ESMF v3.1.0rp2) ASMM Run-Time Comparison msec Plot from Peggy Li, NASA/JPL. Tested on ORNL XT4 in a variety of configurations . -N1 means 1 core per node.

6. Curator Has built a prototype web portal that links model components and data together via metadata. The portal: enables model components, models, simulations, experiments, and data to be searched and browsed (using ESG faceted search) provides new tools to support model and component inter-comparison projects implements dataset “trackback” - connecting datasets with detailed information about the models used to create the data Models Datasets Models

7. Earth System Modeling Infrastructure Other tools Metadata ESMF data structures and standardized interfaces XML Interoperability Database Workflow Web services Search/Browse System Configuration Tools Compare Download

8. ESMF XML Output (example) <model_component name="Finite Volume Dynamical Core"> <discipline_set> <discipline name="Atmosphere" /> </discipline_set> <physical_domain_set> <physical_domain name=“Earth system" /> </physical_domain_set> <agency_set> <agency name="NASA" /> </agency_set> <institution_set> <institution name="Global Modeling and Assimilation Office (GMAO)" /> </institution_set> ……

9. Metadata Lifecycle Slide from Rocky Dunlap, Georgia Institute of Technology

10. Numerical Techniques for Global Atmospheric Models Colloquium 9 atmospheric dynamical core components Running 22 test cases at up to 5 resolutions Component comparison table Automated upload of simulation data, publishing, and comparison Data search and browse via ESG Gateway

11. Workshop Gateway http://dycore.ucar.edu

12. Table Comparison

13. Table Comparison Details Select model components Select criteria Table generated dynamically Eventually selections can be placed in a user’s saved workspace http://dycore.ucar.edu/query/modelComparison.htm

14. Example Table Results

15. Search Interface

16. Trackback Page

17. Questions? www.esmf.ucar.edu www.earthsystemcurator.org