1 / 8

ESMF Development Status and Plans

ESMF Development Status and Plans. ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005. Climate. Data Assimilation. Weather. Outline. Where we are now Where we are going Challenges. ESMF Development Status. Overall, component-based architecture is well-defined

agowdy
Download Presentation

ESMF Development Status and Plans

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ESMF Development Status and Plans ESMF 4th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

  2. Outline • Where we are now • Where we are going • Challenges

  3. ESMF Development Status • Overall, component-based architecture is well-defined • Serial or parallel execution (mpiuni stub library) • Concurrent or sequential execution, single executable • Logically rectangular grids with regular and arbitrary distributions can be represented and regular distributions can be regridded • On-line parallel regridding (bilinear, 1st order conservative) implemented and optimized • Other parallel methods - e.g. halo, redistribution, low-level comms implemented • Utilities such as time manager, logging, and configuration manager usable and adding features • Virtual machine with hooks for load balancing implemented • Fortran interfaces and complete documentation, some C++ interfaces

  4. Growing ESMF Customer Base • New applications coming in during FY05 through the newly funded, ESMF-based DoD Battlespace Environments Institute (BEI): DoD Navy HYCOM oceanDoD Navy NOGAPS atmosphereDoD Navy COAMPS coupled atm-ocean DoD Air Force GAIM ionosphereDoD Air Force HAF solar windDoD Army ERDC WASH123 watershed • More new applications will begin adopting ESMF during FY06 through the ESMF-based NASA Modeling Analysis and Prediction (MAP) Climate Variability and Change program. • Further growth of the customer base is anticipated through partnership with space weather computational environments. • Original ESMF applications:NOAA GFDL atmospheresNOAA GFDL MOM4 oceanNOAA NCEP atmospheres, analysesNASA GMAO models and GEOS-5NASA/COLA Poseidon oceanLANL POP oceanNCAR WRFNCAR CCSMMITgcm atmosphere and ocean • Other groups adopting ESMF: NASA GISSUCLACSU NASA Land Information Systems (LIS) projectNOAA Integrated Dynamics in Earth’s Atmosphere (IDEA) project, more…

  5. Supported Platforms and theESMF Test Suite • IBM AIX (32 and 64 bit addressing) • SGI IRIX64 (32 and 64 bit addressing) • Compaq OSF1 (64 bit addressing) • Linux Intel (32 and 64 bit addressing, with mpich and lam) • Linux PGI (32 bit addressing, with mpich) • Linux NAG (32 bit addressing, with mpich) • Linux Absoft (32 bit addressing, with mpich) • Linux Lahey (32 bit addressing, with mpich) • Mac XLF (32 bit addressing, with lam) • Mac Absoft (32 bit addressing, with lam) • SGI Altix (64 bit addressing) • Cray X1 (64 bit addressing) The ESMF Test Suite consists of ~1500 unit tests, ~17 system tests, ~40 examples. The Suite is run nightly on the platforms above. The ESMF Test Suite is bundled with the ESMF source code so that users can run it themselves for verification, debugging, and porting.

  6. Planned ESMF Extensions • Support for representing, partitioning, communicating with, and regridding data based on general curvilinear coordinates and unstructured grids • Advanced support for data assimilation systems, including data structures for observational data and adjoints for ESMF methods • Looser couplings: support for multiple executable and Grid-enabled versions of ESMF • I/O including asynchronous I/O • Support for nested, moving grids and adaptive grids • Support for regridding in three dimensions and between different coordinate systems • Advanced optimization and load balancing

  7. Current Development Challenges • Refocus of core team on grid development, production quality and performance, increased customer support – new balance of tasks, new hires • Rework mid-level data structures for more advanced decompositions and grids – ensure the framework is usable for real, complex applications • Integrate mid-level data structures with advanced low level communications (threading, chunking, load balancing) • Create a mid-level array class that offers a set of commonly used index space communications • Increase generality of the decomposition and grid representation • Add options such as masking to grids and arrays • Increase grid and regrid extensibility (read/write grids, read/write interpolation weights, interface for user registration of new grids and their methods) • Many new requirements • New tool for tracking requirements (DOORS) • New mechanism for prioritizing design and implementation tasks (CRB)

  8. This Time Next Year… • Representation, regridding, communication methods for grids with general curvilinear coordinates • Representation, regridding, communication methods for unstructured grids and location streams • Read/write interpolation weights and read/write grid specifications • Robust netCDF-based IO capability • Fully-featured utilities (config attributes, logging, Tau timers)

More Related