1 / 21

NCEP Computing Update for Family of Services

NCEP Computing Update for Family of Services. Michelle Mainelli Deputy Director NCEP Central Operations With input from NCO Staff… 5 August 2014. Current & Future High Performance Computing. Weather & Climate Supercomputing System (WCOSS) Transition in July 2013. Significance

necia
Download Presentation

NCEP Computing Update for Family of Services

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. NCEP Computing Updatefor Family of Services Michelle Mainelli Deputy Director NCEP Central Operations With input from NCO Staff… 5 August 2014

  2. Current & Future High Performance Computing FOS Meeting – NCEP Computing – 5 August 2014

  3. Weather & Climate Supercomputing System (WCOSS)Transition in July 2013 • Significance • Where United States weather forecast process starts for the protection of lives and livelihood • Produces model guidance at global, national, and regional scales • Examples: • Hurricane Forecasts • Aviation / Transportation • Air Quality • Fire Weather Location • Primary • Reston, VA (IBM provided facility) - Tide • Backup • Orlando, FL (IBM provided facility) - Gyre Configuration • Identical Systems (per site) • IBM iDataPlex/Intel Sandy Bridge/Linux • 213 trillion calculations/sec • 10,048 processing cores • 2.59 petabytes of storage • Performance Requirements • Minimum 99.9% Operational Use Time • Minimum 99.0% On-time Product Generation • Minimum 99.0% Development Use Time • Minimum 99.0% System Availability • Failover tested regularly Inputs and Outputs • Processes 3.5 billion observations/day • Produces over 15 million products/day FOS Meeting – NCEP Computing – 5 August 2014

  4. HPC Growth TeraFLOP per operational system Projected 735 Built into the contract are capability and storage increases approximately every 3 years with no increase in funding NOAA modeling plans rely heavily on “built-in” contractual increases 213 73.9 69.7 15.5 14.0 4.4 1.8 1.2 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 FOS Meeting – NCEP Computing – 5 August 2014 WCOSS Phase 1 Bridge

  5. WCOSS Future Capacities Phase 1: 2013 – Now • 628 Compute Nodes (10,048 Cores Intel Sandy Bridge 2.6 Ghz) • 2.59 PB of Disk Storage • 600 TB of Tape Storage Phase 2: Beginning now - 2017 • +1,008 Compute Nodes (24,192 Cores Intel IVYBridge 2.7 Ghz) • +2.034 PB of disk storage * Estimated Peak – Theoretical peak rate of floating point operations, the upper bound FOS Meeting – NCEP Computing – 5 August 2014

  6. System Utilization Production Utilization 59.3% - July 17, 2014 38.2% Production, 21% Parallel down from 77.7% early June 2014 • Current Parallels: • NAM • HRRR • NLDAS • HYSPLIT • White Space: • CPC Hurricane Seasonal Forecasts FOS Meeting – NCEP Computing – 5 August 2014

  7. Development System Utilization unspecified “dev” NAM RAP GFS GEFS GFS FOS Meeting – NCEP Computing – 5 August 2014

  8. NOAA Research & Development Supercomputing FOS Meeting – NCEP Computing – 5 August 2014

  9. Visualization & Dissemination Tools FOS Meeting – NCEP Computing – 5 August 2014

  10. NCEP Migration to AWIPS IIStatus • All NCEP Centers have migrated from AWIPS I to AWIPS II • All Centers using both NAWIPS & AWIPS II • CPC and NCO/SDMs plan to enter FOTE by September • All NCEP Centers migration completed to AWIPS II in FY16 AWIPS N-AWIPS AWIPS II Migrated System FOS Meeting – NCEP Computing – 5 August 2014

  11. AWIPS II National Center Perspective:Data Display • Radar mosaic • Global Satellite data • Re-mapped solar imagery • ASCAT data • Deterministic Model data • Ensemble mean/spread model data • Conventional observations Product Generation FOS Meeting – NCEP Computing – 5 August 2014

  12. Model Analysis & GuidanceWebsite http://mag.ncep.noaa.gov FOS Meeting – NCEP Computing – 5 August 2014

  13. FTPPRD & NOMADS FTPPRD: Access to full GRIB2 model data / no cut-splice-dice NOMADS: Access to Numerical Forecast Guidance data, tailored to user needs Data downloaded via Grib Filter and OpenDAP Methods http://ftpprd.ncep.noaa.gov http://nomads.ncep.noaa.gov FOS Meeting – NCEP Computing – 5 August 2014

  14. NOAA Integrated Dissemination Program • NOAA’s Integrated Dissemination Program (IDP) established to transform organization’s dissemination capabilities from a collection of independent stovepipes to an integrated enterprise-wide dissemination service • Primary IDP dissemination service-oriented dissemination infrastructure at the primary facility as part of NCEP Central Operations in College Park, MD and a backup facility in Boulder, CO • Projects and applications are to be moved into (e.g. NOAA National Operational Model Archive and Distribution System (NOMADS)) or established in overall dissemination service facilities • Implementing a scalable, robust, secure, and commonly shared dissemination infrastructure to support a variety of applications enabling the access and delivery of weather data to internal and external stakeholders FOS Meeting – NCEP Computing – 5 August 2014

  15. NOAA IDP: High Level Application Onboarding FY14 FY15 FY16 FY17 FTPPRD, NOMADS, and MAG are already running operationally FOS Meeting – NCEP Computing – 5 August 2014

  16. Current Monitoring ofIDP Applications runningin College Park FOS Meeting – NCEP Computing – 5 August 2014

  17. Opportunities For Notifications & Future Interactions NCO WEB Site http://www.nco.ncep.noaa.gov/pmb/changes/ Model Evaluation Mailing List Notification of availability of test data for major model upgrades: https://lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.modelevalinfo Weekly Change Memo List of every module, script, or data flow change: https://lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.rfcmemo In response to NOAA’s decision to abandon the establishment of a Cooperation Research and Development Agreement (CRADA), NCO remains committed to meet the needs of our non-Federal sectors. If you would like the opportunity to discuss your data needs with NCO please contact me to arrange a meeting: michelle.m.mainelli@noaa.gov FOS Meeting – NCEP Computing – 5 August 2014

  18. Questions? “From the Sun to the Sea… Where America’s Climate, Weather, Ocean and Space Weather Services Begin” Michelle.M.Mainelli@noaa.gov FOS Meeting – NCEP Computing – 5 August 2014

  19. Conventional Data Received FOS Meeting – NCEP Computing – 5 August 2014

  20. Non-Conventional Data Received FOS Meeting – NCEP Computing – 5 August 2014 20

  21. Non-Conventional Assimilated Data FOS Meeting – NCEP Computing – 5 August 2014 21

More Related