1 / 10

Building a HPC Grid for AMS

Building a HPC Grid for AMS. DC2/AMS5/WRF. Chuck Kleinschmidt Fleet Numerical Meteorology and Oceanography Center. What is Grid Computing.

abedi
Download Presentation

Building a HPC Grid for AMS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Building a HPC Grid for AMS DC2/AMS5/WRF Chuck Kleinschmidt Fleet Numerical Meteorology and Oceanography Center

  2. What is Grid Computing Grid computing is a hardware and software infrastructure that clusters and integrates high-end computers, networks, databases and scientific instruments from multiple sources to form a virtual supercomputer on which users can work collaboratively. from DEC 23, 2002 (COMPUTERWORLD) • For this project: • Optimized job scheduling and execution • On geographically dispersed HPC nodes • Linked though a reliable, high bandwidth network • “The weather problem is an instantiation of a general class of grid computing problems.”

  3. The benefit to the nation (the right thing to do) The economic flexibility to stay competitive The technical challenge The HPCMPO Distributed Center II Award Provided funds to test Operational WRF Grid “The Google Way” Chad Dickerson, Infoworld 02.23.04 Work on things that matter Affect everyone in the world Why Do It

  4. Deliver the highest quality weather forecasts, in the most timely manner, maximizing all the available resources in the service of national interests, domestic and abroad The Benefit to Nation

  5. Mapping our HPC processes onto the Grid: increases our flexibility and responsiveness to the computational demands in support of new functional/customer requirements establishes operational readiness to exploit “utility” and “on-demand” computing options changes economics from large capital investment costs for hardware to “utility” or “on-demand” expenses Staying Economically Competitive

  6. Every one talks about the “grid” but few practical instances of operationally and computationally demanding applications Numerical weather prediction is one of the most operationally demanding “supercomputing” applications FNMOC excels in mapping operational processes onto new infrastructures Challenges: QOS, portability of jobs and data, security “We can make it happen, can make it real. Numerical Weather Prediction is the whetstone upon which grid theory can be engineered into practice.” The Technical Challenge

  7. Network Connection Speeds Data transfer latencies are not the constraint • References: • http://whatis.techtarget.com/definition/0,,sid9_gci214198,00.html • Speed for OC connections assumes 90% bandwidth usage. • Ethernet Connections assumes 80% effective transfer rate, because of the properties of Ethernet.

  8. Project Mission and Vision Build the grid infrastructure for a national Operational Weather Forecast Grid (NOWFoG) But first, Create a support environment in which to learn, test, and evaluate grid computing concepts, techniques, and practices Demonstrate that an operational HPC grid can feasibly support weather forecast operations [this is a leading role for DREN] “The HPC Grid is all about the network and what DREN enables us to do.”

  9. The Dream - NOWFoG NCEP Backup NCEP AFWA FNMOC Phase II – DC2 Phase I – Remote EFS Other MSRCs DOD Federal NAVO-MSRC

  10. Science Run more model instances at greater resolution, complexity, and more perturbations Technology (the convergence of interest for HPCMO) Increase overall utilization of systems Share resources between sites, agencies Increase reliability, resilience Reduce incoming and outgoing data redundancy, latency Decrease man hours required for overhead and monitoring Enable heterogeneous computing Expected Outcomes

More Related