Building a HPC Grid for AMS
1 / 10

- PowerPoint PPT Presentation

  • Updated On :

Building a HPC Grid for AMS. DC2/AMS5/WRF. Chuck Kleinschmidt Fleet Numerical Meteorology and Oceanography Center. What is Grid Computing.

Related searches for

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about '' - abedi

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

Building a HPC Grid for AMS


Chuck Kleinschmidt

Fleet Numerical Meteorology and Oceanography Center

What is Grid Computing

Grid computing is a hardware and software infrastructure that clusters and integrates high-end computers, networks, databases and scientific instruments from multiple sources to form a virtual supercomputer on which users can work collaboratively. from DEC 23, 2002 (COMPUTERWORLD)

  • For this project:

    • Optimized job scheduling and execution

    • On geographically dispersed HPC nodes

    • Linked though a reliable, high bandwidth network

  • “The weather problem is an instantiation of a general class of grid computing problems.”

Why do it

The benefit to the nation (the right thing to do)

The economic flexibility to stay competitive

The technical challenge

The HPCMPO Distributed Center II Award

Provided funds to test Operational WRF Grid

“The Google Way” Chad Dickerson, Infoworld 02.23.04

Work on things that matter

Affect everyone in the world

Why Do It

The benefit to nation

Deliver the highest quality weather forecasts, in the most timely manner, maximizing all the available resources in the service of national interests, domestic and abroad

The Benefit to Nation

Staying economically competitive

Mapping our HPC processes onto the Grid: timely manner, maximizing all the available resources in the service of national interests, domestic and abroad

increases our flexibility and responsiveness to the computational demands in support of new functional/customer requirements

establishes operational readiness to exploit “utility” and “on-demand” computing options

changes economics from large capital investment costs for hardware to “utility” or “on-demand” expenses

Staying Economically Competitive

The technical challenge

Every one talks about the “grid” but few practical instances of operationally and computationally demanding applications

Numerical weather prediction is one of the most operationally demanding “supercomputing” applications

FNMOC excels in mapping operational processes onto new infrastructures


QOS, portability of jobs and data, security

“We can make it happen, can make it real. Numerical Weather Prediction is the whetstone upon which grid theory can be engineered into practice.”

The Technical Challenge

Network Connection Speeds instances of operationally

Data transfer latencies are not the constraint

  • References:


  • Speed for OC connections assumes 90% bandwidth usage.

  • Ethernet Connections assumes 80% effective transfer rate, because of the properties of Ethernet.

Project mission and vision
Project Mission and Vision instances of operationally

Build the grid infrastructure for a national Operational Weather Forecast Grid (NOWFoG)

But first,

Create a support environment in which to learn, test, and evaluate grid computing concepts, techniques, and practices

Demonstrate that an operational HPC grid can feasibly support weather forecast operations [this is a leading role for DREN]

“The HPC Grid is all about the network and what DREN enables us to do.”

The dream nowfog
The Dream - NOWFoG instances of operationally

NCEP Backup




Phase II – DC2

Phase I – Remote EFS

Other MSRCs




Science instances of operationally

Run more model instances at greater resolution, complexity, and more perturbations

Technology (the convergence of interest for HPCMO)

Increase overall utilization of systems

Share resources between sites, agencies

Increase reliability, resilience

Reduce incoming and outgoing data redundancy, latency

Decrease man hours required for overhead and monitoring

Enable heterogeneous computing

Expected Outcomes