1 / 32

Program Update

Department of Defense High Performance Computing Modernization Program. Program Update. Presented by Larry Davis, Deputy Director September 2009. Outline. Introduction Program Structure HPC Centers Networking Software Applications Support Resource Management. HPC Modernization Program.

newman
Download Presentation

Program Update

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Department of DefenseHigh Performance Computing Modernization Program Program Update Presented by Larry Davis, Deputy Director September 2009

  2. Outline Solving the hard problems . . . • Introduction • Program Structure • HPC Centers • Networking • Software Applications Support • Resource Management

  3. HPC Modernization Program Solving the hard problems . . .

  4. HPC Modernization Program Goals Solving the hard problems . . .

  5. Program initiation — 1992–1993 HPC Modernization Plan Initial program structure established, S&T Initial HPC capabilities provided HPCMP established as an ACAT1 Program formalization — 1994–1995 Program office established DoD oversight process implemented Program structure and customer base expanded, include T&E Major acquisitions — 1995–1996 Four major shared resource centers Defense Research and Engineering Network (DREN) Programming Environment and Training (PET) contract established Operations focus — 1997–2000 Continuous upgrades at HPC centers Selection of new distributed centers (DCs) DoD Challenge Projects established Major contract awards — 2001–2003 DREN contract awarded HPC Centers contract awards New PET contract awarded Operations focus — 2003–2006 New DHPIs, Institutes and Portfolios selected Capability Applications Project (CAPs) established Minority Undergraduate Education and Research Initiative established Value to the DoD study–Return on Investment (ROI) project Major contracts & expansion — 2007–2009 Next Generation Technical Services (NGTS) contract awarded New DHPIs, Institutes and Portfolios selected Computational Research and Engineering Acquisition Tools and Environments (CREATE) program initiated New PET3 contract awarded New archival storage contract awarded A Quick History Solving the hard problems . . .

  6. DoD HPC Modernization Program Army HPCMP Participation ARL & ERDC DSRCs 1,309 Users/22 Organizations/102 Projects 56 DREN Sites 14 Challenge Projects/2 DHPIs 5 Institutes Navy HPCMP Participation NAVY DSRC 1,031 Users/16 Organizations/198 Projects 38 DREN Sites 12 Challenge Projects/3 DHPIs 1 Institute Air Force HPCMP Participation AFRL & MHPCC DSRCs 1,361 Users/24 Organizations/175 Projects 24 DREN Sites 12 Challenge Projects/5 DHPIs 3 Institutes Defense Agencies Participation DARPA, DTRA, JFCOM, MDA, PA&E & OTE 644 Users/4 Organizations/21 Projects 35 DREN Sites 3 Challenge Projects Other ARSC ADC 68 DREN Sites 1 DHPI Solving the hard problems . . .

  7. DoD Supercomputing Resource Centers (DSRCs)Six Large HPC Centers Solving the hard problems . . .

  8. DoD Supercomputing Resource Centers (DSRCs)FY09 Capability FY09 HPC Systems shown in GREEN FY08 HPC Systems shown in RED FY07 HPC Systems shown in BLUE Older HPC Systems shown in BLACK As of: July 2009 Solving the hard problems . . . Solving the hard problems . . .

  9. TI-09 Installation Status • ARL – Classified SGI Altix ICE 8200 • 6,656 core (169 HABUs) • Final acceptance September 18, 2009 • ARL – Unclassified SGI Altix ICE 8200 • 10,752 core (271 HABUs) • Final acceptance late September 2009 • ERDC – Unclassified SGI Altix ICE 8200 • 15,360 core (385 HABUs) • Final acceptance October 2, 2009 Solving the hard problems . . . • Rackable’s recent purchase of SGI’s assets included all HPCMP contracts • TI-09 systems on track for delivery as scheduled • New SGI remains committed to delivering the new system and maintaining existing system

  10. HPC Installations (TI-01 through 09)Added HPC Capability Trend (DSRCs Only) 2.1 + 30% 1.5 1.7 1.8 2.2 1.6 4.6 1.1 2.1 Solving the hard problems . . .

  11. Performance Increases Come from Both Processor Improvement and Processor Count Implication: Need Software Applications that Scale to 1,000s of Processors Solving the hard problems . . .

  12. Next Generation Technical Services Support (NGTS) Contract Solving the hard problems . . . • HPC Center’s Technical Services Support contract provides 30–50 FTEs per Center • Technical Expertise • Customer Support • System and Network Administration • Application/System Performance Analysis • Expansion Analysis and Integration Services • Operators and Operations Support • Outreach • Acquisition Vehicle for Small Purchases (ODCs)

  13. NGTS (Continued) Solving the hard problems . . . • Attributes of Contract • One five year contract for four DSRCs • Facilitates leveraging innovations and efficiencies across multiple DSRCs • Does not include ARSC and MHPCC with the exception of support for the Consolidated Customer Assistance Center • Cost plus type contract with a fixed award fee pool and no base fee • Awarded to Lockheed Martin Information Systems (LMIS) in March 2008 • $344M contract ceiling

  14. HPCMP Storage Initiative Solving the hard problems . . . Solving the hard problems . . . • Computing power grows annually—so do stored files • Archived data is hard for users to use and manage • Costs: User time, labor, hardware, software and media • Storage Initiative • Objective: Refresh to manage data for next 10 years • Goals: 10-year architecture • Leverage advances in technology • Improve user productivity • Improve reliability & adaptability • Sustain within current storage budget • Funding: Reserved 1/3 of FY09 investment dollars • Challenge:User awareness and behavior changes

  15. HPCMP Data Storage GrowthSingle Copy Data Storage Solving the hard problems . . .

  16. Storage Lifecycle Management (SLM) Solving the hard problems . . . • Three Key Features • Utility Server to provide longer term near-line storage to store data for up to 30 days prior to archiving • Information Lifecycle Management (ILM) system to help user and system to associate important information with data • Establishment of a 10-year contract to facilitate predictable costs (possibly fixed) for data management software • Acquisition • Software • ILM software, archive software and development services • Full and open competition • RFP release in March 2009, award made in August 2009 • Hardware • Execute via NGTS

  17. 10 years HPCMP Storage Initiative Overall Acquisition Strategy Long-term Government Partnership with Industry Storage Software Storage Hardware Generation 1 Storage Hardware Generation 2 Storage Hardware Generation 3 Storage Hardware Generation 4 Hardware Refresh Cycle Solving the hard problems . . .

  18. Storage Target Architecture Remote Disaster Recovery Facility Data Sharing with Other Centers HPC File System A HPC SYSTEM A SLM DR Cache ILM-managed File System Archive Server Center Archive Cache Utility Server Tape HPC SYSTEM B ILM-Driven Long-Term Storage Medium-Term Storage HPC File System B Short-Term Storage Solving the hard problems . . .

  19. User Interface Toolkit – API UIT Making High Performance Computing Easy • Single Desktop Interface to Multiple HPC Systems • Supports Novice to Expert Users • Central Access to HPC Resources • Custom Productivity Clients • Complete Job Stream Management • Fast Large File Transfers • Secure Authentication UIT API Solving the hard problems . . .

  20. Defense Research & Engineering Network (DREN) (pronounced: 'dē-ren) Solving the hard problems . . .

  21. DREN – Two WorldsHPCMP - Buy-In Customers 111 Subscriber sites 68 HPCMP sites Solving the hard problems . . .

  22. Software Applications Support Solving the hard problems . . .

  23. HPC Software Applications Institutes Solving the hard problems . . .

  24. HPC Software Applications Institutes Solving the hard problems . . .

  25. User Productivity Enhancement, Technology Transfer and Training (PET3) Solving the hard problems . . .

  26. PET3 Contract Award Update Solving the hard problems . . . PET3 was awarded to High Performance Technologies Inc. (HPTi) on July 31, 2009 to start September 1, 2009 Award amount ~$147 million over ten years The HPTi team is made up of major HPC groups around the country, including Texas Advanced Computing Center, Pittsburgh Supercomputing Center, San Diego Supercomputer Center, and 18 other partners One major feature is the combination of Computational Environment (CE) and Enabling Technologies (ET) into Advanced Computational Environments (ACE)

  27. Computational Research and Engineering Acquisition Tools and Environments Solving the hard problems . . .

  28. Resource Management Solving the hard problems . . .

  29. Customer Needs, Priorities, and Usage History Drive HPCMP Investments • Detailed requirements information collected annually through web-based requirements survey (includes all projects) • Requirements information refined through in-person interviews and quality checks • Requirements validated by senior S&T and T&E executives in each Service and Agency Solving the hard problems . . .

  30. DoD Challenge Projects Solving the hard problems . . .

  31. Dedicated HPC Project Investments Solving the hard problems . . .

  32. Summary • World-class corporate computing capability established for DoD HPC community • High Performance Computing capabilities being employed to provide substantial contributions to DoD mission capabilities • Successful transition to scalable, parallel computing • Leveraging national, academic and federal activities Solving the hard problems . . .

More Related