hpcmp benchmarking update n.
Skip this Video
Loading SlideShow in 5 Seconds..
HPCMP Benchmarking Update PowerPoint Presentation
Download Presentation
HPCMP Benchmarking Update

Loading in 2 Seconds...

play fullscreen
1 / 34

HPCMP Benchmarking Update - PowerPoint PPT Presentation

  • Uploaded on

Department of Defense High Performance Computing Modernization Program. HPCMP Benchmarking Update. Cray Henry April 2008. Outline. Context – HPCMP Initial Motivation from 2003 Process Review Results. DoD HPC Modernization Program. DoD HPC Modernization Program.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'HPCMP Benchmarking Update' - efrem

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
  • Context – HPCMP
  • Initial Motivation from 2003
  • Process Review
  • Results
hpcmp serves a large diverse dod user community
HPCMP Serves a Large, Diverse DoD User Community

519 projects and 4,086 users at approximately 130 sites

Requirements categorized in 10 Computational Technology Areas (CTA)

FY08 non-real-time requirements of 1,108 Habu-equivalents

Computational Fluid Dynamics – 1,572 Users

Computational Electromagnetics & Acoustics – 337 Users

Electronics, Networking, and Systems/C4I – 114 Users

Computational Structural Mechanics – 437 Users

Environmental Quality Modeling & Simulation – 147 Users

Forces Modeling & Simulation – 182 Users

Computational Chemistry, Biology & Materials Science – 408 Users

Climate/Weather/Ocean Modeling & Simulation – 241 Users

Signal/Image Processing – 353 Users

Integrated Modeling & Test Environments – 139 Users

156 users are self characterized as “Other”

benchmarks have real impact
Benchmarks Have REAL Impact
  • In 2003 we started to describe our benchmarking approach
  • Today benchmarks are even more important
2003 benchmark focus
2003 Benchmark Focus
  • Focused on application benchmarks
  • Recognized application benchmarks were not enough
2003 challenge move to synthetic benchmarks
2003 Challenge – Move to Synthetic Benchmarks
  • 5 years later we have made progress, but not enough to fully transition to synthetics
  • Supported over $300M in purchases so far
what has changed since 2003
What Has Changed Since 2003

(TI-08) Introduction of performance modeling and predictions

Primary emphases still on application benchmarks

Performance modeling now used to predict some application performance

Performance predictions and measured benchmark results compared for HPCMP systems used in TI-08 to assess accuracy

(TI-08) Met one on one with vendors to review performance predictions for each vendor’s individual systems

overview of ti xx acquisition process
Overview of TI-XX Acquisition Process

Usability/past performance information on offered systems

Determine requirements, usage, and allocations

Choose application benchmarks, test cases, and weights

Vendors provide measured and projected times on offered systems

Measure benchmark times on DoD standard system

Determine performance for each offered system per application test case

Determine performance for each offered system

Collective acquisition decision

Measure benchmark times on existing DoD systems

Determine performance for each existing system per application test case

Use optimizer to determine price/performance for each offered system and combination of systems

Center facility requirements

Life-cycle costs for offered systems

Vendor pricing

ti 09 application benchmarks
TI-09 Application Benchmarks

AMR – Gas dynamics code

(C++/FORTRAN, MPI, 40,000 SLOC)

AVUS (Cobalt-60) – Turbulent flow CFD code

(Fortran, MPI, 19,000 SLOC)

CTH – Shock physics code

(~43% Fortran/~57% C, MPI, 436,000 SLOC)

GAMESS – Quantum chemistry code

(Fortran, MPI, 330,000 SLOC)

HYCOM – Ocean circulation modeling code

(Fortran, MPI, 31,000 SLOC)

ICEPIC – Particle-in-cell magnetohydrodynamics code

(C, MPI, 60,000 SLOC)

LAMMPS – Molecular dynamics code

(C++, MPI, 45,400 SLOC)

Red = predicted

Black = benchmarked

predicting code performance for ti 08 and ti 09
Predicting Code Performance for TI-08 and TI-09

*The next 12 charts were provided by the Performance Modeling and Characterization Group at the San Diego Supercomputer Center.


One curve per stride pattern

Plateaus correspond to data fitting in cache

Drops correspond to data split between cache levels

MultiMAPS ported to C and will be included in HPC Challenge Benchmarks

Sample MultiMAPS Output

Memory Bandwidth (MB/s)

Working Set Size (8 Byte Words)

MultiMAPS System Profile


4 Core Woodcrest Node

L2 cache being shared

Modeling the Effects of Multicore

differences between predicted and measured benchmark times unsigned
Differences Between Predicted and Measured Benchmark Times (Unsigned)

Note: Average uncertainties of measured benchmark times on loaded HPCMP systems are approximately 5%.



Solving the hard problems . . .




Solving the hard problems . . .




Solving the hard problems . . .




Solving the hard problems . . .




Solving the hard problems . . .




Solving the hard problems . . .


what s next
What’s Next?

More focus on Signature Analysis

Continue to evolve application benchmarks to represent accurately the HPCMP computational workload

Increase profiling and performance modeling to understand application performance better

Use performance predictions to supplement application benchmark measurements and to guide vendors in designing more efficient systems