parallel computing n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Parallel Computing PowerPoint Presentation
Download Presentation
Parallel Computing

Loading in 2 Seconds...

play fullscreen
1 / 22

Parallel Computing - PowerPoint PPT Presentation


  • 233 Views
  • Uploaded on

Parallel Computing. Guoliang Chen E-mail : glchen@ustc.edu.cn. Parallel Computing. Parallel Architectures Parallel Algorithms Parallel Programming. Abstract.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Parallel Computing' - finnea


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
parallel computing

Parallel Computing

Guoliang Chen

E-mail : glchen@ustc.edu.cn

parallel computing1
Parallel Computing
  • Parallel Architectures
  • Parallel Algorithms
  • Parallel Programming

国家高性能计算中心(合肥)

abstract
Abstract
  • Generally speaking, parallel computing deals with the parallel computer architectures, parallel algorithms and parallel programming. In this lecture we will discuss briefly them separately. In part I, we will discuss the contemporary parallel computer system architectures and memory access models, parallel system interconnections and parallel system performance evaluation. In part II, we will discuss the parallel computational models, the design methods, techniques and methodology of parallel algorithms, as well as some parallel numerical algorithms. In part III, we will discuss the parallel programming models,shared-memory, message-passing and dataparallel programming, as well as parallel programming environment and tools.

国家高性能计算中心(合肥)

part i parallel computer systems
Part I : Parallel Computer Systems

Hardware Platform for Parallel Computing:

  • System Architectures and Models
  • System Interconnections
  • Performance Evaluation

国家高性能计算中心(合肥)

system architectures and models
System Architectures and Models
  • Parallel Computer System Architectures
    • PVP : Parallel Vector Processors
    • SMP : Symmetric Multiprocessors
    • MPP : Massively Parallel Processors
    • DSM : Distributed Shared Memory
    • COW : Cluster Of Workstations
  • Parallel Computer Memory Access Models
    • UMA : Uniform Memory Access
    • NUMA : Non-Uniform Memory Access
    • COMA : Cache-Only Memory Access
    • NORMA : NO-Remote Memory Access

国家高性能计算中心(合肥)

system interconnections
System Interconnections
  • Network Environments
    • Intra-node Interconnections( Buses , Switches )
    • Inter-node Interconnections( SAN )
    • Inter-system Interconnections( LAN , MAN , WAN )
  • Interconnection Topologies
    • Static-Connection Networks( LA,RC,MC,TC,HC,CCC)
    • Dynamic-Connection Networks (Buses, Crossbar, MIN)
  • Wide-Band Networks
    • FDDI( Fiber Distributed Data Interface )
    • FE/GE( Fast Ethernet / Gigabit Ethernet )
    • ATM( Asynchronous Transfer Mode )
    • SCI( Scalable Coherence Interface )

国家高性能计算中心(合肥)

performance evaluation
Performance Evaluation
  • Speed up of Systems
    • Amdahl’s Law
    • Gustafson’s Law
    • Sun and Ni’s Law
  • Scalability of Systems
    • Iso-efficiency
    • Iso-speed
    • Average Latency
  • Performance of Systems : Benchmarks
    • LINPACK
    • SPEC
    • PARKBENCH
    • NAS etc

国家高性能计算中心(合肥)

part ii parallel algorithms
Part II : Parallel Algorithms

Theoretical Base for Parallel Computing:

  • Computational Models
  • Design Policy
  • Design Techniques
  • Design Methodology
  • Parallel Numerical Algorithms

国家高性能计算中心(合肥)

computational models
Computational Models
  • PRAM : Parallel Random Access Machines
  • APRAM : Asynchronous PRAM
  • BSP : Bulk Synchronous Parallel
  • LogP : Latency , Overhead , Gap , Processors

国家高性能计算中心(合肥)

design policy
Design Policy
  • Parallelizing a Sequential Algorithm
  • Designing a new Parallel Algorithm
  • Borrowing Other Well-known Algorithm

国家高性能计算中心(合肥)

design techniques
Design Techniques
  • Balanced Trees
  • Doubling Technique
  • Partitioning Strategy
  • Divide and Conquer
  • Pipelining

国家高性能计算中心(合肥)

design methodology
Design Methodology
  • PCAM : Partitioning
  • PCAM : Communication
  • PCAM : Agglomeration
  • PCAM : Mapping

国家高性能计算中心(合肥)

parallel numerical algorithms
Parallel Numerical Algorithms
  • Dense Matrix Algorithms
  • Solving Systems of Linear Equations
  • Fast Fourier Transform

国家高性能计算中心(合肥)

part iii parallel programming
Part III : Parallel Programming

Software Support for Parallel Computing:

  • Programming Models
  • Shared-Memory Programming
  • Message-Passing Programming
  • Data-Parallel Programming
  • Programming Environment and Tools

国家高性能计算中心(合肥)

programming models
Programming Models
  • Implicit Model
  • Data-Parallel Model
  • Shared-Memory Model
  • Message-Passing Model

国家高性能计算中心(合肥)

shared memory programming
Shared-Memory Programming
  • ANSI X3H5
  • POSIX Threads( Pthreads )
  • OpenMP
  • Shared-Variable Parallel Code to Compute Pi

国家高性能计算中心(合肥)

message passing programming
Message-Passing Programming
  • MPI : Message-Passing Interface
  • MPI Basics
  • Message-Passing Code to Compute Pi
  • PVM : Parallel Virtual Machine
  • PVM Program to Compute Pi

国家高性能计算中心(合肥)

data parallel programming
Data-Parallel Programming
  • HPF : High-Performance Fortran
  • Gaussian Elimination in HPF

国家高性能计算中心(合肥)

programming environment and tools
Programming Environment and Tools
  • Parallelizing Compiler
    • Two Ways to Parallelize Compiler
    • SIMDizing : Vectoring
    • MIMDizing : Parallelizing
    • Dependency Analysis
  • Performance Analysis
    • Performace Prediction
    • Performace Monitoring
    • Performace Visualization

国家高性能计算中心(合肥)

programming environment and tools1
Programming Environment and Tools
  • Parallel Program Debugging
    • Correct Debugging
    • Performance Debugging
  • Graphical Development Environment for Parallel Programming
    • Graphical Editor and Language
    • Pre-Compilation
    • Mapping
    • Debugging and Monitoring

国家高性能计算中心(合肥)

slide22

Thank you for

your listening !

国家高性能计算中心(合肥)