1 / 14

Parallel Architectures

Parallel Architectures. MIMD Machines. CMSC 415: Computer Architecture Marist College Spring 2001. Crystal VanDeMark Matthew Cousens.

nitsa
Download Presentation

Parallel Architectures

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Parallel Architectures MIMD Machines

  2. CMSC 415: Computer Architecture Marist College Spring 2001 Crystal VanDeMark Matthew Cousens

  3. From the beginning of time, computer scientists have been challenging computers with larger and larger problems. Eventually, computer processors were combined together in parallel to work on the same task together. This is parallel processing. Types Of Parallel Processing SISD – Single Instruction stream, Single Data stream MISD – Multiple Instruction stream, Single Data stream SIMD – Single Instruction stream, Multiple Data stream MIMD – Multiple Instruction stream, Multiple Data stream

  4. CPU Data Multiply SISD One piece of data is sent to one processor. Ex: To multiply one hundred numbers by the number three, each number would be sent and calculated until all one hundred results were calculated.

  5. MISD One piece of data is broken up and sent to many processor. CPU Data CPU Search CPU CPU Ex: A database is broken up into sections of records and sent to several different processor, each of which searches the section for a specific key.

  6. Data CPU Data CPU Multiply Data CPU Data CPU SIMD Multiple processors execute the same instruction of separate data. Ex: A SIMD machine with 100 processors could multiply 100 numbers, each by the number three, at the same time.

  7. MIMD Multiple processors execute different instruction of separate data. Data CPU Multiply Data CPU Search Data CPU Add Data CPU Subtract This is the most complex form of parallel processing. It is used on complex simulations like modeling the growth of cities.

  8. The Granddaddy of Parallel Processing MIMD

  9. MIMD computers usually have a different program running on every processor. This makes for a very complex programming environment. What’s doing what when? What processor? Doing which task? At what time?

  10. Memory latency The time between issuing a memory fetch and receiving the response. Simply put, if execution proceeds before the memory request responds, unexpected results will occur. What values are being used? Not the ones requested!

  11. A similar problem can occur with instruction executions themselves. Synchronization The need to enforce the ordering of instruction executions according to their data dependencies. Instruction b must occur before instruction a.

  12. Despite potential problems, MIMD can prove larger than life. MIMD Successes IBM Deep Blue – Computer beats professional chess player. Some may not consider this to be a fair example, because Deep Blue was built to beat Kasparov alone. It “knew” his play style so it could counter is projected moves. Still, Deep Blue’s win marked a major victory for computing.

  13. IBM’s latest, a supercomputer that models nuclear explosions. IBM Poughkeepsie built the world’s fastest supercomputer for the U. S. Department of Energy. It’s job was to model nuclear explosions.

  14. MIMD – it’s the most complex, fastest, flexible parallel paradigm. It’s beat a world class chess player at his own game. It models things that few people understand. It is parallel processing at its finest.

More Related