1 / 12

Experiences with MPI Program Migration

Experiences with MPI Program Migration. Karolina Sarnowska -Upton University of Virginia. Preparing Computing Environments to Execute Jobs. Learning to use new computing environments can be time consuming Especially for MPI applications Especially when using multiple sites

soo
Download Presentation

Experiences with MPI Program Migration

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Experiences with MPI Program Migration Karolina Sarnowska-Upton University of Virginia

  2. Preparing Computing Environments to Execute Jobs • Learning to use new computing environments can be time consuming • Especially for MPI applications • Especially when using multiple sites • Automate process to • Free users from manual preparation • Enable more efficient use of resources

  3. What to Automate? • Discovery of application information related to deployment: architecture, MPI type & version, shared object dependencies, C library version • Composing of site-specific instructions for application deployment: set MPI, resolve shared object dependencies, set execution paths

  4. Current Developments • Discovery techniques – for Linux distributions • Resolution techniques • Identify problem • Set MPI stack configuration • Resolve software-related migration issues • Predict resolution success

  5. Environment Test Set *decommissioned

  6. Application Test Set

  7. Characterizing Migration Issues(without recompilation) • Configuration • Software-related • Architecture-related

  8. Results: Testing Discovery Techniques Test Set: NAS Parallel benchmarks across 3 sites • Discovery techniques • Identify MPI stack (100%) • Resolution techniques • Setup MPI Stack in execution environment (100%)

  9. Results: Resolving Software-Related Issues Test Set: NAS Parallel benchmarks across 5 sites • Discovery techniques • Identify software-related execution issues (100%) • Resolution techniques • Resolve* software-related execution issues (68%) • Predict resolution outcome (100%) *without recompilation

  10. Future Application Test Set

  11. Future Work • Create additional techniques that: • Address architecture-related migration issues • Enable recompilation • Evaluate efficiency of techniques for various community codes • Characterize causes of issues and automation limitations

  12. Conclusion “Civilization advances by extending the number of important operations which we can perform without thinking of them. ” Alfred North Whitehead

More Related