soo
Uploaded by
12 SLIDES
266 VIEWS
120LIKES

Automating MPI Program Migration for Efficient Computing Environment Utilization

DESCRIPTION

The MPI Program Migration initiative at the University of Virginia focuses on automating the process of preparing computing environments for executing MPI applications across multiple sites. This project addresses the challenges associated with time-consuming manual setups, enabling users to efficiently utilize resources. Key developments include discovering application deployment information, automating the MPI stack configuration, and resolving software-related issues without recompilation. The project aims to enhance the efficiency of migration processes and establish techniques to predict resolution outcomes and address architecture-related challenges in the future.

1 / 12

Download Presentation

Automating MPI Program Migration for Efficient Computing Environment Utilization

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Experiences with MPI Program Migration Karolina Sarnowska-Upton University of Virginia

  2. Preparing Computing Environments to Execute Jobs • Learning to use new computing environments can be time consuming • Especially for MPI applications • Especially when using multiple sites • Automate process to • Free users from manual preparation • Enable more efficient use of resources

  3. What to Automate? • Discovery of application information related to deployment: architecture, MPI type & version, shared object dependencies, C library version • Composing of site-specific instructions for application deployment: set MPI, resolve shared object dependencies, set execution paths

  4. Current Developments • Discovery techniques – for Linux distributions • Resolution techniques • Identify problem • Set MPI stack configuration • Resolve software-related migration issues • Predict resolution success

  5. Environment Test Set *decommissioned

  6. Application Test Set

  7. Characterizing Migration Issues(without recompilation) • Configuration • Software-related • Architecture-related

  8. Results: Testing Discovery Techniques Test Set: NAS Parallel benchmarks across 3 sites • Discovery techniques • Identify MPI stack (100%) • Resolution techniques • Setup MPI Stack in execution environment (100%)

  9. Results: Resolving Software-Related Issues Test Set: NAS Parallel benchmarks across 5 sites • Discovery techniques • Identify software-related execution issues (100%) • Resolution techniques • Resolve* software-related execution issues (68%) • Predict resolution outcome (100%) *without recompilation

  10. Future Application Test Set

  11. Future Work • Create additional techniques that: • Address architecture-related migration issues • Enable recompilation • Evaluate efficiency of techniques for various community codes • Characterize causes of issues and automation limitations

  12. Conclusion “Civilization advances by extending the number of important operations which we can perform without thinking of them. ” Alfred North Whitehead

More Related