1 / 19

Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell

A Comparative Analysis of Localized Command Line Execution, Remote Execution through Command Line, and Torque Submissions of MATLAB® Scripts for the Charting of CReSIS Flight Path Data. Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell. Nature and Background of the Study.

tanith
Download Presentation

Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. A Comparative Analysis of Localized Command Line Execution, Remote Execution through Command Line, and Torque Submissions of MATLAB® Scripts for the Charting of CReSIS Flight Path Data Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell

  2. Nature and Background of the Study

  3. Abstract The Polar Grid team was tasked with providing the Center for the Remote Sensing of Ice Sheets (CReSIS) with data that would allow signal processing through the CReSIS Synthetic Aperture RADAR Processor (CSARP) to utilize clustered computing resources without the need of MATLAB’s® proprietary Distributed Computing Environment. This research centered on the use of MATLAB® through command line, and scripted distribution through TORQUE high performance computing scheduling. The team used flight path information from the Greenland 2007 field deployment. This data was imported into MATLAB® so that they could be converted from text files into actual MATLAB® script files. With these MEX files, the team was able to create a script within MATLAB® that could plot the flight path data into a graph with the axes of the graph being labeled latitude for the x-axis and longitude for the y-axis. The team took the master script for the creation of the chart and ran jobs through the command line of MATLAB® to Madogo [Elizabeth City State University’s Cluster] and Quarry [Indiana University’s Cluster]. The team was then able to compare execution times from the jobs of Madogo versus Quarry. A second comparison was then tested with TORQUE job submission versus MATLAB® submission to see which performed with greater efficiency. Lastly the average execution times of all three data sets were statistically compared with a 5% significance level to determine if there was a statistically significant difference between the use of command line jobs verses TORQUE submissions.

  4. Background of the Problem • Versatility • Affordability • Better Efficiency Dr. Prasad Gogineni Director of CReSIS Twin Otter Carrying SAR RADAR

  5. Vocabulary • ANOVA • Binary • Cluster • Jobs • Linux • MATLAB • Node • Perl Script • Ssh key • TORQUE

  6. Hypothesis • Multiple hypotheses: • Submission through TORQUE would be quicker • Submission of the scripts through the Quarry’s command line would be the slowest to submit

  7. Methodology

  8. Definition of the Population • Types of Data • CReSIS Datasets • Run times Madogo Quarry

  9. Definition of Population

  10. Research Design • Defined the problem • Analyzed a solution • Performed experiment • Analyzed results

  11. Statistical Methods & Tests used • ANOVA in Excel • Null hypothesis H0 = μ1=μ2 =μ3 or H1 ≠ μ1≠μ2 ≠μ3

  12. Analysis of Data

  13. Visual Representation Data Time in Seconds Job Submission Trial

  14. Summary, Conclusions, and Recommendations

  15. Conclusions based off Statistical Analysis of the Data

  16. Visual Representation Data

  17. Challenges • MATLAB ® complier • Libraries • TORQUE on Madogo • No user shared home directory • No shared ssh keys

  18. Future works • Create standalone applications using MATLAB® • Research why TORQUE submissions were slower • Direct comparisons of the clusters • MATLAB® Distributed Computing Toolkit vs. using TORQUE to access MATLAB® • Test using CSARP-Lite

  19. Acknowledgements • William Blake of the University of Kansas • MathWorks Support Team • Je’aime Powell • Jefferson Davis of Indiana University

More Related