1 / 11

Successful Installation and Insights from the SAMGrid Workshop at UTA and University of Oklahoma

He-uh-nu Kim from UTA discusses the complexities of SAMGrid installation during the SAR-II meeting. Initially questioning the necessity of various Globus-related packages for effective resource management, Kim reflects on the essential basics for Unix job execution. The presentation outlines the major components of SAMGrid and details the testing of installations on single PCs and small farms. Despite initial challenges, a simple SAM job was executed successfully, and efforts are ongoing to send specific requests to the CSE-farm via SAMGrid.

calder
Download Presentation

Successful Installation and Insights from the SAMGrid Workshop at UTA and University of Oklahoma

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SAMGrid installation status He-uh-nu KIM : UT-Arlington SAR-II meeting Sep 26-27 Univ. of Oklahoma at Norman He-uh-nu KIM, UTA

  2. Started with “What is SAMGrid?” He-uh-nu KIM, UTA

  3. SAMGrid from ordinary users’ point of view At first, I could not stop asking, “Why do we need all those complicated Globus-related packages like GRAM for Resource Management, GSI for security GASS for stderr,stdout transfer, MDS for Monitoring and Condor/Condor-G? Are they really necessary?” He-uh-nu KIM, UTA

  4. Kim> a.out (knows who I am) Kim> “no input, again!” (stderr) Kim> ps –ef or top (status) Kim> “job done” (stdout) Happened to speculate on the meaning of using my local machines. In order to do D0 analysis, what’s needed is that I have to log on to a machine, compile my code, execute the compiled executable, receive any error message, and be able to monitor the jobs using “ps –ef” or top and so on, He-uh-nu KIM, UTA

  5. But I was too accustomed to realize those basic things are actually very crucial to do some significant jobs under Unix, and noticed that it’s not so easy to implement these basics when we are forced to need larger resources than we have. ??? ??? Being able to use remote resources like local resources can mean to have those basics implemented He-uh-nu KIM, UTA

  6. So I started to realize the importance of all those new packages. And then began to learn one by one. (www-d0/computing/grid/) There are 4 major components in SAMGrid • Client Site : can be our laptops • Submission Site : samgrid.fnal.gov • Execution : a single pc(heppc32) then cse-farm • Monitoring Site : He-uh-nu KIM, UTA

  7. Client Personal certificate User script+JDF Condor-G schedd Grid Manager = GRAM client Browser Apache+CGI Broker Cluster-OU Site – D0SAR Advertise GSI Host-cert Sam-ser-cert Gatekeeper Cluster-UTA Job Mgr-sam DB MDS slapd SAM stations GGK Project.sh Batch System SBA Tomcat SAM stations Worker Node 2 Of BS Consumer.sh Worker Node 1 Of BS Worker Node He-uh-nu KIM, UTA User script

  8. Test installation on a single PC • Started with a testbed ; heppc32.uta.edu • UPD/UPS, SAM, Condor, Pesonal Certificates • SBA + Condor • Tomcat+Servlet(Xindice) : heppc32.uta.edu:7080 • Globus-Gatekeeper • Advertising confirmed with samgrid.fnal.gov • MDS set-up ; LDAP daemon running • Sent a simple SAM-job ; Job-monitorring done • Resource monitoring : Many sites vs One site He-uh-nu KIM, UTA

  9. Test installation on a CSE-FARM • UPD/UPS, SAM, Condor were all there • SBA + Condor • Globus-Gatekeeper(v2.2) : fresh one(v2.0) set up with different port(2119 normal) • Other features, XMLDB,ADV,MDS easily done. • We wanted to send McFarm-specific request. • Had no clear idea how to this; how McFarm will interact with SAM, Condor etc. • Now got an idea ; MF-running command can be included in the “user-script” which will eventually be run by “consumer-script” • Now working on “configuration” to achieve that. He-uh-nu KIM, UTA

  10. Client Personal certificate User script+JDF Condor-G schedd Grid Manager = GRAM client Browser Apache+CGI Broker Cluster-OU Site – D0SAR Advertise GSI Host-cert Sam-ser-cert Gatekeeper Cluster-UTA Job Mgr-sam DB MDS slapd SAM stations GGK Project.sh Batch System SBA Tomcat SAM stations Consumer.sh User script Worker Node 2 Of MF Worker Node 1 Of MF Worker Node He-uh-nu KIM, UTA

  11. Summary and Conclusion SAMGrid installation on a single host and small-sized farm was successful. Simple SAM job has been sent to heppc32 Now struggling to send McFarm request to CSE-farm via SAMGrid. I hope this can be done very soon. Many thanks to Gabriele, Igor, Parag! He-uh-nu KIM, UTA

More Related