Grid Tookits Globus, Condor, BONIC, Xgrid

1. Young Suk Moon Grid TookitsGlobus, Condor, BONIC, Xgrid

2. Grid Requirements • Resource sharing / coordination • Resource discovery / management • Job managements • Security • Delegation • Monitoring • Communication • Interoperability

3. Needs for Grid Application Developments • Standardized mechanisms • APIs / SDKs for grid protocols

4. Grid Toolkits • Globus Toolkit : grid computing • Condor : cluster computing • Condor-G : grid computing • BONIC : public-resource computing • Xgrid : cluster computing

5. Globus Toolkit • Open-source project • Software toolkit for grid applications • Being developed by the Globus Alliance • www.globus.org

6. Globus Toolkit Requirements • Resource location & allocation • Communications • Unified resource information service • Authentication interface • Process creation • Data access • Reference: from the slide “Globus: A Metacomputing Infrastructure Toolkit.” p.12.

7. Grid Architecture & GlobusFabric Layer • Access to the resources • Computational resources • Storage resources • Network resources • Globus uses existing fabric components • If they do not exist, GT provides the missing components. Grid Protocol Architecture Application Collective Resource Connectivity Fabric

8. Grid Architecture & GlobusConnectivity Layer - 1 • Defines communication & authentication protocols • Transport, routing, naming • Verify users & resources • Globus Toolkit: Grid Security Infrastructure (GSI)‏ • Public-key based • X.509 Grid Protocol Architecture Application Collective Resource Connectivity Fabric

9. Grid Architecture & GlobusConnectivity Layer - 2 • Grid Security Requirements • Single sign on • Delegation • Integration with various local security solutions • User-based trust relationships

10. Grid Architecture & GlobusResource Layer • Resource managements • Information protocols • Management protocols (process creation, data access)‏ • Globus Toolkit • Grid Resource Information Protocol (GRIP)‏ • Grid Resource Access and Management (GRAM)‏ • GridFTP • Lightweight Directory Access Protocol (LDAP)‏ Grid Protocol Architecture Application Collective Resource Connectivity Fabric

11. Grid Architecture & GlobusCollective Layer • Access to “global” resources • Resource discovery • Task scheduling • Monitoring • Authorization • Globus Toolkit: Meta Directory Service • Grid Information Index Services (GIISs)‏ • Grid Resource Registration Protocol (GRRP)‏ Grid Protocol Architecture Application Collective Resource Connectivity Fabric

12. Condor • Cluster computing toolkit • Developed at University of Wisconsin • Runs on various Operating Systems • Provides • Job queuing • Scheduling policy (job allocation, migrations, etc.)‏ • Resource monitoring • Resource management

13. Condor Architecture • A central manager • Detects idle machines • Matches job requirements to available resources • Submit machines • Only submit jobs • Full Install machines • Submit & run jobs Cluster Submit Full Install Central Manager Full Install Submit Full Install

14. Condor - Flocking Cluster A Cluster B Submit Job Run Job

15. Condor-G • Grid computing • Using the Globus Toolkit • Can access a Globus grid

16. Xgrid • A Mac OS X application • Security • Extendability • A plug-in architecture • Ease of use

17. How Xgrid is used • Ad hoc participation • Programs are run at idle computers • Dedicated grid • Computers are dedicated for programs

18. Xgrid Architecture • Agent • Runs a job (dedicated mode, screensaver mode)‏ • Controller • Queues tasks, scheduling, handles failover • Client • Submits jobs to the controller

19. Xgrid Architecture • Plug-ins • For specific functionalities • Networking • BEEP (The Blocks Extensible Exchange Protocol) http://www.beepcore.org/ • Security • Xgrid requires a password • MD5 hash

20. BONIC • Stands for Berkeley Open Infrastructure for Network Computing • Public-resource computing • Also known as peer-to-peer computing • Different from grid computing • Grid: resources are owned by organizations (universities, research labs, etc.)‏ • Public-resource: resources are owned by individuals

21. BONIC - participants • Give “credits” to participants • Need participants to make a more capable system • Meter contributions (computation, storage, network transfer, etc.)‏ • Participants are interested in their rankings

22. BONIC - Examples • SETI@home • Predictor@home • Folding@home • Climateprediction.net • Climate@home • CERN project • Einstein@home • UCB/Intel study of Internet resources

23. BONIC - Features • Components • A master URL, scheduling servers, data servers • Tools (Python scripts, C++ interfaces)‏ • Redundant computing • Detects errors and compute again • Failure / backoff • Congestion control • Local scheduling

24. References • Globus Website: www.globus.org • Presentation Slides, The Globus Project TM, “The Grid and Globus.” Argonne National Laboratory, JSC Information Sciences Institute. users.sdsc.edu/~ludaesch/ECS289F-W05/ECS289F-W05-16-globus.pdf • Presentation Slides, Harhad, F, “Globus: A Metacomputing Infrastructure Toolkit.” International Journal of Supercomputer Applications, 11(2):115-128, 1997. www.cct.lsu.edu/~kosar/csc7700/slides/Lecture05a.pdf • Foster, I., Kesselman, C. and Tuecke, S. “The Anatomy of the Grid: Enabling Scalable Virtual Organizations.” International Journal of High Performance Computing Applications, 15 (3). 200-222. 2001. • Habib, I. “Getting started with condor.” Linux J., 2006(149), 2. Website: http://www.linuxjournal.com/node/9058/print • Condor Website: http://www.cs.wisc.edu/condor/ • Anderson, D.P. “BONIC: a system for public-resource computing and storage.” Grid Computing, Proceedings. Fifth IEEE/ACM International Workshop on, 4-10. 2004. • “Xgrid Guide” Apple Computer, Inc. 1 Infinite Loop, Cupertino, CA 95014. March 17. 2004.