1 / 17

Service Computing

Service Computing. Prof. Dr. Ramin Yahyapour IT & Medien Centrum 10. Dezember 2009. Grids - An Introduction. Grid Vision. Simple, transparent access to resources without central control Dynamic coordination and combination of services on demand Easy addition of resources

agatha
Download Presentation

Service Computing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Service Computing Prof. Dr. Ramin YahyapourIT & Medien Centrum10. Dezember 2009

  2. Grids - An Introduction

  3. Grid Vision • Simple, transparent accesstoresourceswithoutcentralcontrol • Dynamiccoordinationandcombinationofservices on demand • Easy addition ofresources • Autonomicmanagementof Grid components • Complexityoftheinfrastructureishiddenfromuserorresourceprovider • Analogy: Power-Grid (see Intro) • Application of vision to “e-Science” • Support of “Virtual Organizations”

  4. One View of Requirements • Adaptation • Intrusion detection • Resource management • Accounting & payment • Fault management • System evolution • and many more … • Identity & authentication • Authorization & policy • Resource discovery • Resource characterization • Resource allocation • (Co-)reservation, workflow • Distributed algorithms • Remote data access • High-speed data transfer • Performance guarantees • Monitoring

  5. Application Application Internet Protocol Architecture Transport Internet Link Layered Grid Architecture(by Analogy to Internet Architecture) “Coordinating multiple resources”: ubiquitous infrastructure services, app.-specific distributed services Collective “Sharing single resources”: negotiating access, controlling use Resource “Talking to things”: communication (Internet protocols) & security Connectivity “Controlling things locally”: Access to & control of resources Fabric

  6. The Hourglass Model Applications • Focus on architecture issues • Propose set of core services as basic infrastructure • Use to construct high-level, domain-specific solutions • Design principles • Keep participation cost low • Enable local control • Support for adaptation • “IP hourglass” model Diverse global services Core services Local OS

  7. Where are we with Architecture? • No “official” standards exist • But • Globus Toolkit™ has emerged as the de facto standard for several important Connectivity, Resource, and Collective protocols • OGF has an architecture working group (OGSA) • Technical specifications are being developed for architecture elements: e.g., security, data, resource management, information • Internet drafts submitted in security area

  8. Fabric Layer: Protocol & Services • Just what you would expect: the diverse mix of resources that may be shared • Individual computers, Condor pools, file systems, archives, metadata catalogs, networks, sensors, etc. • Few constraints on low-level technology: connectivity and resource level protocols form the “neck in the hourglass” • Defined by interfaces not physical characteristics Condor: www.cs.wisc.edu/condor

  9. Connectivity Layer: Protocol & Services • Communication • Internet protocols: IP, DNS, routing, etc. • Security: Grid Security Infrastructure (GSI) • Uniform authentication, authorization, and message protection mechanisms in multi-institutional setting • Single sign-on, delegation, identity mapping • Public key technology, SSL, X.509, GSS-API • Supporting infrastructure: Certificate Authorities, certificate & key management, … GSI: www.globus.org/security/overview.html

  10. Resource Layer: Protocol & Services • Grid Resource Allocation Management (GRAM) • Remote allocation, reservation, monitoring, control of compute resources • GridFTP protocol (FTP extensions) • High-performance data access & transport • Grid Resource Information Service (GRIS) • Access to structure & state information • Others emerging: Catalog access, code repository access, accounting, etc. • All built on connectivity layer: GSI & IP GRAM, GridFTP, GRIS: www.globus.org

  11. Collective Layer: Protocol & Services • Index servers aka metadirectory services • Custom views on dynamic resource collections assembled by a community • Resource brokers • Resource discovery and allocation • Replica catalogs • Replication services • Co-reservation and co-allocation services • Workflow management services • etc.

  12. API SDK C-point Protocol Checkpoint Repository API SDK Access Protocol Compute Resource Example: High-Throughput Computing App High Throughput Computing System Collective (App) Dynamic checkpoint, job management, failover, staging Collective (Generic) Brokering, certificate authorities Access to data, access to computers, access to network performance data Resource Communication, service discovery (DNS), authentication, authorization, delegation Connect Fabric Storage systems, schedulers

  13. Example: Data Grid Architecture App Discipline-Specific Data Grid Application Collective (App) Coherency control, replica selection, task management, virtual data catalog, virtual data code catalog, … Collective (Generic) Replica catalog, replica management, co-allocation, certificate authorities, metadata catalogs, … Access to data, access to computers, access to network performance data, … Resource Communication, service discovery (DNS), authentication, authorization, delegation Connect Storage systems, clusters, networks, network caches, … Fabric

  14. An Example Grid Middleware- The Globus Toolkit

  15. Globus Toolkit™ • A software toolkit addressing key technical problems in the development of Grid enabled tools, services, and applications • Offer a modular “bag of technologies” • Enable incremental development of Grid-enabled tools and applications • Implement standard Grid protocols and APIs (the “core” of the hourglass) • Is available under liberal open source license Globus: www.globus.org

  16. General Approach • Define Grid protocols & APIs • Protocol-mediated access to remote resources • Integrate and extend existing standards • “On the Grid” = speak “intergrid” protocols • Develop a reference implementation • Open source Globus Toolkit • Client and server SDKs, services, tools, etc. • Grid-enable wide variety of tools • Globus Toolkit, FTP, SSH, Condor, SRB, MPI, … • Integrate user experience gathered through deployment and application integration

  17. Key Protocols • The Globus Toolkit™ centers around four key protocols • Connectivity layer: • Security: Grid Security Infrastructure (GSI) • Resource layer: • Resource Management: Grid Resource Allocation Management (GRAM) • Information Services: Grid Resource Information Protocol (GRIP) • Data Transfer: Grid File Transfer Protocol (GridFTP) • Other important collective layer protocols • Information services, replica management, etc.

More Related