Living on the edge osg edge services framework
This presentation is the property of its rightful owner.
Sponsored Links
1 / 20

Living on the Edge: OSG Edge Services Framework PowerPoint PPT Presentation


  • 130 Views
  • Uploaded on
  • Presentation posted in: General

Living on the Edge: OSG Edge Services Framework. Kate Keahey Abhishek Rana. Edge Services. Services executing on the edge of the public and private network. ATLAS. CMS. CE. SE. CDF. Guest VO. Site. Compute nodes and Storage nodes. Edge Service Requirements. Configuration Issues

Download Presentation

Living on the Edge: OSG Edge Services Framework

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Living on the edge osg edge services framework

Living on the Edge:OSG Edge Services Framework

Kate Keahey

Abhishek Rana


Edge services

Edge Services

  • Services executing on the edge of the public and private network

ATLAS

CMS

CE

SE

CDF

Guest

VO

Site

Compute nodes

and Storage nodes


Edge service requirements

Edge Service Requirements

  • Configuration Issues

    • The configuration requirements can vary widely per Edge Service per community.

    • We need an easy way to upgrade Edge Services

    • Alternative Edge Services

  • Resource allocation issues

    • Flexibility in dynamically managing resource assignments as load demands fluctuate

    • Fair usage between communities

    • Incentives


Virtual machines

1.1

1.0

0.9

0.8

0.7

0.6

0.5

0.4

0.3

0.2

0.1

0.0

L

X

V

U

L

X

V

U

L

X

V

U

L

X

V

U

SPEC INT2000 (score)

Linux build time (s)

OSDB-OLTP (tup/s)

SPEC WEB99 (score)

Benchmark suite running on Linux (L), Xen (X), VMware Workstation (V), and UML (U)

Virtual Machines

  • Excellent isolation, security, fine-grain forensics…

  • Promising enforcement properties

  • More control to the site & great recoverability

  • Flexible configuration

  • The ability to serialize and migrate

  • Modern implementation are fast


Virtual workspaces

Virtual Workspaces

  • Virtual Workspaces: environments that can be made available dynamically on the Grid

    • Different possible implementations

  • Workspace Service

    • Enables secure deployment and management of a workspace within a trusted computing base

      • Authentication and authorization

      • Deployment configuration

      • Resource allocation enforcement

    • Workspace = deployment meta-data + image

    • More information and technology preview download available at http://workspace.globus.org


Edge service framework

Edge Service Framework

ESF - Phase 1

Edge Service Framework

Staging

Tools

Workspace

Service

Image

Repository

Image

Information


Living on the edge osg edge services framework

ESF - Phase 1

Role=VO Admin

CMS

ESF

CE

SE

Site


Living on the edge osg edge services framework

ESF - Phase 1

Role=VO Admin

CMS

ESF

CE

SE

Site


Living on the edge osg edge services framework

ESF - Phase 1

Role=VO Admin

ESF

CE

SE

Site


Living on the edge osg edge services framework

ESF - Phase 1

Role=VO Admin

ESF

CE

SE

Site


Living on the edge osg edge services framework

ESF - Phase 1

Role=VO Admin

ESF

CMS

CE

SE

Site


Living on the edge osg edge services framework

ESF - Phase 1

Role=VO Admin

ESF

CMS

CE

SE

Site


Living on the edge osg edge services framework

ESF - Phase 1

Role=VO Admin

Remote

Entity

ESF

CMS

CE

SE

Site


Living on the edge osg edge services framework

ESF - Phase 1

Role=VO User

ESF

CMS

CE

SE

Site


Living on the edge osg edge services framework

ESF - Phase 1

Role=VO User

ESF

CMS

CE

SE

Site


Living on the edge osg edge services framework

ESF - Phase 1

Role=VO User

ESF

CMS

CE

SE

Site


Living on the edge osg edge services framework

ESF - Phase 1

Role=VO User

ESF

CMS

CE

SE

Site


Esf project

ESF Project

  • Phase 1 objective: create a proof-of-concept dynamic deployment of Edge Services

  • Progress:

  • Implement and release the Workspace Service

  • Bubbly test: static deployment and test of a real Edge Service on a production site

  • Dynamic deployment of an Edge Service and integration into OSG infrastructure

  • Configuring more testbeds

  • Deploying and testing more Edge Services


Testbed images

Testbed & Images

  • Testbed

    • SDSC (Abhishek)

      • OSG production site, 150+ worker nodes

      • Intel 2.6, 4GB, RAID device, Xen 2.0.7

    • FNAL (Burt)

      • Xeon 3.2, 4GB, RAID device, Xen 2.0.7

    • UC (Rob, Borja)

      • TeraPort, Xen 3

    • ANL, PIOCON coming online

  • Images

    • SDSC: SL3.0.3, FC4, CentOS4.1

    • FNAL: SL3.0.3, SL4, LTS 3, LTS 4

  • Edge Services

    • ATLAS: mysql-gsi db built by the DASH project


Summary

Summary

  • Growing ESF testbed

    • Xen capabilities / ESF requirements

    • Installation woes getting worked out

  • Growing library of images with useful configurations

  • Growing infrastructure

  • www.opensciencegrid.org/esf


  • Login