1 / 18

Paul Watson & Chris Fowler School of Computing Science University of Newcastle - PowerPoint PPT Presentation

  • Uploaded on

Dynasoar Dynamic Deployment of Web Services on a Grid or the Internet or Why it’s good to be Jobless. Paul Watson & Chris Fowler School of Computing Science University of Newcastle.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about ' Paul Watson & Chris Fowler School of Computing Science University of Newcastle' - irma-nieves

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

DynasoarDynamic Deployment of Web Services on a Grid or the InternetorWhy it’s good to be Jobless

Paul Watson & Chris Fowler

School of Computing Science

University of Newcastle

The Dynasoar team: Chris Fowler, Paul Watson, Charles Kubicek, Arijit Mukherjee, John Colquhoun, Savas Parastatidis, Mark Hewitt

The GridShed team: Isi Mitrani, Jennie Palmer, Rob Smith, Paul McKee (BT) & Mike Fisher (BT)

Why jobs services
Why Jobs & Services?

  • Grid applications are being built from Web Services

  • If the computational requirements can’t be met by the service hosting environment then a job must be created

  • Do we need both jobs and services?

  • Dynasoar

    • a service-only approach to building grid applications

    • an infrastructure for the dynamic deployment of web services

Dynasoar components
Dynasoar Components

  • Web Service Provider (WSP)

    • exposes service endpoints

    • accepts the incoming SOAP message sent to the endpoint

    • chooses a Host Provider and passes the message to it

    • holds a copy of service code

  • Host Provider (HP)

    • manages computational resources (e.g. a cluster or a grid)

    • accepts the message from the WSP

    • dynamically deploys the service if necessary

    • processes the message and returns any response


Routing to an existing service deployment
Routing to an Existing Service Deployment

A request for s2 is routed to an existing

deployment of the service

Dynamic service deployment
Dynamic service deployment

A request to s4 cannot be met by an existing deployment of the service


The deployed service remains in place and

can be re-used

- unlike job scheduling

Dynasoar advantages
Dynasoar Advantages

  • Simplicity: just services

  • Efficiency: a deployed service can process many messages

    • important if cost of deployment is high… e.g. VMs

  • Support a range of new e-science/ e-business models:

    • defining the interactions between the major components allows them to be distributed in a variety of ways

Dynamic outsourcing
Dynamic Outsourcing

  • Biocorp are experts in writing bioinformatics services

  • They don’t want to manage their own compute resources

  • Therefore, they use Hosting Inc to process messages sent to their services

  • In e-science, BioCorp could be a research group writing specialist e-science services, and Hosting Inc the NGS

The national grid service as a host provider
The National Grid Service as a Host Provider

  • A researcher writes their own services but does not have sufficient local compute resources

  • They deploy a local WSP, and configure it so that it sends messages to the National Grid Service

    • their services are then transparently deployed on the NGS as required

A marketplace for e science
A Marketplace for e-Science







Moving computation to data
Moving Computation to Data

  • In many e-science applications analysis services operate on data extracted from a data store (e.g. OGSA-DAI, SRB…)

    • often large amounts of data are transferred

    • this may severely limit the performance

Moving computation to data1
Moving Computation to Data

  • The data owner provides compute resources close to a database

  • Researchers can write services and deploy them on their own WSP

  • The service is dynamically deployed close to the database when requests are sent to the WSP

Tripartite security model
Tripartite Security Model

The 3 actors can define policies (XACML) that Dynasoar enforces at run-time, e.g….

WSP: only use Host Providers

trusted to not re-use the

deployed service without payment

HP: accept only messages

from WSPs trusted to not

send malicious code

C: only send the message to a HP trusted

not to look at the contents

Current implementation
Current Implementation

GridShed Cluster


New host provider architecture
New Host Provider Architecture

  • Layer as high-level infrastructure over lower level grid fabric

  • Use OMII Job Submission and Monitoring Service to provide stable interface to different underlying fabrics

    • Newcastle Grid (Condor), National Grid Service, local clusters,….

Current work
Current Work

  • Deploying Services in Virtual Machines

    • can encapsulate a complex service implementation environment

  • Use of QoS to enhance decisions on where to deploy a service

  • Dynamic database deployment

    • ogsa-dai, ogsa-dqp


  • Grid applications can be built entirely from services

    • jobless grid computing

    • simpler conceptual model

    • performance improvements due to sharing the cost of service deployment over multiple requests

  • Dynasoar is built as a high-level infrastructure on top of existing grid fabrics

  • Separating the Web Service Provider from the Host Provider – with a well-defined interface – opens up a range of e-science/ e-business models

  • Demo available at the North East Regional e-Science Centre stand