Grid and web services convergence and the impact on enterprise computing
Download
1 / 31

Grid and Web Services convergence and the impact on enterprise computing - PowerPoint PPT Presentation


  • 247 Views
  • Uploaded on

Grid and Web Services convergence and the impact on enterprise computing. Takanori Seki, Distinguished Engineer Grid Computing Business, IBM Japan. 22-60. Contents. Enterprise Computing History Virtual Organization and Grid Computing Web Services Evolution with SOA

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Grid and Web Services convergence and the impact on enterprise computing' - richard_edik


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Grid and web services convergence and the impact on enterprise computing l.jpg

Grid and Web Services convergence and the impact on enterprise computing

Takanori Seki, Distinguished Engineer

Grid Computing Business, IBM Japan

22-60


Contents l.jpg
Contents enterprise computing

  • Enterprise Computing History

  • Virtual Organization and Grid Computing

  • Web Services Evolution with SOA

  • Grid and Web Services Convergence

  • Adoption and Expansion of Grid Application

  • Summary

© 2004 IBM Corporation


Enterprise computing history l.jpg
Enterprise Computing History enterprise computing

(Blank Page)

© 2004 IBM Corporation


1 st generation enterprise computing l.jpg
1 enterprise computingst Generation Enterprise Computing

  • Discrete Business Applications within Enterprise

    • Coupled by manual or batch processing

      • Separate application sets like Order, Inventory, Accounting

      • Through print-out or screen-scraper

    • Local optimization on each business operation

      • Data silo issue

© 2004 IBM Corporation


2 nd generation enterprise computing l.jpg
2 enterprise computingnd Generation Enterprise Computing

  • Monolithic Integration with Package Apps around Business Process

    • ERP package integrates a set of application tightly but monolithic

      • Data silo issue resolved within ERP

      • Needs many customization to adopt

    • New business application packages create higher level data silo issue

      • Between application packages like CRM, e-commerce, SCM etc.

    • B2B and B2C create new integration needs across enterprises

© 2004 IBM Corporation


3 rd generation enterprise computing l.jpg
3 enterprise computingrd Generation Enterprise Computing

  • EAI needs by On-demand Business

    • ERP and monolithic application packages integration through EAI (Enterprise Application Integration)

      • Has to be responsive through entire processes as enterprise in network economy

    • Still tightly non-flexible integration between business processes

      • No dynamic partnership enabled

      • Difficult to change and create new process (70% of IT budget spent for current system-associated maintenance)

    • Difficult to change IT resource for business transaction fluctuation

      • Huge spike as e-commerce nature

© 2004 IBM Corporation


Next generation enterprise computing l.jpg
Next-Generation Enterprise Computing enterprise computing

  • Enterprise Application Needs for Network Economy

    • Build business process dynamically as composite services within Enterprise and across Enterprise

      • Disintegrate monolithic business processes

    • Long business transaction to complete a business process

    • Dynamic resource allocation for transaction fluctuation

© 2004 IBM Corporation


Virtual organization and grid computing l.jpg
Virtual Organization and Grid Computing enterprise computing

(Blank Page)

© 2004 IBM Corporation


Example of scientific application l.jpg

~PBytes/sec enterprise computing

~100 MBytes/sec

Offline Processor Farm

~20 TIPS

There is a “bunch crossing” every 25 nsecs.

There are 100 “triggers” per second

Each triggered event is ~1 MByte in size

~100 MBytes/sec

Online System

Tier 0

CERN Computer Centre

~622 Mbits/sec or Air Freight (deprecated)

Tier 1

France Regional Centre

Germany Regional Centre

Italy Regional Centre

FermiLab ~4 TIPS

~622 Mbits/sec

Tier 2

Tier2 Centre ~1 TIPS

Caltech ~1 TIPS

Tier2 Centre ~1 TIPS

Tier2 Centre ~1 TIPS

Tier2 Centre ~1 TIPS

HPSS

HPSS

HPSS

HPSS

HPSS

~622 Mbits/sec

Institute ~0.25TIPS

Institute

Institute

Institute

Physics data cache

~1 MBytes/sec

1 TIPS is approximately 25,000

SpecInt95 equivalents

Physicists work on analysis “channels”.

Each institute will have ~10 physicists working on one or more channels; data for these channels should be cached by the institute server

Pentium II 300 MHz

Pentium II 300 MHz

Pentium II 300 MHz

Pentium II 300 MHz

Tier 4

Physicist workstations

Example of Scientific Application

  • Similar Requirements in Scientific Application

    • Build research process dynamically as composite services across Internet

    • Dynamic resource allocation through Internet

  • Science applications leap from discrete applications to Grid through WWW

http://www.griphyn.orghttp://www.ppdg.net http://www.eu-datagrid.org

© 2004 IBM Corporation


The grid l.jpg
The Grid enterprise computing

  • Enterprise Computing Reached Grid Story

  • “Resource sharing & coordinated problem solving in dynamic, multi-institutional virtual organizations”

    • Enable integration of distributed resources

    • Using general-purpose protocols & infrastructure

    • To achieve better-than-best-effort service

“The Grid: Beyond the Hype” by Ian Foster, 2004

© 2004 IBM Corporation


Grid and web services for next gen needs l.jpg
Grid and Web Services for Next-Gen Needs enterprise computing

  • Common Next Generation Computing

    • Dynamic virtual organization formation as business/research process

    • Long transaction as business/research process

    • Reliable processing over unreliable network

  • Technology Requirements

    • Meta-Operating System to form a virtual organization over heterogeneous environment

    • Loosely-coupled application/resource

    • Monolithic application decomposition for dynamic integration

    • Asynchronous and reliable message driven communication pipe

    • System management infrastructure over Internet

  • The answer is “Grid and Web Services”

© 2004 IBM Corporation


On demand operating environment l.jpg

Horizontal enterprise computing

Process

Business Flexibility

IT Simplification

Partners

Partners

Partners

On-Demand Operating Environment

  • IBM’s Articulation of Next-Gen Enterprise IT Environment

Integration

  • Business Modeling

  • Process Transformation

  • Application & Information Integration

  • Access

  • Collaboration

  • Business Process Management

Infrastructure Management

  • Automation/Virtualization

    • Availability

    • Security

    • Optimization

    • Provisioning

    • Policy-based Orchestration

    • Business Service Management

    • Resource Virtualization of Servers, Storage, Distributed Systems/Grid and the Network

SOA

Grid

© 2004 IBM Corporation


Web services evolution with soa l.jpg
Web Services Evolution with SOA enterprise computing

(Blank Page)

© 2004 IBM Corporation


What soa service oriented architecture is l.jpg

UDDI enterprise computing

Find

Publish

WSDL

Service

Bind

Requestor

SOAP

What SOA (Service Oriented Architecture) is

  • SOA aims at realizing “plug-and-play” software component

    • Easy to connect and easy to disconnect

    • Consists of a collection of “services” and can communicate each other simply

    • A “service” is a function that is well-defined, self-contained, and does not depend on the context or state of other services.

    • Web Services as one of technology to realize

    • A set of architectural principles which address characteristics

    • Amazon and Google as early adopters

© 2004 IBM Corporation


Soa evolution l.jpg

Enterprise Service Bus enterprise computing

Server Foundation

Modeler

Monitor

BPEL

Studio

SOA Evolution

  • ESB as a design pattern for Services Orchestration

  • Total Application Lifecycle support for SOA

  • Transaction/Long Transaction needs

© 2004 IBM Corporation


Grid and web services convergence l.jpg
Grid and Web Services Convergence enterprise computing

(Blank Page)

© 2004 IBM Corporation


Common things for web services and grid l.jpg

share enterprise computing

manage

access

Resources

on demand

Applications on

demand

Global

Accessibility

Secure and

universal access

Business

integration

Vast resource

scalability

Grid Protocols

Web Services

Common Things for Web Services and Grid

  • Share, access, and manage IT resources from physical to logical over Internet

    • Grid mainly has focused on lower abstracted and dynamic resource like computing resources

    • Web Services have focused on higher abstracted and static resources like applications

  • OGSA as an convergence technology proposed in 2002

© 2004 IBM Corporation


Ogsi issues as web services technology l.jpg

Applications enterprise computing

OGSA Architected Services

OGSI – Open Grid Services Infrastructure

Web Services

OGSA Enabled

OGSA Enabled

OGSA Enabled

Network

Storage

Servers

OGSA Enabled

OGSA Enabled

OGSA Enabled

OGSA Enabled

OGSA Enabled

OGSA Enabled

Workflow

Security

Directory

Messaging

Database

File Systems

OGSI Issues as Web Services Technology

  • OGSI developed since 2002 as OGSA Foundation, but…

    • Too much stuff in one specification

    • Does not work well with existing Web Services and XML tooling

    • Too object oriented

    • Introduction of forthcoming WSDL 2.0 capability as unsupported extensions to WSDL 1.1

© 2004 IBM Corporation


Refactor ogsi into wsrf l.jpg

WS-Resource enterprise computing

Properties

WS-Resource

Lifetime

WS-Notification

Modeling Stateful Resources with Web Services

WS-Base Faults

WS-Service Group

WS-RenewableReferences

Refactor OGSI into WSRF…

  • A family of Web services specification proposals in Jan, 2004

    • Proposed by Globus, IBM, HP, et.al.

  • Refactor OGSI into WS-Resource Framework and WS-Notification

    • Introduces a design pattern to specify how to use Web services to access “stateful” components

    • Better separation of function and exploitation of other Web Services specification

    • Introduce message based publish-subscribe to Web services as a broader view of notification

© 2004 IBM Corporation


Refactor ogsi into wsrf20 l.jpg

OGSI enterprise computing

WS-Resource framework (WSRF)

Grid Service Reference

WS-Addressing Endpoint Reference

Grid Service Handle

WS-Addressing Endpoint Reference

*

HandleResolver portType

WS-RenewableReferences

Service data definition & access

WS-ResourceProperties

*

*

GridService lifetime mgmt

WS-ResourceLifetime

Notification portTypes

WS-Notification

Factory portType

Treated as a pattern

*

ServiceGroup portTypes

WS-ServiceGroup

*

Base fault type

WS-BaseFaults

Refactor OGSI into WSRF

  • Better separation of function and exploitation of other Web Services specification

* Proposed as WSRF

http://www.globus.org/wsrf/sabbah_wsrf.ppt

© 2004 IBM Corporation


Web services as ogsa foundation l.jpg

Applications enterprise computing

OGSA Architected Services

Web Services

(with WS-Resource Framework + WS-Notification)

OGSA Enabled

OGSA Enabled

OGSA Enabled

Network

Storage

Servers

OGSA Enabled

OGSA Enabled

OGSA Enabled

OGSA Enabled

OGSA Enabled

OGSA Enabled

Database

Workflow

Directory

Security

Messaging

File Systems

Web Services as OGSA Foundation

  • Grid applications will NOT require special Web services infrastructure

    • Grid Services as a part of Web Services Specification

    • Can use other Web Services standards naturally

    • Standard Web services development tools can be used

© 2004 IBM Corporation


Grid services as web services l.jpg
Grid Services as Web Services enterprise computing

Service Composition

BPEL4WS

WS-Notification

WS-Service Group

Quality of

Experience

(QoX)

WS-Reliable Messaging

WS-Transaction

WS-Security

WS-Resource Lifetime

Description

WS-Base Faults

WS-Resource Properties

XSD

WSDL

WS-Policy

WS-Metadata Exchange

Messaging

SOAP

XML

WS-Addressing

WS-Renewable References

Transports

JMS

RMI / IIOP

SMTP

HTTP/HTTPS

© 2004 IBM Corporation


Adoption and support for wsrf l.jpg
Adoption and Support for WSRF+ enterprise computing

  • Globus Alliance

    • Globus Toolkit 4.0 fully adopt WSRF expected to be shipped in 2005Q1

  • IBM

    • IBM WebSphere Family and related Rational tools

      • When Standards mature they provide a runtime environment that supports WS-Resource Framework and WS-Notification

    • Fundamental to IBM’s On-Demand operating environment

      • System Management, Autonomic Computing

      • Data Management and Storage Management

      • Knowledge Management and Collaboration

      • Business Computing Services

© 2004 IBM Corporation


Adoption and expansion of grid application l.jpg
Adoption and Expansion of Grid Application enterprise computing

(Blank Page)

© 2004 IBM Corporation


Science neesgrid l.jpg

F enterprise computing1

m1, q1

f2

e

NTCP

SERVER

NTCP

SERVER

NTCP

SERVER

f1, x1

F2

m1

=

f1

f2

f2

f1

Experimental Model

Experimental Model

m1

Earthquake Simulation

SIMULATION

COORDINATOR

U. Colorado

UIUC

m1

NCSA

f2

f1

Computational Model

Science: NEESgrid

  • Distributed Simulation of Building in Earthquake

    • Implemented with GT3 Grid Services

    • Collective use of distributed experiment facilities and computing resource

    • 10ms order for one time-step for each simulation calculation

http://www.neesgrid.org/

© 2004 IBM Corporation


Science bioinformatics data mining l.jpg

Community enterprise computing

Registry

Mining

Factory

“Find me a data mining service, and somewhere to store data”

Database

Service

Query

BioDB 1

Miner

“Create a data mining service with initial lifetime 10”

Compute Service Provider

.

.

.

User

Application

.

.

.

Results

“Create a database with initial lifetime 1000”

Query

“I want to create

a personal database

containing data on

e.coli metabolism”

Database

Service

Database

Factory

“Notify User the mining done”

Results

BioDB n

Database

Storage Service Provider

Science: Bioinformatics Data Mining

  • Potential OGSA Application Scenario in Science

    • Bioinformatics Data Mining Application Service

    • Can be a generic pattern for Data Mining services in enterprise

      • Multi-Provider involvement and long transaction to complete

“Introduction to Open Grid Services Architecture (OGSA)” By Globus Project, 2002

© 2004 IBM Corporation


Enterprise clinical data sharing utility l.jpg

Hospital : A enterprise computing

Medical Grid Host

E-chart system

③search

MML

Mr.X’s chart data

repository

④search results

Community

Health Care

Center

Hospital : B

Hospital:A

Hospital:B

Medical Grid Host

③search

E-chart system

broker functions

④search results

Medical Grid Host

④ 検索結果

MML

Mr.X’s chart data

Clinic : C

XML Web

Service

Mr.X’s

movie

Web Service Client

⑴processing request

Mr.X’s chart

(Hospital : A)

Search

MML

⑤ Merge Mr.X’s chart information

image encoding ASP

Mr.X’s chart

(Hospital : B)

ASP Grid host

Hospital : A

Mr.X’s e-chart

encoding system

⑥search results

⑶Result

Hospital : B

Mr.X’s e-chart

⑵notice of termination

Hospital : A

Mr.X’s operation /

surgery movie

Enterprise: Clinical Data Sharing Utility

  • Potential OGSA Application Scenario across Hospital

    • Experiment of virtual clinical data sharing and encoding capability using GT3

    • Can be a generic pattern for virtual data utility services in enterprise

    • Developed by Partners of IBM Japan

© 2004 IBM Corporation


Enterprise dynamic entertainment service l.jpg
Enterprise: Dynamic Entertainment Service enterprise computing

  • GGF OGSA Use Case for Enterprise Service with Multiple Partners

    • Entertainment content provider and associated IT partner ecosystem

    • Content provision and aggregation like game and video contents

      • ex. Virtual Scuba-diving business scenario by Ian Foster

    • Tolerance to unexpected transaction fluctuation by dynamic Grid resource provisioning

    • Quick and dynamic ecosystem building using Standardized Grid Services

Consumer

Content

Provider

Content

Provider

Content

Provider

Integrator/

Publisher

Infrastructure

Service Provider

Network

Service Provider

© 2004 IBM Corporation


Summary l.jpg
Summary enterprise computing

(Blank Page)

© 2004 IBM Corporation


Summary30 l.jpg
Summary enterprise computing

  • Next-Gen Applications in both Science and Enterprise need Dynamic and Flexible Grid Services

    • Dynamic multi-partnership needs in business and a complex research experiment/simulation

    • Unexpected transaction fluctuation especially in Enterprise

    • Long transaction needs with a long business process and a huge simulation/mining

  • Grid/Web Services Convergence with WSRF

    • Dynamic and flexible resource coordination

    • Single standardization for multiple partner collaboration

    • Loosely-coupled design based on SOA is key

      • Service virtualization for abstracted IT resource

      • Asynchronous aspects for long transaction

© 2004 IBM Corporation


Slide31 l.jpg

© enterprise computing2004 IBM Corporation


ad