grid and web services convergence and the impact on enterprise computing
Download
Skip this Video
Download Presentation
Grid and Web Services convergence and the impact on enterprise computing

Loading in 2 Seconds...

play fullscreen
1 / 31

Grid and Web Services convergence and the impact on enterprise computing - PowerPoint PPT Presentation


  • 252 Views
  • Uploaded on

Grid and Web Services convergence and the impact on enterprise computing. Takanori Seki, Distinguished Engineer Grid Computing Business, IBM Japan. 22-60. Contents. Enterprise Computing History Virtual Organization and Grid Computing Web Services Evolution with SOA

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Grid and Web Services convergence and the impact on enterprise computing' - richard_edik


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
grid and web services convergence and the impact on enterprise computing

Grid and Web Services convergence and the impact on enterprise computing

Takanori Seki, Distinguished Engineer

Grid Computing Business, IBM Japan

22-60

contents
Contents
  • Enterprise Computing History
  • Virtual Organization and Grid Computing
  • Web Services Evolution with SOA
  • Grid and Web Services Convergence
  • Adoption and Expansion of Grid Application
  • Summary

© 2004 IBM Corporation

enterprise computing history
Enterprise Computing History

(Blank Page)

© 2004 IBM Corporation

1 st generation enterprise computing
1st Generation Enterprise Computing
  • Discrete Business Applications within Enterprise
    • Coupled by manual or batch processing
      • Separate application sets like Order, Inventory, Accounting
      • Through print-out or screen-scraper
    • Local optimization on each business operation
      • Data silo issue

© 2004 IBM Corporation

2 nd generation enterprise computing
2nd Generation Enterprise Computing
  • Monolithic Integration with Package Apps around Business Process
    • ERP package integrates a set of application tightly but monolithic
      • Data silo issue resolved within ERP
      • Needs many customization to adopt
    • New business application packages create higher level data silo issue
      • Between application packages like CRM, e-commerce, SCM etc.
    • B2B and B2C create new integration needs across enterprises

© 2004 IBM Corporation

3 rd generation enterprise computing
3rd Generation Enterprise Computing
  • EAI needs by On-demand Business
    • ERP and monolithic application packages integration through EAI (Enterprise Application Integration)
      • Has to be responsive through entire processes as enterprise in network economy
    • Still tightly non-flexible integration between business processes
      • No dynamic partnership enabled
      • Difficult to change and create new process (70% of IT budget spent for current system-associated maintenance)
    • Difficult to change IT resource for business transaction fluctuation
      • Huge spike as e-commerce nature

© 2004 IBM Corporation

next generation enterprise computing
Next-Generation Enterprise Computing
  • Enterprise Application Needs for Network Economy
    • Build business process dynamically as composite services within Enterprise and across Enterprise
      • Disintegrate monolithic business processes
    • Long business transaction to complete a business process
    • Dynamic resource allocation for transaction fluctuation

© 2004 IBM Corporation

virtual organization and grid computing
Virtual Organization and Grid Computing

(Blank Page)

© 2004 IBM Corporation

example of scientific application
~PBytes/sec

~100 MBytes/sec

Offline Processor Farm

~20 TIPS

There is a “bunch crossing” every 25 nsecs.

There are 100 “triggers” per second

Each triggered event is ~1 MByte in size

~100 MBytes/sec

Online System

Tier 0

CERN Computer Centre

~622 Mbits/sec or Air Freight (deprecated)

Tier 1

France Regional Centre

Germany Regional Centre

Italy Regional Centre

FermiLab ~4 TIPS

~622 Mbits/sec

Tier 2

Tier2 Centre ~1 TIPS

Caltech ~1 TIPS

Tier2 Centre ~1 TIPS

Tier2 Centre ~1 TIPS

Tier2 Centre ~1 TIPS

HPSS

HPSS

HPSS

HPSS

HPSS

~622 Mbits/sec

Institute ~0.25TIPS

Institute

Institute

Institute

Physics data cache

~1 MBytes/sec

1 TIPS is approximately 25,000

SpecInt95 equivalents

Physicists work on analysis “channels”.

Each institute will have ~10 physicists working on one or more channels; data for these channels should be cached by the institute server

Pentium II 300 MHz

Pentium II 300 MHz

Pentium II 300 MHz

Pentium II 300 MHz

Tier 4

Physicist workstations

Example of Scientific Application
  • Similar Requirements in Scientific Application
    • Build research process dynamically as composite services across Internet
    • Dynamic resource allocation through Internet
  • Science applications leap from discrete applications to Grid through WWW

http://www.griphyn.orghttp://www.ppdg.net http://www.eu-datagrid.org

© 2004 IBM Corporation

the grid
The Grid
  • Enterprise Computing Reached Grid Story
  • “Resource sharing & coordinated problem solving in dynamic, multi-institutional virtual organizations”
    • Enable integration of distributed resources
    • Using general-purpose protocols & infrastructure
    • To achieve better-than-best-effort service

“The Grid: Beyond the Hype” by Ian Foster, 2004

© 2004 IBM Corporation

grid and web services for next gen needs
Grid and Web Services for Next-Gen Needs
  • Common Next Generation Computing
    • Dynamic virtual organization formation as business/research process
    • Long transaction as business/research process
    • Reliable processing over unreliable network
  • Technology Requirements
    • Meta-Operating System to form a virtual organization over heterogeneous environment
    • Loosely-coupled application/resource
    • Monolithic application decomposition for dynamic integration
    • Asynchronous and reliable message driven communication pipe
    • System management infrastructure over Internet
  • The answer is “Grid and Web Services”

© 2004 IBM Corporation

on demand operating environment
Horizontal

Process

Business Flexibility

IT Simplification

Partners

Partners

Partners

On-Demand Operating Environment
  • IBM’s Articulation of Next-Gen Enterprise IT Environment

Integration

  • Business Modeling
  • Process Transformation
  • Application & Information Integration
  • Access
  • Collaboration
  • Business Process Management

Infrastructure Management

  • Automation/Virtualization
    • Availability
    • Security
    • Optimization
    • Provisioning
    • Policy-based Orchestration
    • Business Service Management
    • Resource Virtualization of Servers, Storage, Distributed Systems/Grid and the Network

SOA

Grid

© 2004 IBM Corporation

web services evolution with soa
Web Services Evolution with SOA

(Blank Page)

© 2004 IBM Corporation

what soa service oriented architecture is
UDDI

Find

Publish

WSDL

Service

Bind

Requestor

SOAP

What SOA (Service Oriented Architecture) is
  • SOA aims at realizing “plug-and-play” software component
    • Easy to connect and easy to disconnect
    • Consists of a collection of “services” and can communicate each other simply
    • A “service” is a function that is well-defined, self-contained, and does not depend on the context or state of other services.
    • Web Services as one of technology to realize
    • A set of architectural principles which address characteristics
    • Amazon and Google as early adopters

© 2004 IBM Corporation

soa evolution
Enterprise Service Bus

Server Foundation

Modeler

Monitor

BPEL

Studio

SOA Evolution
  • ESB as a design pattern for Services Orchestration
  • Total Application Lifecycle support for SOA
  • Transaction/Long Transaction needs

© 2004 IBM Corporation

grid and web services convergence
Grid and Web Services Convergence

(Blank Page)

© 2004 IBM Corporation

common things for web services and grid
share

manage

access

Resources

on demand

Applications on

demand

Global

Accessibility

Secure and

universal access

Business

integration

Vast resource

scalability

Grid Protocols

Web Services

Common Things for Web Services and Grid
  • Share, access, and manage IT resources from physical to logical over Internet
    • Grid mainly has focused on lower abstracted and dynamic resource like computing resources
    • Web Services have focused on higher abstracted and static resources like applications
  • OGSA as an convergence technology proposed in 2002

© 2004 IBM Corporation

ogsi issues as web services technology
Applications

OGSA Architected Services

OGSI – Open Grid Services Infrastructure

Web Services

OGSA Enabled

OGSA Enabled

OGSA Enabled

Network

Storage

Servers

OGSA Enabled

OGSA Enabled

OGSA Enabled

OGSA Enabled

OGSA Enabled

OGSA Enabled

Workflow

Security

Directory

Messaging

Database

File Systems

OGSI Issues as Web Services Technology
  • OGSI developed since 2002 as OGSA Foundation, but…
    • Too much stuff in one specification
    • Does not work well with existing Web Services and XML tooling
    • Too object oriented
    • Introduction of forthcoming WSDL 2.0 capability as unsupported extensions to WSDL 1.1

© 2004 IBM Corporation

refactor ogsi into wsrf
WS-Resource

Properties

WS-Resource

Lifetime

WS-Notification

Modeling Stateful Resources with Web Services

WS-Base Faults

WS-Service Group

WS-RenewableReferences

Refactor OGSI into WSRF…
  • A family of Web services specification proposals in Jan, 2004
    • Proposed by Globus, IBM, HP, et.al.
  • Refactor OGSI into WS-Resource Framework and WS-Notification
    • Introduces a design pattern to specify how to use Web services to access “stateful” components
    • Better separation of function and exploitation of other Web Services specification
    • Introduce message based publish-subscribe to Web services as a broader view of notification

© 2004 IBM Corporation

refactor ogsi into wsrf20
OGSI

WS-Resource framework (WSRF)

Grid Service Reference

WS-Addressing Endpoint Reference

Grid Service Handle

WS-Addressing Endpoint Reference

*

HandleResolver portType

WS-RenewableReferences

Service data definition & access

WS-ResourceProperties

*

*

GridService lifetime mgmt

WS-ResourceLifetime

Notification portTypes

WS-Notification

Factory portType

Treated as a pattern

*

ServiceGroup portTypes

WS-ServiceGroup

*

Base fault type

WS-BaseFaults

Refactor OGSI into WSRF
  • Better separation of function and exploitation of other Web Services specification

* Proposed as WSRF

http://www.globus.org/wsrf/sabbah_wsrf.ppt

© 2004 IBM Corporation

web services as ogsa foundation
Applications

OGSA Architected Services

Web Services

(with WS-Resource Framework + WS-Notification)

OGSA Enabled

OGSA Enabled

OGSA Enabled

Network

Storage

Servers

OGSA Enabled

OGSA Enabled

OGSA Enabled

OGSA Enabled

OGSA Enabled

OGSA Enabled

Database

Workflow

Directory

Security

Messaging

File Systems

Web Services as OGSA Foundation
  • Grid applications will NOT require special Web services infrastructure
    • Grid Services as a part of Web Services Specification
    • Can use other Web Services standards naturally
    • Standard Web services development tools can be used

© 2004 IBM Corporation

grid services as web services
Grid Services as Web Services

Service Composition

BPEL4WS

WS-Notification

WS-Service Group

Quality of

Experience

(QoX)

WS-Reliable Messaging

WS-Transaction

WS-Security

WS-Resource Lifetime

Description

WS-Base Faults

WS-Resource Properties

XSD

WSDL

WS-Policy

WS-Metadata Exchange

Messaging

SOAP

XML

WS-Addressing

WS-Renewable References

Transports

JMS

RMI / IIOP

SMTP

HTTP/HTTPS

© 2004 IBM Corporation

adoption and support for wsrf
Adoption and Support for WSRF+
  • Globus Alliance
    • Globus Toolkit 4.0 fully adopt WSRF expected to be shipped in 2005Q1
  • IBM
    • IBM WebSphere Family and related Rational tools
      • When Standards mature they provide a runtime environment that supports WS-Resource Framework and WS-Notification
    • Fundamental to IBM’s On-Demand operating environment
      • System Management, Autonomic Computing
      • Data Management and Storage Management
      • Knowledge Management and Collaboration
      • Business Computing Services

© 2004 IBM Corporation

adoption and expansion of grid application
Adoption and Expansion of Grid Application

(Blank Page)

© 2004 IBM Corporation

science neesgrid
F1

m1, q1

f2

e

NTCP

SERVER

NTCP

SERVER

NTCP

SERVER

f1, x1

F2

m1

=

f1

f2

f2

f1

Experimental Model

Experimental Model

m1

Earthquake Simulation

SIMULATION

COORDINATOR

U. Colorado

UIUC

m1

NCSA

f2

f1

Computational Model

Science: NEESgrid
  • Distributed Simulation of Building in Earthquake
    • Implemented with GT3 Grid Services
    • Collective use of distributed experiment facilities and computing resource
    • 10ms order for one time-step for each simulation calculation

http://www.neesgrid.org/

© 2004 IBM Corporation

science bioinformatics data mining
Community

Registry

Mining

Factory

“Find me a data mining service, and somewhere to store data”

Database

Service

Query

BioDB 1

Miner

“Create a data mining service with initial lifetime 10”

Compute Service Provider

.

.

.

User

Application

.

.

.

Results

“Create a database with initial lifetime 1000”

Query

“I want to create

a personal database

containing data on

e.coli metabolism”

Database

Service

Database

Factory

“Notify User the mining done”

Results

BioDB n

Database

Storage Service Provider

Science: Bioinformatics Data Mining
  • Potential OGSA Application Scenario in Science
    • Bioinformatics Data Mining Application Service
    • Can be a generic pattern for Data Mining services in enterprise
      • Multi-Provider involvement and long transaction to complete

“Introduction to Open Grid Services Architecture (OGSA)” By Globus Project, 2002

© 2004 IBM Corporation

enterprise clinical data sharing utility
Hospital : A

Medical Grid Host

E-chart system

③search

MML

Mr.X’s chart data

repository

④search results

Community

Health Care

Center

Hospital : B

Hospital:A

Hospital:B

Medical Grid Host

③search

E-chart system

broker functions

④search results

Medical Grid Host

④ 検索結果

MML

Mr.X’s chart data

Clinic : C

XML Web

Service

Mr.X’s

movie

Web Service Client

⑴processing request

Mr.X’s chart

(Hospital : A)

Search

MML

⑤ Merge Mr.X’s chart information

image encoding ASP

Mr.X’s chart

(Hospital : B)

ASP Grid host

Hospital : A

Mr.X’s e-chart

encoding system

⑥search results

⑶Result

Hospital : B

Mr.X’s e-chart

⑵notice of termination

Hospital : A

Mr.X’s operation /

surgery movie

Enterprise: Clinical Data Sharing Utility
  • Potential OGSA Application Scenario across Hospital
    • Experiment of virtual clinical data sharing and encoding capability using GT3
    • Can be a generic pattern for virtual data utility services in enterprise
    • Developed by Partners of IBM Japan

© 2004 IBM Corporation

enterprise dynamic entertainment service
Enterprise: Dynamic Entertainment Service
  • GGF OGSA Use Case for Enterprise Service with Multiple Partners
    • Entertainment content provider and associated IT partner ecosystem
    • Content provision and aggregation like game and video contents
      • ex. Virtual Scuba-diving business scenario by Ian Foster
    • Tolerance to unexpected transaction fluctuation by dynamic Grid resource provisioning
    • Quick and dynamic ecosystem building using Standardized Grid Services

Consumer

Content

Provider

Content

Provider

Content

Provider

Integrator/

Publisher

Infrastructure

Service Provider

Network

Service Provider

© 2004 IBM Corporation

summary
Summary

(Blank Page)

© 2004 IBM Corporation

summary30
Summary
  • Next-Gen Applications in both Science and Enterprise need Dynamic and Flexible Grid Services
    • Dynamic multi-partnership needs in business and a complex research experiment/simulation
    • Unexpected transaction fluctuation especially in Enterprise
    • Long transaction needs with a long business process and a huge simulation/mining
  • Grid/Web Services Convergence with WSRF
    • Dynamic and flexible resource coordination
    • Single standardization for multiple partner collaboration
    • Loosely-coupled design based on SOA is key
      • Service virtualization for abstracted IT resource
      • Asynchronous aspects for long transaction

© 2004 IBM Corporation

ad