1 / 38

Aggregation and Coordination of Services in Geological Application Grid

Aggregation and Coordination of Services in Geological Application Grid. National Lab of Software Development Environment Beihang University, Beijing 100083, China. Outline. Introduction to data grid environment and NGG (National Geological Grid).

opal
Download Presentation

Aggregation and Coordination of Services in Geological Application Grid

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Aggregation and Coordination of Services in Geological Application Grid National Lab of Software Development Environment Beihang University, Beijing 100083, China

  2. Outline • Introduction to data grid environment and NGG (National Geological Grid) • Mechanism for Aggregation and Coordination of Services • Collaborative Service integration and management for NGG • Survivability of Tasks Running in NGG • Example: A Task Running in NGG • Conclusions Advanced Grid Research Workshops through European and Asian Co-operation

  3. Introduction to data grid environment and NGG (National Geological Grid) • Mechanism for Aggregation and Coordination of Services • Collaborative Service integration and management for NGG • Survivability of Tasks Running in NGG • Example: A Task Running in NGG • Conclusions Advanced Grid Research Workshops through European and Asian Co-operation

  4. Introduction: data grid environment Serving for • sharing data resource across the grid environment (aggregation of data services) • sharing computing power across the grid environment (coorindation of computing services) Advanced Grid Research Workshops through European and Asian Co-operation

  5. Introduction: NGG Serving for geological application Qos service Monitoring service Uniform retrieval Architecture of NGG Advanced Grid Research Workshops through European and Asian Co-operation

  6. Mechanism: the NGG Deployment National node Regional node Provincial node Advanced Grid Research Workshops through European and Asian Co-operation

  7. Introduction: problems raised in NGG The rapidly raising number of services and resources result in: • Heterogeneous data resource results in onerous repetition of service’s development. • Different service’s interface results in incompatibility in execution. • Uncertain “quality” of services affects the survivability of tasks (applications) • Applications needs several services to be integrated Advanced Grid Research Workshops through European and Asian Co-operation

  8. Introduction to data grid environment and NGG (National Geological Grid) • Mechanism for Aggregation and Coordination of Services • Collaborative Service integration and management for NGG • Survivability of Tasks Running in NGG • Example: A Task Running in NGG • Conclusions Advanced Grid Research Workshops through European and Asian Co-operation

  9. Select setting Find relevant nodes Retrieve data from nodes Retrieve data from nodes Aggregate data and computation Get result Mechanism: Applications in NGG The application process: Advanced Grid Research Workshops through European and Asian Co-operation

  10. Mechanism: Services in NGG Features of service in NGG • provides atomic function in applications • should be integrated together for one applications • have same functionality and interface • “quality” in execution is changing and uncertain Advanced Grid Research Workshops through European and Asian Co-operation

  11. Mechanism: collaborative and coordination The mechanism aims to : • hide heterogeneity of data resource for service integration. • integrate services and manage applications for clients . • implement applications automatically. • support survivability of tasks running in NGG. Advanced Grid Research Workshops through European and Asian Co-operation

  12. Mechanism: the serviceFlow & management NGG develops a serviceflow to address the issue: NGGSf (National Geological Grid Service Flow) . Defines applications with XML . Integrates services . Implements static services, virtual services and dynamic services . Manages services by state and transaction control information defined by user Advanced Grid Research Workshops through European and Asian Co-operation

  13. Mechanism: the serviceFlow & management Based on NGGSf • executes services by hiding heterogeneity • implements applications automatically • schedules services for efficiency • supports migration of services Advanced Grid Research Workshops through European and Asian Co-operation

  14. Introduction to data grid environment and NGG (National Geological Grid) • Mechanism for Aggregation and Coordination of Services • Collaborative Service integration and management for NGG • Survivability of Tasks Running in NGG • Example: A Task Running in NGG • Conclusions Advanced Grid Research Workshops through European and Asian Co-operation

  15. The NGGSf: the modeling . Conform to WfMC (Workflow Management Coalition) . Couple with WSDL and SOAP . Embed execution information in flow description . Execute service uniformly Advanced Grid Research Workshops through European and Asian Co-operation

  16. The NGGSf: the meta model Activity is core of a flow. It’s a sub job of the application Message interface Quality assessment Activity invocation interface State and transaction control Service composition State and transaction control interface Message interface services invocationinterface WSDL interface Advanced Grid Research Workshops through European and Asian Co-operation

  17. The NGGSf: the structure Flow description Three layer structure flow Activity list Control link data link Activity description activity Service list Control link data link Service description service Advanced Grid Research Workshops through European and Asian Co-operation

  18. The NGGSf: the structure . Service’s address or virtual code . Service’s message . Service’s invocation . Service’s state table Flow description flow -<serviceDescription> -<serviceDef> <ID>MultiGetData</ID> <method>MultiGetData</method> <url>http://192.168.5.156/NGGWFActivityWb/Service1.asmx</url> <wsdl>waterquality.WSDL</wsdl> -<stateTable> <create /> <waiting /> <activiting /> <abort /> <end /> <exception /> </stateTable> <description>service_description</description> <dataDescription>DataSet</dataDescription> <inDataDescription>[ID][UserName] [FieldLink][CallIP] [criterions][year] </inDataDescription> </serviceDef> </serviceDescription> Activity list Control link data link Activity description activity Service list Control link data link Service description service Advanced Grid Research Workshops through European and Asian Co-operation

  19. The NGGSf: the structure . Integrates services . Define state and control Flow description flow Activity list Control link . Execution order . Parallel . Sequential . Conditional transaction data link Activity description activity Service list Control link data link Service description . Define data transferred among services service Advanced Grid Research Workshops through European and Asian Co-operation

  20. The NGGSf: the structure Flow description Integrate activities for application flow Activity list Manage activities Control link data link Activity description activity Service list Control link data link Service description service Advanced Grid Research Workshops through European and Asian Co-operation

  21. The NGGSf: application with the workflow Application flow Prepare activity Data activity root root Uniform data retrieval Data aggregating MapGIS Query Selection Setting computation activity result activity root root Select model mapping costing Computation model A Computation model B Control flow Datal flow Advanced Grid Research Workshops through European and Asian Co-operation

  22. Engine Application flow Error report Syntax check Service discover authentication binding Planning and scheduling execution Monitoring result The NGGSf: the Engine Advanced Grid Research Workshops through European and Asian Co-operation

  23. Introduction to data grid environment and NGG (National Geological Grid) • Mechanism for Aggregation and Coordination of Services • Collaborative Service integration and management for NGG • Survivability of Tasks Running in NGG • Example: A Task Running in NGG • Conclusions Advanced Grid Research Workshops through European and Asian Co-operation

  24. The Survivability: the “best” service Service’s quality : • Availability : the service’s working state that can and agrees to offer the resource in time. It could be assessed by hardware state and authentication measured. • Connectivity : the service’s connection state that affects stability property of the service. • Stability : the service’s execution state. One service’s stability is affected by multi conditions, such as hardware’s load, network connection, software’s environment and so on. Stability can be predicated by collecting certain information about the service through system’s monitoring services. Advanced Grid Research Workshops through European and Asian Co-operation

  25. The Survivability: service’s running Services run as . Static service : the service with a valid URL address . Virtual service : the service with a virtual service code. Its URL should be retrieved from NNG’s registration system . Dynamic service : the service with null. Its URL or virtual service code is generated by other services. Advanced Grid Research Workshops through European and Asian Co-operation

  26. query Registration service Monitoring service Find valid services record The Survivability: select a good service Application engine Assess “quality” of service History execution record execution Advanced Grid Research Workshops through European and Asian Co-operation

  27. Service invocation Service invocation Data information data Data retrieval service service data result service result data store service Data information The Survivability: execute a service large scale of data transferred Advanced Grid Research Workshops through European and Asian Co-operation

  28. The Survivability: execute a service large scale of data transferred Service invocation Used to tell the service where and how to get relevant data Data information Service invocation Data retrieval service data data service service result result data store service Data information Advanced Grid Research Workshops through European and Asian Co-operation

  29. The Survivability: execute a service large scale of data transferred Service invocation Data information Service invocation Data retrieval service data data service service Used to tell the application where and how to get the result data result result data store service Data information Advanced Grid Research Workshops through European and Asian Co-operation

  30. Introduction to data grid environment and NGG (National Geological Grid) • Mechanism for Aggregation and Coordination of Services • Collaborative Service integration and management for NGG • Survivability of Tasks Running in NGG • Example: A Task Running in NGG • Conclusions Advanced Grid Research Workshops through European and Asian Co-operation

  31. Example: NGGSf in NGG Simple flow of groundwater quality assessment Advanced Grid Research Workshops through European and Asian Co-operation

  32. Example: NGGSf in NGG Advanced Grid Research Workshops through European and Asian Co-operation

  33. Example: tools Advanced Grid Research Workshops through European and Asian Co-operation

  34. Example: Groundwater quality assessment methodSelect activity Select method service Select activity Rect select service MultiGetData activity multiGetData service result activity Assessment activity table service Assessment service map service Advanced Grid Research Workshops through European and Asian Co-operation

  35. Example: Groundwater quality assessment Advanced Grid Research Workshops through European and Asian Co-operation

  36. Introduction to data grid environment and NGG (National Geological Grid) • Service Flow for Aggregation and Coordination of Services • Collaborative Service integration and management for NGG • Survivability of Tasks Running in NGG • Example: A Task Running in NGG • Conclusions Advanced Grid Research Workshops through European and Asian Co-operation

  37. Conclusion Serving for data grid environment: • easy and quick integration of services for applications • aggregating and coordinating services • support the survivability of running tasks • by other ongoing project experience, the proposed service flow model is also applicable for other data grid environment such as earthquake analysis applications and petroleum exploration applications Advanced Grid Research Workshops through European and Asian Co-operation

  38. Thanks Advanced Grid Research Workshops through European and Asian Co-operation

More Related