Grid Component Model and Platform: An Overview

1. Grid Component Model and Platform: An Overview Workshop on Evolutions of GRIDs Towards SOKUsOGF20, Manchester, 8 May 2007 Vladimir GetovCoreGRID STE Institute Leader University of Westminster, London, U.K. http://www.coregrid.net V.S.Getov@westminster.ac.uk

2. EchoGrid Degree Grid@Asia Challengers Nessi-Grid GridCoord SIMDAT industrial simulations BeinGrid business experiments BREIN agents & semantics NextGRID service architecture Akogrimo mobile services CoreGRID virtual laboratories GridEcon GridTrust GridComp OntoGrid InteliGrid ArguGrid Bridge UniGrids Grid4all KnowArc Gredia HPC4U Sorma EC-Gin A-Ware g-Eclipse Edutain@ Grid Chemomen tum Datamining Grid AssessGrid Provenance QosCosGrid K-WF Grid Grid Research Projects under FP6 international cooperation supporting the Grid community EU Funding: 130 M€ Grid services, business models trust, security BeinGrid business experiments platforms, user environments data, knowledge, semantics XtreemOS Linux based Grid operating system Wave2 – start 2006 Network of excellence Integrated project Specific targeted research project Specific support action Wave 1 – start 2004 European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

3. Preventing research fragmentation • Developing world-class scientific and technological excellence • Achieving sustainable integration • Contributing to the realisation of the European Research Area for Grid Research Six highly-focused Research Institutes across 41 Research Labs System architecture Programming models Resource Management & Scheduling Grid Information, Resource and Workflow Monitoring Knowledge and data management Grid Systems, Tools and Environments Gathering 145 researchers & 169 PhD students into a single EU Laboratory on Grid Technologies European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

4. CoreGRID Definition of Future Grids • A fully distributed, dynamically reconfigurable, scalable and autonomous infrastructure to provide location independent, pervasive, reliable, secure and efficient access to a coordinated set of services encapsulating and virtualizing resources (computing power, storage, instruments, data, etc.) in order to generate knowledge. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

5. SOA Methodologies KnowledgeTechnologies … Evolution of HPCN Next Generation Grids Service-OrientedKnowledge Utility Current Grids Evolution of the Web SoftwareTechnologies Autonomic Computing … From Grids to SOKU European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

6. Background: How to build Grid Middleware • Proprietary middleware (Globus 1.0, Legion, Unicore, …) • Resources exposed through an API • Non interoperable ! • Object-based middleware • Resources exposed through distributed objects (Java, CORBA, etc.) • Some interoperability issues with the communication protocols (CORBA IIOP) • Not anymore at the top of the hype ! • Service-based middleware • Resources exposed through services • Strong support from the Industry • At the top of the hype ! • Need some extensions (stateful Web services) European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

7. One of the Main Research Challenges for Future Grids To develop the software design and development methodology of a generic component-based Grid platform for both applications and tools/systems/PSEs to have a single, seamless, “invisible” Grid software services infrastructure. Possible Solution: Grid Component Model (GCM): • Proposal for a Grid Component Model - DPM02 • Basic Features of the Grid Component Model (assessed) - DPM04 • GoreGRID Institute on Programming Models European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

8. GCM: Main Features • Component hierarchy • Extensibility of the model • Support for adaptivity • Language neutrality • Interoperability • Reflexivity • Lightweight  portable and compact implementations • Well-defined semantics (allow future formalization) European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

9. GCM Technical Structure • Component Specification as an XML schema • Run-Time API defined in several languages • C, Java, etc. • Packaging described as an XML schema • Information for Deployment • (Virtual Nodes, … Variables, File Transfer, …) European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

10. Collective Interfaces • Simplify the design and configuration of component systems • Expose the collective nature of interfaces • Multicast, Gathercast, gather-multicast • The framework handles collective behaviour • at the level of the interface • Based on Fractal API : • Dedicated controller • Interface typing  Verifications European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

11. Content and Main Activities: GCM Reference Implementation • 1 - Primitive Component Programming • 2 - Legacy Code Wrapping, Interoperability • 3 - Composition and Composites, Deployment • 4 – Autonomic features • 5 – IDE for GCM (Composition GUI, etc.) European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

12. Research Example: Componentising an Application for the GridINRIA and University of Westminster • ProActive library • Java distributed object middleware for parallel and concurrent programming • Main features: Active objects, Asynchronous method invocation, Group communications, Descriptor-based deployment • Jem3D • numerical solver for the 3D Maxwell’s equations modelling the time domain propagation of electromagnetic waves • follows typical “geometric decomposition” parallelisation • distributed object application using ProActive European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

13. Research Example: Componentisation Process • General, architecture-based process • Object-based system  • Component-based system • Early GCM using ProActive – extends Fractal with: • distributed components • multicast interfaces • configurable deployment on the Grid European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

14. Research Example: Performance Evaluation • Comparison: Object-based vs. Component-based • experiments on Grid’5000 using up to 308 processors, allocated on up to 3 clusters • 7 experiments using different problem size and number of processors • execution times of two versions are similar European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

15. Domain-Specific Metadata for Model Validation and Performance Optimisation – Legacy Applications GENIE is an interactive, legacy code for Earth system modelling. Our hypothesis is that componentising the application and using domain-specific metadata will help transforming it into a scalable yet efficient Grid system. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

16. Domain-Specific Metadata for Model Validation and Performance Optimisation • Motivation: Enable legacy applications to evolve as a part of the scalable problem solving environments within modern Grid systems. • Framework: Componentising existing applications along with domain-specific metadata so that issues arising thereof can be addressed using this metadata. • Result: Used GENIE (Earth Simulation System) as a motivating example. Derived different domain- and component-specific metadata and optimisation strategies. • Further Work: The principles we outlined are application-specific. A generic, but domain-restricted approach is required and potential performance benefits need to be demonstrated. • Partners: • University of Westminster (UK) • Imperial College - London (UK) • Ongoing work: CoreGRID TR-0068 and a chapter in a CoreGRID Springer volume European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

17. Some Future Research Goals • Adoption of GCM for Grid applications development • Generic, lightweight component-based Grid platform design methodology • Use of GCM for Grid system software design • Integration of application and system components into a single adaptable Grid platform • Interoperability between peer-to-peer and client-server paradigms in hybrid Grid systems European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

18. New Spin-off Project - GridCOMP • FP6 Call5 • GridCOMP nvolves 6/12 CoreGRID partners:INRIA, ERCIM, UNIPI, UOW, ISTI/CNR, UCHILE • Main goal: develop a GCM prototype platform • Strong industrial involvement: IBM, Atos Origin, Grid Systems • Worldwide partners: Tsinghua University (China), Melbourne University (Australia), and University of Chile (Chile) European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

19. Conclusions • Research work ongoing in both CoreGRID and GridCOMP projects • Some other CoreGRID Institutes adopting GCM • More research results to be expected soon • Strong interest from the US community – joint focused yearly workshop • High industrial interest via the GridCOMP project • ETSI interest to initiate further work on the GCM specification • An OGF activity - ? European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies