The Interactive European Grid Project

1. The Interactive European Grid Project Paul Heinzlreiter GUP, University Linz CoreGrid Summer School, Budapest, 7.9.2007

2. Outline • General Project Overview • Research Activities • Infrastructure • Applications CoreGrid Summer School, Budapest, 7.9.2007

3. i2g Partners CoreGrid Summer School, Budapest, 7.9.2007

4. i2g History • Precursor:Crossgrid Project • First Project to deliver Interactivity for Grids • i2g improves: • Key Components • Integration • Adaptation to new Middleware • New applications CoreGrid Summer School, Budapest, 7.9.2007

5. i2g Aims • Timeframe: May 2006 – April 2008 • Interactivity • User-Friendliness • MPI Support • Support of Demanding Applications • Integration of all Components • Provision of a Good User Experience • Interoperability (with EGEE / gLite) CoreGrid Summer School, Budapest, 7.9.2007

6. i2g Joint Research Activity • Interactivity & Visualization • Resource Broker • Interactive Connections • Video Streaming • CrossBroker • Reduced Job Startup Times • Graphical User Interface • Job Control • Data Handling • Job Output • MPI Support • Intra-Site and Inter-Site • Active Security CoreGrid Summer School, Budapest, 7.9.2007

7. return return Problem: GASS cache fork inherited socket (i2)glogin Client Gatekeeper Workernode job submit Point ofContact glogin fork  interactive bidirectional connection Workernode glogin’ socket Workernode traffic forwarding glogin’’ Workernode Workernode on the Grid CoreGrid Summer School, Budapest, 7.9.2007

8. TCP Transport MP4 Decoder Socket Transport SDL Outputclient File Transport Event Encoder Pipe Transport MP4 Encoder TCP Transport Socket Transport remoteGlut File Transport Event Decoder Pipe Transport glogin glogin GSS secured GVid Application GVid UI Grid vtk App $ grid-proxy-init $ glogin -x –C altix1 CoreGrid Summer School, Budapest, 7.9.2007

9. GUI – Migrating Desktop • User-Friendly • Platform Independent • Java • Running Sequential & MPI Jobs • Roaming Access Server interfaces with the UI • Data Management • Easily Extendable • Plugin Mechnism for new Applications • Extension for Interactive Remote Visualization CoreGrid Summer School, Budapest, 7.9.2007

10. GUI – Migrating Desktop CoreGrid Summer School, Budapest, 7.9.2007

11. Information Index Migrating Desktop Scheduling Agent Resource Searcher Replica Manager Application Launcher Condor-G DAGMan LCG gLite CE CE WN WN WN WN CrossBroker • Interactive Job Broker • Automatic Job Managementfor Parallel Applications • Resource Searching • Job Conditioning • Launching, Monitoring, Retry • Result Retrieval • Workflows, Interactive & Batch Jobs, MPI Support • JDL Extensions • Compatible • Best Effort Approachfor Failures / Problems • Improved Job Startup Time CoreGrid Summer School, Budapest, 7.9.2007

12. PACX-MPI MPI-START PACX-MPI LAM/MPI LA-MPI FT-MPI MPI Support • OpenMPI • Joint Effort / OSS • Best of FT-MPI, LA-MPI, LAM-MPI, PACX-MPI • PACX-MPI • Inter-Cluster / Site • Supports Vendor-MPI • MPI-Start • Shell Scripts • Abstraction LayerWMS / Schedulers and MPI-Implementations • Flexibility (relocateable Shellscripts) CoreGrid Summer School, Budapest, 7.9.2007

13. Active Security • Security measures for interactive framework • Active Security Tools: • Track Grid Interactions • Respond to Unwanted Security Events • Extended Security Monitoring & Tracking • Coordination among Security Tools & Sites • Architecture Divided in 2 Layers • Monitoring & Control Layer • Security Monitoring & Control Engine • Analysis Layer • Alert Analysis • Alert Correlation Engine • R-GMA • Communication Layer CoreGrid Summer School, Budapest, 7.9.2007

14. Integration • Most Advanced: Fusion Application – Integrates Components from JRA • MPI Support • Crossbroker • Visualization • Videostreaming • GUI Support • Interactivity CoreGrid Summer School, Budapest, 7.9.2007

15. Interactivity & Visualization • i2glogin • GVid • CrossBroker • Migrating Desktop • Full Integration + MPI Support CoreGrid Summer School, Budapest, 7.9.2007

16. Integration: Fusion Application • Application is integrated in Migrating Desktop • Communication Channel to MPI Master over the Roaming Access Server • Communication MD – RAS can also go over TCP/IP CoreGrid Summer School, Budapest, 7.9.2007

17. The i2g Infrastructure • 12 Sites • 430 CPU Cores • 21 TB of Storage • Multiple Architectures • i2g MiddlewareComponentsavailable forApplications CoreGrid Summer School, Budapest, 7.9.2007

18. The i2g Infrastructure (Production) CoreGrid Summer School, Budapest, 7.9.2007

19. i2g Applications • Plasma Fusion Simulation & Visualization • First Images of the Universe • Brain Diagnostic • Control of Pollution • … CoreGrid Summer School, Budapest, 7.9.2007

20. Interactive Plasma Fusion Simulation • Most Advanced Application • MPI-Parallel Simulation • Remote Visualization • Full Interaction (GUI, Mouse) • GUI Integration • Distinguished as best Application Demo at OGF in Manchester CoreGrid Summer School, Budapest, 7.9.2007

21. Fusion Application in MD CoreGrid Summer School, Budapest, 7.9.2007

22. First Images of the Universe • Simulation of the Measurements of the Planck Satellite to be launched in 2008. • Model Validation • Radiation Values should have Gaussian Distribution • If not, Model Error • Calculating Autocorrelations: • Sky gets divided • 100000 Simulations, 5 Minutes each • Output gets visualized CoreGrid Summer School, Budapest, 7.9.2007

23. Brain Diagnostic • Developing and Testing new Diagnostic Methods for Brain Images • Requires large Datasets • DICOM Images • Corresponding Brain Maps • Final Diagnostic Map • E.g. Perfusion Studies (Stroke Diagnosis) • Visualization and Annotation CoreGrid Summer School, Budapest, 7.9.2007

24. Control of Pollution • Developing of a Model Suite to analyze the Evolution of Pollution Clouds. • Compute Intensive Models • Interaction enables steering of Simulation Parameters • Impact Analysis • MPI-Parallel Simulation CoreGrid Summer School, Budapest, 7.9.2007

25. Support for external developers and users’ applications Education Disseminative materials Grid infrastructure i2g Offer The Interactive European Grid project helps application developers in adapting their applications to work in a Grid environment as well as in parallelization of these applications. If you would like us to consider running your application in the int.eu.grid infrastructure or creating a new VO,please contact: Isabel CamposIFCA-CSIC*, Santander, Spain email: iscampos AT ifca.unican.es Tutorials: for Grid beginners, Grid site administrators, application developers; some tutorials on MPI and other Grid specific. If you would like to join the tutorial organized at our site or to organize our tutorial at your facilities, please contact: Celso Martínez RiveroIFCA-CSIC, Santander, Spain email:mrivero AT ifca.unican.es The Project helps to integrate new clusters to the int.eu.grid infrastructure as well as to establish agreements between research communities and infrastructure providers. If you would like to join the int.eu.grid infrastructure with your cluster,please contact: Project support team email: i2g.support AT lip.pt Seminars for groups of interested people or consultancy. If you need a consultancy or you are interested in taking part in a seminar on Grid technology,please contact: Project Office Santander, Spain email: inteugrid-office AT ifca.unican.es specifying the subject, product or problem. General information aboutthe Project – brochures, posters, etc. General int.eu.grid presentation. If you are interested in receiving them,please contact: Robert Pajak CYFRONET*, Kraków, Poland email: r.pajak AT cyfronet.krakow.pl CoreGrid Summer School, Budapest, 7.9.2007

26. New Applications? • http://dissemination.interactive-grid.eu/how_to_use_grid • Description of interactive tools • Use our infrastructure for your application • Online user questionaire • http://dissemination.interactive-grid.eu/how_to_use_grid/user_questionnaire/ • User Data form • Our offer (infrastructure, tools, …) CoreGrid Summer School, Budapest, 7.9.2007

27. i2g Information & Contact • http://www.interactive-grid.eu • http://dissemination.interactive-grid.eu • Brochures, Posters, Information ... • Contact Persons: • (New) Applications:Isabel Campos; iscampos@ifca.unican.es • (New) Infrastructure:i2g.support@lip.pt • Tutorials:Celso Martinez Rivero; mrivero@ifca.unican.es • Seminars:Project Office; inteugrid-office@ifca.unican.es CoreGrid Summer School, Budapest, 7.9.2007