1 / 45

SEE-GRID and EGEE Portal applications

SEE-GRID and EGEE Portal applications. M. Kozlovszky, A. Balasko Computer and Automation Research Institute of the Hungarian Academy of Sciences PUCOWO, Zurich, Switzerland 10-11/06/2010. www.lpds.sztaki.hu. Content. SEE-GRID-SCI Tools & Applications Tools

luke
Download Presentation

SEE-GRID and EGEE Portal applications

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SEE-GRID and EGEE Portal applications M. Kozlovszky, A. Balasko Computer and Automation Research Institute of the Hungarian Academy of Sciences PUCOWO,Zurich, Switzerland 10-11/06/2010 www.lpds.sztaki.hu

  2. Content • SEE-GRID-SCI Tools & Applications • Tools • USGIME - User specific grid infrastructure monitoring extension • CWRE - Workflow Repository • Applications • NMMC3D • SRA • SEE-GRID2 Applications • FEM2.5D • EMMIL • EGEE Applications • OMNeT++ • ABC, MPI-FD-FDTD, ...

  3. Content • SEE-GRID-SCI Tools & Applications • Tools • USGIME - User specific grid infrastructure monitoring extension • CWRE - Workflow Repository • Applications • NMMC3D • SRA • SEE-GRID2 Applications • FEM2.5D • EMMIL • EGEE Applications • OMNeT++ • ABC, MPI-FD-FDTD, TINKER, ...

  4. USGIME - User/application specific grid infrastructure monitoring extension of P-GRADE Portal • Aim: Allow users of P-GRADE Portal to test: • The validity of their own certificate • Accessibity between • Computing Elements • Storage Elements (using Remote Files and Logical File Catalog) • Solution: portlet development with new functionalities • Functions: shows availability/compatibility of specified resources or makes query of the whole grid infrastructure (from user point of view). • Advantage: Always up-to-date information about the infrastructure for developers/end users. • Targeted: mainly end users and not grid administrators • Gridification: • LPDS @ SZTAKI • Used special feature: Google visualization toolkit • More detailed information http://wiki.egee-see.org/index.php/JRA1_Commonalities#USGIME_.28User.2Fapplication_specific_grid_infrastructure_monitoring_extension_of_P-GRADE_Portal.29

  5. Usage scenario + List of Computing Elements,and Storage Elements P-GRADE Portal 2.7 List of SEs Pre-developed workflow Job generation is done from CE-list

  6. Implemented GUI 1/3

  7. Implemented GUI 2/3

  8. Implemented GUI 3/3

  9. DSpace repository End-users Portal Portal Portal App developers CWRE - Common Workflow Repository Extension • Aim: to make available workflow applications for the whole P-GRADE portal user community • Solution: Integrating P-GRADE portal with DSpace repository • Functions: • App developers can publish their ready-to-use and half-made applications in the repository • End-userscan download, parameterize and execute the applications stored in the repository • Advantage: • Appl. developers can collaborate with appl. developers and with end-users • Portal user community members can share their WFs • Different portal user communities can share their WFs • Gridification: LPDS @ SZTAKI, WPI /US/ • DSpace was developed by HP and MIT Libraries (http://www.dspace.org.) • More detailed information • http://wiki.egee-see.org/index.php/JRA1_Commonalities#CWRE_.28Common_Workflow_Repository_Extension_of_P-GRADE_Portal.29

  10. New portlets • DSpace View • DSpace Download • DSpace Upload

  11. Upload WF to DSpace Download WF from DSpace Integrating P-GRADE portal with DSpace repository DSpace Repository

  12. Content • SEE-GRID-SCI Tools & Applications • Tools • USGIME • CWRE • Applications • NMMC3D • SRA • SEE-GRID2 Applications • FEM2.5D • EMMIL • EGEE Applications • OMNeT++ • ABC, MPI-FD-FDTD, TINKER, ...

  13. Seismo VO’s applications NMMC3D -Numerical Modeling of Mantle Convection MDSSP-WA –process and analysis of seismic signals SRA - Seismic Risk Assessment ELF –Earthquake Location finder = P-GRADE portal was used during development "We shape our buildings, and afterwards our buildings shape us” -- Churchill

  14. NMMC3D - Numerical Modeling of Mantle Convection • Aim: better understand the influences of parameters on the behavior of upwellings. • Function: The application solves the equations of thermal convection with a partly finite difference, partly spectral scheme. • Gridification: • GGRI /Geodetic and Geophysical Research Institute/ • LPDS @ SZTAKI • Bogazici University /Turkey/ • Important used/developed features • Application specific complex portlet structure • Embedded picture rendering service • Parameter Study type solution • More detailed information http://www.lpds.sztaki.hu/gasuc/index.php?m=7&s=16

  15. NMMC3D – application profile and Workflow structure • Fortran based binaries • No internal communication • Small input size (1MB) • Moderate large output size (100MB) • Output rendered by external application (embedded visualization) • End users are able to configure parameter • Extra parameter configuration and submission portlet for end-user • Workflow structure: • 1 Autogenerator • 1 Parameter Study job • 5 direct input parameters + one generated parameter • 1 binary in the PSJob

  16. Application output Example result file converted to an image

  17. SRA -Seismic Risk Assessment • Aim: • Application for public safety and hazards mitigation. • Gridification: • METU /Ankara, Turkey/ • Important used/developed features • Application specific portlet • Embedded Google maps • Embedded picture rendering service • Parameter Study solution • More detailed information http://wiki.egee-see.org/index.php/SRA_gridification_guide

  18. SRA: Seismic Risk Assessment • developed as a portlet • Google-powered map

  19. Content • SEE-GRID-SCI Tools & Applications • Tools • USGIME • CWRE • Applications • NMMC3D • SRA • SEE-GRID2 Applications • FEM2.5D • EMMIL • EGEE Applications • OMNeT++ • ABC, MPI-FD-FDTD, TINKER, ...

  20. FEM2.5D • Aim: Finite difference (FD) modeling (for solving partial differential equations). • Gridification: • Miskolc University • LPDS @ SZTAKI support • Important used/developed features • Application specific portlet for end users • Embedded picture rendering service • Parameter Study type solution • More detailed information http://www.lpds.sztaki.hu/gasuc/index.php?m=7&s=2

  21. FEM 2.5D end-user GUI and workflow output

  22. EMMIL : E-Marketplace Model Integrated with Logistics • Aim: Supply chain efficiency improvement with numerical model. Three sided negotiation between: • Buyers • Sellers • Third party logistics providers • Gridification: • IBS /International Business School/ • LPDS @ SZTAKI support • Important used/developed features • Application specific portlets • Embedded Google maps • Embedded picture rendering service • Parameter Study type solution • Complex independent user views • More detailed information • http://www.lpds.sztaki.hu/gasuc/index.php?m=7&s=1

  23. EMMIL Workflow structure GEN Grid job: parameter field generator SEQ SEQ SEQ SEQ Parameter study grid jobs P-GRADE Portal COLL Collector

  24. Profile Page Every user has its own Profile

  25. Buyer: Product Management

  26. Buyer: Create new Auction

  27. List of available Auctions

  28. 3PL’s bid taking

  29. Downloading Results

  30. Set up the most optimal supplier chain Log in as buyer supplier, or logistic service provider. Create auctions or take your bids Best buyer-seller-logistic service provider pairs discovered, result presented in an Excel file Download rendered images Parameter study optimization workflow is automatically generated and executed EMMIL P-GRADE Procurement Portal views

  31. Results EMMIL P-GRADE Procurement Portal • Buyers profile • Buyer’s product management • Buyer starts new auction • Supplier places bid • Supplier auction is closing • 3PL places bid • 3PL auction is closing

  32. Content • SEE-GRID-SCI Tools & Applications • Tools • USGIME • CWRE • Applications • NMMC3D • SRA • SEE-GRID2 Applications • FEM2.5D • EMMIL • EGEE Applications • OMNeT++ • ABC, MPI-FD-FDTD, TINKER, ...

  33. OMNET++ OMNeT++ is a public-source, component-based, modular, discrete event simulation environment. • Aim: Use of grid infrastructure for computing network simulations, queuing network simulations • Gridification: • OpenSim Ltd. • LPDS @ SZTAKI • Important used/developed features • Application specific portlets • Parameter Study type solution • Parrot usage • Service like, easy-to-use login (non-gridsphere based authentication), captcha supported automatic user creation • More detailed information http://www.lpds.sztaki.hu/gasuc/index.php?m=6&r=4

  34. OMNET++ workflow

  35. Two types of OMNET portal usage OMNeT++ user portal • User accounts exist for 1 week • Can handle NED files that use INET and Queuing module sets from OMNeT++ • No binary come from end user • Portal does grid operations with one fixed certificate OMNeT++ developer portal • Permanent user accounts • Can handle custom OMNeT++ modules and NED files that handle such modules • Binaries come from end users • Users are authenticated based on their personal certificates

  36. OMNeT++ portal

  37. Other applications/services examples based on P-GRADE Portal • ABC - Solving the Schrodinger equation for triatomic systems using time independent method (Department of Chemistry, University of Perugia, Italy) • RWavePR - Solving the Schrodinger equation for triatomic systems using time dependent method (Department of Chemistry, University of Perugia, Italy) • MPI-FD-FDTD - Numerical modeling of ElectroMagnetic field distribution in human tissues (University of Manchester, United Kingdom) • TINKER Conformer Generator - Molecular modeling for QSAR studies for drug development with TINKER external library (LPDS @ SZTAKI) • …

  38. Thank you for your attention! Questions?

More Related