NA4 Progress

1. NA4 Progress PSC07Zabljak, 22-23 February 2010 Cevat Sener Dept. of Computer Engineering METU, Ankara sener@ceng.metu.edu.tr The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

2. Activities • NA4.1 Study the Grid applications • NA4.2 Adapt Grid applications • NA4.3 Support the deployed applications • NA4.4 Assess applications Grid usage and take-up

3. Deliverables • DNA4.1 Target applications analysis • DNA4.2 Application deployment and support • DNA4.3 Porting guidelines for target scientific fields • DNA4.4 User community engagement and applications assessment

4. Milestones • MNA4.1 Regional applications analysed [PM04] • Means of verification: DNA4.1 Target applications analysis • MNA4.2 Three core user groups’ applications running on the regional Grid [PM24] • Means of verification: DNA4.4 User community engagement and applications assessment + Demonstration at review

5. Review Recommendations • “In the second year of the project, the partners will need to place more emphasis on dissemination of the scientific outputs from the project. • Deliverable NA4.4 due in M24, User Community Engagement and Applications Assessment, should signpost: the new science / new capabilities developed by the project; how the scientific state of the art has been advanced by the project; how the grid has helped advance the science base. • In addition, it will be important to point to scientific papers produced by the project that have appeared in refereed conferences/journals outside the grid community in the scientific field of interest.”

6. Gridification Status • Almost all in “Deployed in Production” ! • Extension to GreenView: EnviMon from MD – Also “Deployed in Production” • CHERS– in “Developed Grid-mode”– almost ready for “Testing Grid-mode” • ROMS– in “Testing Grid-mode”

7. Web Pages / Wiki Sections • All applications are supposed to have a web page or a wiki section – In case of a web page, there should be a link from the wiki • These, especially, should make improvements asap: • MCSAES, CHERS, MSACM, MSERRHSA, CCIAQ, ROMS, • GreenView (missing info on EnviMon), • Lizza-PAKP (link broken on the wiki) – But, all need to consider the check-list for the content: • Scientific model implemented • User documentation*: guide, licensing info, ... • Description of JRA1 AS/OT usage * Suggested to use the format given in “2.4.2. User Documentation” of “Deliverable JRA1.3 – Application services design report”

8. Application Dissemination • Scientific publications (incl. submissions) within PY2 • CHERS: 1+1, GreenView: 10+0, Lizza-PAKP:1+0, ROMS:0+1, BG Apps:10+2 => Total for Envo: 22+4 • WRF-ARW: 3+1, REFS: 4+0 => Total for Meteo: 7+1 • ELF: 1+0, FPS:1+1, SDS: 3+1, SRA: 1+3, MDSSP-WA: 1+1, NMMC3D: 2+1 => Total for Seismo: 9+7 • a+b means 'published/just submitted' + 'near-future plan' – More emphasis should be given to publications! • List of scientific events & journals to be announced (and then kept updated) by VOs in order to guide members • Achieved only by Seismo VO, so far, at http://erciyes.cmpe.boun.edu.tr/seegridsci/scipub

9. Application Accounting Collaborators in VOMS Groups • VOMS groups are ready for all applications • Some collaborators still not registered, eg., • Ljupco Jordanovski to MDSSP-WA • BG partners to SRA • ME and GE partners to REFS • Application developers should check if all collaborators are registered to the applications' VOMS groups; • When such exists, VOMS admin should be contacted • Note: Regional collaborators in ROMS !

10. Application Accounting Number of Jobs • – See the file Accounting_22.02.2010.xls –

11. Application Accounting Base CPU Time • – See the file Accounting_22.02.2010.xls –

12. Application Accounting • Other applications not seen on the output • Differences between VO totals of per-application accounting and per-VO accounting numbers? • Some sites not publishing the accounting data have been identified – Could any other such site exist? • All zero: CHERS, ROMS, SDA • WRF-ARW + WRF-ARW/Role=developer ?

13. PM24 Metrics • All are met for all Vos • Number of applications deployed • Number of users • Number of countries involved • Number of research groups involved • Except • Number of users for Meteo VO • Expected: 35, Now: 30

14. GENESI-DR InteractionBackground • GENESI-DR works on defining and developing data policies and tools to support the data and service access. • There are two tendencies among partners GENESI-DR partners on data policy: • To make public the spatial data, especially for EC projects, education and research (e.g. GMES, GEO) • To make data private and to require particular license (e.g. RapidEye, JRC – by individual contract) • Combination of the first two solution (e.g. ESA)

15. GENESI-DR InteractionStatus • SEE-GRID-SCI uses just the public data and services provided by GENESI-DR, available as batch files. • SEE-GRID-SCI continues to make experiments on functional development and performance evaluation of tools and services considering data availability, format, dimension, location, etc. • GENESI-DR does not provide yet data we require in production. • SEE-GRID-SCI has made a proposal to GENESI-DR to develop and provide a set of pilot data repositories to be available for the development of the SEE-GRID-SCI applications. • The pilot repositories are resident on the sites of GENESI-DR data providers. • Data could be accessed through secured ways and policy (i.e. certificates to access Portal and distributed repositories), as any other production data.

16. DNA4.3 and GG@wiki • Gridification Guideline updates (reflecting the information contained in DNA4.3) should be completed by the relevant contributors of DNA4.3 by 15 March 2010. • To be guided/followed by Davor.

17. EGEE APPDB • Taken from “http://appdb.eu-egee.org” • EGEE Regional Support Applications Registry • This registry is the central point for gathering and providing information about the scientific applications deployed in EGEE, exploiting the project's international Grid infrastructure. • If you are interested in adding your application in the Regional Applications Database, please contact the team responsible for your region: “project-eu-egee-na4-see@cern.ch”

18. NA4.4 • Task NA4.4 - “Assess of the application and takeup” • Assesses and quantifies the applications usage of the infrastructure, and application take-up in the community, • Finish with the deliverable DNA4.4 [PM24] • Leader: RBI • Working plan: • Accounting, for every application – the number of jobs, total CPU time, based time, • Per country application accounting (at least for the countries that are involved in the application development) - CPU time, based time, number of jobs, • Per country engagement – number of jobs, CPU based time, CPU time • Total application usage per VO (summary of the application accounting) • Raw accounting data could be very useful!

19. DNA4.4 • DNA4.4 – “User community engagement and application assessment” [PM24] • Final and overall assessment of the involvement of the end-user community and application usage and take-up in the project • Editor: RBI • What is to be reported? • Application aims and benefits – description of the VOs (env,meteo,seismo), social and scientific benefits per VO, social benefits • Summary of user community involvment – number of users, country distribution, number of user per VO, • Summary of international collaboration – other project with MoU, VOs, national VOs and other user groups, user community established between the project partners

20. DNA4.4 (2) • Proposed structure for application assessment, per VO, per application • Application • Short description • Usage scenario • New scientific results – new capabilities developed within the project, scientific stat of the art advances, how the grid has helped advance the science base • Scientific/social impact of the application (?) • Overall user community and end-user involvement • Application status on the grid • Resource & requirements • Developed by / Collaborations

21. DNA4.4 (3) • Analyzing the usage of the SEE-GRID infrastructure • Analysis per scientific field – number of jobs, CPU time, based time • Analysis per application • Infrastructure usage by the applications • Analysis per country engagement • Summary of infrastructure requirements

22. Action • Existing APs on the followings are still valid with updates: • Scientific (most preferably, refereed) publications • Extended papers from UF to ESI – deadline 28 Feb'10 • ISTGW submissions • User community enlargement • Collaborations with other researchers, projects, applications • Use of VOMS roles • Registering collaborators to application's VOMS group • List of scientific events and journals by VOs • Web pages / Wiki sections with (i) Scientific model implemented, (ii) User documentation*, (iii) Description of JRA1 AS/OT usage*: for the user documentation, the format given in “2.4.2. User Documentation” of DJRA1.3 is highly suggested • Updating Gridification Guide at wiki till 15.03.2010 – to be followed by Davor

23. Action • New APs: • Meteo VO to note: (i) PM24 metric 'number of users' not met yet and (ii) REFS accounting+WRF-ARW accounting<<Meteo VO accounting • CHERS and ROMS to be deployed in production asap • Lizza PAKP and NMMC3D to investigate the accounting issues • BBmSAM to start submitting tests with Envo VO credentials – towards end of project • Complete the gridification of EnviMon and its integration with GreenView (incl. info on the web/wiki) • MDSSP-WA to have the final version for production • SRA application will work on getting input data from other countries like MK, MD, BG. • SDSAS source version control by C.Ozturan • Format of the AL earthquake data to be corrected

24. Action • New APs (cnt'd): • ToC for DNA4.4 is to be finalized and contributions to the deliverable to be collected by Davor. Need to cover both the technical and scientific points of view. • Developers consider adding their applications to EGEE APPDB at “http://appdb.eu-egee.org” • SEE-GRID-SCI logo to put on the applications' web pages • Classification of NA4 publications as Grid and non-Grid