1 / 14

EU DataGrid Data Management Workpackage : WP2 Status and Plans

EU DataGrid Data Management Workpackage : WP2 Status and Plans. Peter Z Kunszt IT/DB http://cern.ch/grid-data-management/ EU Datagrid Conference Piliscsaba/Hungary. Outline. WP2: Tasks and Constituency Task status Replication Metadata Optimization Security Plans Issues.

aadi
Download Presentation

EU DataGrid Data Management Workpackage : WP2 Status and Plans

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. EU DataGrid Data Management Workpackage : WP2Status and Plans Peter Z Kunszt IT/DB http://cern.ch/grid-data-management/EU Datagrid Conference Piliscsaba/Hungary DGC5 4.9.2002

  2. Outline • WP2: Tasks and Constituency • Task status • Replication • Metadata • Optimization • Security • Plans • Issues DGC5 4.9.2002

  3. Data Management Tasks • Data Transfer Efficient, secure and reliable transfer of data between sites • Data Replication Replicate data consistently across sites • Data Access Optimization Optimize data access using replication and remote open • Data Access Control Authentication, ownership, access rights on data • Metadata Storage Grid-wide persistent metadata store for all kinds of Grid information DGC5 4.9.2002

  4. Current Constituency • CERN Peter Kunszt, Heinz Stockinger, Leanne Guy, Diana Bosio, Akos Frohner, Wolfgang Hoschek, Kurt Stockinger • INFNFlavia Donno, Andrea Domenici, Livio Salconi, Giuseppe Andronico, Federico Di Carlo, Marco Serra • PPARCGavin McCance, WilliamBell, David Cameron, Paul Millar • Trento Cultural InstituteRuben Carvajal Schiaffino, Luciano Serafini, Floriano Zini • U.Helsinki/CSCMika Silander, Joni Hahkala, Ville Nenonen, Niklas Karlsson • KDC StockholmOlle Mulmo, Gian Luca Volpato DGC5 4.9.2002

  5. Additional Resources, collaborators • LCG:Erwin Laure, Itzhak Ben-Akiva, James Casey • PPDG: Andy Hanushevsky • Condor: Alain Roy • NorduGrid: Aleksandr Konstantinov • Globus/ISI: Ann Chervenak, Bob Schwarzkopf DGC5 4.9.2002

  6. Current Status • Replication: edg-replica-catalog – deployed • GSI version available. • Graphical User Interface available. • Replication: edg-replica-manager – deployed • Atomic replication operations. • This component should be used for data management tests. • Replication: GDMP – deployed • More complex subscription-based functionality. • Has been tested and is proven to work. • Can be ‘abused’ to provide the same functionality as edg-replica-manager but it is overkill and much harder to do. • Metadata Storage: SQL Database ServiceSpitfire – deployed • Servlets on HTTP(S) with XML (XSQL) • GSI enabled access + extensions • Optimization: Replica Selection OptorSim – working DGC5 4.9.2002

  7. Current Status (cont.) • Replication: Replica Location Service – deployable • Joint Globus – EDG development • Unit and performance tests successful • Distributed Replica Catalog service • Graphical User Interface available. • Security: edg-security – in testing • Security for Web Services • Metadata Storage: SQL Database ServiceSpitfire – in testing • Web Service interface over SOAP • Security through edg-security and proper local authorization • Secure data browser through a web interface • Replication: Replica Manager Reptor – in testing and development • Optimization: Replica Selection Optor – in testing and development • Replication: Replica Metadata Catalog Repmec – in testing and development • Security: edg-voms – in development, joint effort with WP6, WP7 DGC5 4.9.2002

  8. WP2 Strategy for 1.2 • Integrate a single-instance RLS into TB1.2 (replacement for edg-replica-catalog) • Integrate RLS into edg-replica-manager and GDMP • Focus users away from GDMP and towards edg-replica-manager for simple data management use cases. • Increment stability and usability of edg-replica-manager • Configuration • Simplify configuration and build system of deployed components • Unify build for all components, adopt edg-standards • Testing • Large effort on unit testing and functionality tests inside WP2 for all components. • Close interaction with ITeam and the new testing group DGC5 4.9.2002

  9. Towards Testbed 2 • Focus away from GDMP • Introduction of Reptor (‘refactorization of GDMP’) • Initially with identical functionality • Incremental and controlled addition of requested functionality • Use R-GMA for information gathering and publishing • edg-replica-manager will stay as a command-line interface to Reptor, easy migration for users • Security: work towards new security model with VOMS and local authorization. • Documentation: • Guides • Examples, How-to • Tutorials DGC5 4.9.2002

  10. Progress in WP2 Workshop • Application of the conclusions of the Retreat towards the WP2 Strategy • Reallocation of resources according to the strategy. • Re-focus Development • Detailed workplan for the next incremental releases. • Better understanding of the technical issues, interoperation of components. DGC5 4.9.2002

  11. Progress in this Conference • Joint session with WP5 • Agreement to continue with current solution in GDMP, will be used in edg-replica-manager as well • WP5 will produce a prototype service by the end of September. These services will be used by Reptor. • Close collaboration to make MSS access for Atlas successful. • Joint session with WP10 • Control flow, Metadata requirements • Security requirements • Close collaboration on deploying a WP10 metadata catalog. DGC5 4.9.2002

  12. Progress in this Conference • Interaction with WP3 • Agreement on usage of edg-security module for R-GMA • Joint session with WP1-4-5 • Agreement on the Zamboni daemon for worker node storage administration. Joint development of WP1-2-4 • Joint session with applications WP8-9-10 • Detailed feedback on current status was very useful. • We have taken the conclusions to heart in our current strategy. DGC5 4.9.2002

  13. Issues • Testing on the ‘real’ testbed. • Dependencies upon components by other WPs need to be understood so that we will have a good release plan • Optimizing Communication DGC5 4.9.2002

  14. Thank you for your Attention DGC5 4.9.2002

More Related