EU DataGrid Testbed

1. EU DataGrid Testbed • EU DataGrid • Software releases • Testbed 1 Job Lifecycle • Authorisation at your site • More EDG and TB information Andrew McNab - Manchester HEP - 22 April 2002

2. EU DataGrid • Officially started 1st January 2001 • Partners: CERN, CNRS, ESA, INFN, NIKHEF, PPARC • Other contributions from HEP institutes (eg in NorduGrid countries) and other Grid projects (eg core UK e-Science) • Management and software organised into Work Packages: • WP1 Resource Management (“job submission”) • WP2 Data Management • WP3 Information and Monitoring Services • WP4 Fabric Management (eg local installation and management tools) • WP5 Mass Storage • WP6 Testbeds (include Integration and support for the Testbed grid.) • WP7 Networking • WP8,9,10 Applications Andrew McNab - Manchester HEP - 22 April 2002

3. Software Releases • Have 3 major releases to coincide with three yearly Testbeds 1, 2 and 3 • Have minor releases every 2 months, and then patch level releases between those: currently at 1.1.4 (deployed last week) • Currently, the only supported platform is RedHat 6.2 on Intel. • Software is stored in a central CVS and published via a public HTTP server (http://datagrid.in2p3.fr) in RPM format. • This includes EDG-authored software, a distribution of Globus (contributed by GridPP) and any external packages and updates not included in out-of-the-box RedHat 6.2. • The official installation procedure is to use LCFG, contributed by Edinburgh and customised by WP4. • Once an LCFG server is working at your site, installation of testbed machines is automated (rather like RedHat kickstart.) See Steve’s talk for details. Andrew McNab - Manchester HEP - 22 April 2002

4. Andrew McNab - Manchester HEP - 22 April 2002

5. Authorisation at your site • a.k.a “how do I maintain the list of certificate names (people) that can use my Testbed site?” • WP6 provides a standard way of publishing lists of certificate names via an LDAP server, and selecting subsets based on group or “Virtual Organisation” (eg experiment) affiliation. • gridmapdir patch to Globus provides dynamic user account allocation from a pool. • Each LHC experiment maintains a “VO Server” and populates it with the DNs of their members. • VO’s also exist for WP6, BaBar and GridPP. Andrew McNab - Manchester HEP - 22 April 2002

6. More information • Main EDG site is http://www.eu-datagrid.org/ • each Work Package has a website, usually with documents, mailing list archives etc about its software. • WP6 Testbed information at http://marianne.in2p3.fr/ • includes links to software repository, User and Installation Guides, bug tracking Bugzilla etc. • UK Testbed support: http://www.gridpp.ac.uk/tb-support/ • has info about tb-support@jiscmail.ac.uk mailing list, Steve’s notes about LCFG and other practical information. Andrew McNab - Manchester HEP - 22 April 2002

7. Summary • EDG producing middleware components as part of a consistent distribution for testbed sites. • Situation evolving rapidly, but central aim of job submission “to the Grid” via a Resource Broker is working. • Software available to interested sites, and web and mailing list resources exist for support. • See following talks for details. Andrew McNab - Manchester HEP - 22 April 2002

8. UK Rollout and Support Plan • Aim of this talk is to the answer question “As a site admin, what are the steps between the situation today, and all interested UK sites being part of the Testbed.” • Definite predictions limited by uncertain nature of the releases. Andrew McNab - Manchester HEP - 22 April 2002

9. “Constituencies” • Sysadmins (represented in “Sysman” and by WP6) • Care about the integrity of their site (firewalls etc) and the maintenance load of Grid Testbed equipment; may be under pressure to get a “green dot” on the relevant map. • Experiments (represented by GridPP EB) • Want sites up and running for application development and to run data challenges. Esp. concerned about sites hosting their farms. • Grid developers (represented by GridPP TB) • Concerned about getting functionality running in UK, esp. at sites where experts are. • Local HEP groups (represented on GridPP CB) • Want a transparent process that includes everyone. Andrew McNab - Manchester HEP - 22 April 2002

10. UK Deployment Plan • Start with UK WP6 people (+ other key experts) • Use tb-support@jiscmail.ac.uk mailing list, which anyone can join and is archived. • Once have some WP6 sites up and a procedure that should work for any site, then ask more sites to test installation procedure, docs etc. • Once this has stabilised, invite all interested sites to install Testbed software. • By this point, installation instuctions should be clear and not require previous grid experience, ad-hoc fixes etc. • Support will then be provided by tb-support mailing list on best-effort basis and Grid Support Centre with a formal ticket-based system. • (Likely that mailing list will be best place to get a quick answer.) • Need to repeat this every 2 months for EDG releases, although not all sites may have commitments (eg from experiments) to do this. Andrew McNab - Manchester HEP - 22 April 2002

11. Testbed Joining Procedure • Procedure for joining EDG testbed is being defined by WP6. • For UK sites, WP6 UK will propose sites to rest of WP6. • WP6-UK will provide help with testing UK sites: • Have GridPP VO, Resource Broker and MDS so can add sites to UK Testbed and validate functionality ourselves before trying in the EDG Testbed. • We don’t want to propose sites without testing them ourselves; and cautious sites can put themselves up for validation within GridPP without risking “embarrassment” at a European level. • Will use same validation criteria as WP6. Andrew McNab - Manchester HEP - 22 April 2002

12. Installation Procedure • This needs to be based around LCFG because of complex configuration process, which is published as automatic LCFG configuration objects. • Sites will almost certainly need to dedicate machines to be installed this way. • LCFG itself has been non-trivial to install and configure. • However, once your local LCFG server is working, installing CE etc is automated (similar to RedHat kickstart.) • Steve has been installing LCFG at RAL and has written up the procedure. Also contributed updated scripts back to WP6. So the situation is much better now. Andrew McNab - Manchester HEP - 22 April 2002

13. More information • EDG Testbed talk from earlier today. • WP6 website at http://marianne.in2p3.fr/ • GridPP Technical Board http://www.gridpp.ac.uk/tb/ • tb-support@jiscmail.ac.uk mailing list • http://www.gridpp.ac.uk/tb-support/ has: • mailing list information • Steve’s recipe for LCFG-installing Computing Element, Storage Element, User Interface machine and Worker Node. Andrew McNab - Manchester HEP - 22 April 2002

14. Summary • UK Deployment Plan largely defined • but depends on timing and quality of EDG releases • Testbed joining procedure defined • aim to use UK resources to smooth path for UK sites to join EDG Testbed. • Deployment to non-expert sites largely limited by current installation procedures • this has improved a lot and is pretty much ready to go. Andrew McNab - Manchester HEP - 22 April 2002