1 / 27

JRA1 Activity Feedback Frédéric Hemmer EGEE Middleware Manager and the JRA1 team

EGEE 1 st Conference, 22-Apr-2004. JRA1 Activity Feedback Frédéric Hemmer EGEE Middleware Manager and the JRA1 team. www.eu-egee.org. EGEE is a project funded by the European Union under contract IST-2003-508833. Outline. Status What has changed in Cork

kimberley-edwards
Download Presentation

JRA1 Activity Feedback Frédéric Hemmer EGEE Middleware Manager and the JRA1 team

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EGEE 1st Conference, 22-Apr-2004 JRA1 Activity FeedbackFrédéric HemmerEGEE Middleware Managerand the JRA1 team www.eu-egee.org EGEE is a project funded by the European Union under contract IST-2003-508833

  2. Outline • Status • What has changed in Cork • Important steps until next conference in November 2004 • Or rather end of 2004 – MJRA1.4: Release Candidate 1 • Summary EGEE 1st Conference, Cork, April 22, 2004 - 2

  3. STATUS EGEE 1st Conference, Cork, April 22, 2004 - 3

  4. Software Clusters • Tools, Testing & Integration (CERN) clusters • Development clusters: • UK • CERN • IT/CZ • Nordic • Clusters have a reasonable sized (distributed) development testbed • Taken over from EDG • Nordic cluster to be finalized • Milestone MJRA1.2 (PM3) almost reached now • Link with Integration & Tools clusters established • Clusters up and running! • Nordic (security) cluster  JRA3 EGEE 1st Conference, Cork, April 22, 2004 - 4

  5. Design Team • Formed in December 2003 • Current members: • UK: Steve Fisher • IT/CZ: Francesco Prelz • Nordic: David Groep • VDT: Miron Livny • CERN: Predrag Buncic, Peter Kunszt, Frederic Hemmer, Erwin Laure • Started service design based on component breakdown defined by the LCG ARDA RTAG • Leverage experiences and existing components from AliEn, VDT, and EDG. • A workingdocument • Overall design & API’s • https://edms.cern.ch/document/458972 • Basis for architecture (DJRA1.1) and design (DJRA1.2) document EGEE 1st Conference, Cork, April 22, 2004 - 5

  6. Initial prototype components for April’04 To be extended/ changed (e.g. WMS) • Access service: • AliEn shell, APIs • Information & Monitoring: • R-GMA • CE: • AliEn CE, Globus gatekeeper, CondorG • Security: • VOMS, myProxy • Workload mgmt: • AliEn task queue; • SE: • SRM (Castor), GridFTP, GFAL, aoid • File Transfer Service: • AliEn FTD • File and Replica Catalog: • AliEn File Catalog, RLS Towards a prototype • Focus on key services; exploit existing components • Initially an ad-hoc installation at Cern and Wisconsin • Aim to have first instance ready by end of April • Open only to a small user community • Expect frequent changes (also API changes) based on user feedback and integration of further services • Enter a rapid feedback cycle • Continue with the design of remaining services • Enrich/harden existing services based on early user/operations feedback This is not a release! It’s purely an ad-hoc installation EGEE 1st Conference, Cork, April 22, 2004 - 6

  7. Integration • A master Software Configuration Plan is being finalized now • It contains basic principles and rules about the various areas of SCM and Integration (version control, release management, build systems, bug tracking, etc) • Compliant with internationally agreed standards (ISO 10007-2003 E, IEEE SCM Guidelines series) • Most EGEE stakeholders have already been involved in the process to make sure everybody is aware of, contributes to and uses the plan • An EGEE JRA1 Developer's Guide will follow shortly in collaboration with JRA2 (Quality Assurance) based on the SCM Plan • It is of paramount importance to deliver the plan and guide as early as possible in the project lifetime EGEE 1st Conference, Cork, April 22, 2004 - 7

  8. SCM Contents • SCM and Integration Implementation • Configuration and Version Control • Build Systems • Release Process • Other Configuration and Change Control Procedures • Solid steps towards MJRA1.3 (PM5) EGEE 1st Conference, Cork, April 22, 2004 - 8

  9. Testing • The 3 initial testing sites are CERN, NIKHEF and RAL • More sites can join the testing activity at a later stage ! • Must fulfil site requirements • Testing activities will be driven by the test plan document • Test plan being developed based on user requirements documents: • Application requirements from NA4: HEPCAL I&II, AWG documents, Bio-informatics requirements documents from EDG • Deployment requirements being discussed with SA1 • ARDA working document for core Grid services • Security: work with JRA3 to design and plan security testing • The test plan is a living document: it will evolve to remain consistent with the evolution of the software • Coordination with NA4 testing and external groups (e.g. Globus) established • Solid steps towards MJRA1.3 (PM5) EGEE 1st Conference, Cork, April 22, 2004 - 9

  10. Resources indicators EGEE 1st Conference, Cork, April 22, 2004 - 10

  11. Execution Plan • Work Breakdown Structure defined • Document needs to be completed EGEE 1st Conference, Cork, April 22, 2004 - 11

  12. Achievements in Cork EGEE 1st Conference, Cork, April 22, 2004 - 12

  13. UK IT/CZ UK CERN IT/CZ CERN Clusters Responsibilities Nordic EGEE 1st Conference, Cork, April 22, 2004 - 13

  14. Planning • Evolution of the prototype • Envisaged status at end of 2004: • Key services need to fulfill all requirements (application, operation, quality, security, …) and form a deployable release • Remaining services available as prototype • Need to develop a roadmap • Incremental changes to prototype (where possible) • Early user feedback through ARDA and early deployment on SA1 pre-production service • Detailed release plan being planned • Converge prototype work with integration & testing activities • Need to get rolling now! • First components will start using SCM in May EGEE 1st Conference, Cork, April 22, 2004 - 14

  15. Guiding Principles • Lightweight (existing) services • Easily and quickly deployable • Interoperability • Allow for multiple implementations • Resilience and Fault Tolerance • Co-existence with deployed infrastructure • Run as an application • Service oriented approach • Follow WSRF standardization • No mature WSRF implementations exist to date, hence: start with plain WS – WSRF compliance is not an immediate goal • Review situation end 2004 EGEE 1st Conference, Cork, April 22, 2004 - 15

  16. JRA1/SA1 - Process description • No official delivery of requirements from SA1 to JRA1 stated in the TA • The definition, discussion and agreement of the requirements has already started, done through dedicated meetings • This is an ongoing process: • Not all the requirements defined yet • Set of requirements agreed, need basic agreement to start working! But can be reviewed at any time there is a valid reason for it EGEE 1st Conference, Cork, April 22, 2004 - 16

  17. JRA1/SA1 - Requirements • Middleware delivery to SA1 • Release management • Deployment scenarios • Middleware configuration • JRA1 will provide a standard set of configuration files and documentation with examples that SA1 can use to design tools. Format to be agreed between SA1-JRA1 • It is the responsibility of SA1 to provide configuration tools to the sites • Enforcement of the procedures • Platforms to support • Primary platform: Red Hat Enterprise 3.0, gcc 3.2.3 and icc8 compilers (both 32 and 64-bits). • Secondary platform: Windows (XP/2003), vc++ 7.1 compiler (both 32 and 64-bits) • Versions for compilers, libraries, third party software • Programming languages • Packaging and software distribution • Others • Sites must be allowed to organize the network as they wish, internal or external connectivity, NAT, firewall, etc, all must be possible, no special constraints. WNs must not require Outgoing IP connectivity; Not inbound connectivity either. EGEE 1st Conference, Cork, April 22, 2004 - 17

  18. Related documents • Requirement table stored at: https://edms.cern.ch/document/456865 • Meeting minutes stored at: https://edms.cern.ch/document/451069 EGEE 1st Conference, Cork, April 22, 2004 - 18

  19. JRA1/JRA3 • A lot of progress has been achieved here • Security Group formed, JRA1 members identified • First meeting scheduled on May 5-6, 2004 • GAP analysis planned by then • VOMS Administration support clarified • Handled by JRA3 • Issue: VOMS effort reporting EGEE 1st Conference, Cork, April 22, 2004 - 19

  20. JRA1/JRA4 • SCM plan presented and discussed • More discussions on which components of JRA4 will be required in the overall architecture/design need to take place EGEE 1st Conference, Cork, April 22, 2004 - 20

  21. American Involvement in JRA1 • UWisc • Miron Livny part of the design Team • Condor Team actively involved in reengineering resource access • In collaboration with Italian Cluster • ISI • Identification of potential contributions started (e.g. RLS) • Focused discussions being planned • Argonne • Collaboration on Testing started • Support for key Globus Components enhancements being discussed EGEE 1st Conference, Cork, April 22, 2004 - 21

  22. March Issues related to other activities Addressed Addressed • Security JRA3 • Development must be part of JRA1 structure • Security is not an orthogonal activity • Same for JRA4 • Interaction with SA1 • Support • Requirements and acceptance criteria gathering • Definition of responsibilities • Testing • Support • Packaging/Configuration/Distribution Mechanisms • American involvement still being clarified • Issue: CNRS Involvement • JRA2 documents (standards, templates) need to be available early • And relevant to the complexity of the activity Addressed Addressed Addressed Open Open EGEE 1st Conference, Cork, April 22, 2004 - 22

  23. Important steps until next conference (rather: end of 2004 – MJRA1.4: 1st release candidate) EGEE 1st Conference, Cork, April 22, 2004 - 23

  24. Milestones and Deliverables for 2004 M08 – Amsterdam conference: Tech preview of release candidate 1 available EGEE 1st Conference, Cork, April 22, 2004 - 24

  25. JRA1 and other activities • NA4 • HEP: ARDA project started; ensures close relations between HEP and middleware • Bio: activities with similar spirit needed – focused meeting tentatively being planned for May • SA1 • Revision of requirements (platforms) • JRA2 • QAG started • Monthly meeting established • JRA3 • Necessary structures established • Focused Meeting in May • JRA4 • Architectural components required need to be clarified • Other projects • Potential drain of resources for dissemination activities EGEE 1st Conference, Cork, April 22, 2004 - 25

  26. Summary • Activity progressing and on track (despite tight schedules) • Technology Risk • Will WS allow for all upcoming requirements? • Divergence to standards • Very productive conference • Lively discussions in most sessions • Unfortunately no time for a JRA1/NA4 session • No amendments to TA foreseen • Thanks to organizers EGEE 1st Conference, Cork, April 22, 2004 - 26

  27. Information Systems … http://www.mylostbag.com/ EGEE 1st Conference, Cork, April 22, 2004 - 27

More Related