ET-GDDP report ICG-WIS, Seoul, February 2010

1. ET-GDDP report ICG-WIS, Seoul, February 2010 Matteo Dell’Acqua Meteo-France IGC-WIS, Seoul

2. ET-GDDP members • Li Xiang, CMA • Hiroyuki Ichijo, JMA • Ian Senior, BoM • Okki Lee, KMA • Siegfried Fechner, DWD • Baudouin Raoult, ECMWF • Don Middleton, NCAR • Lothar Wolf, EUMETSAT (since January 2010) IGC-WIS, Seoul

3. ET Work Outline • First meeting in Toulouse from 12 to 13 March 2009 • Established a work plan and timelines with the key milestones • Outlined demonstration process • Defined demonstration criteria • technical but also managerial and coordination aspects • Telco and emails exchange in June/July 2009 • Discuss first draft questionnaire • Second meeting in Beijing from 7 to 11 September 2009 • Validate the questionnaire tools • Sketch the demonstration scenarios • Draft “guidance and management” document • Emails exchange in October/November 2009 • Finalise “guidance and management” document IGC-WIS, Seoul

4. Define what needs to be assessed and how Identify test site Test demo proc. Complete questionnaire Prepare demo for CBS Ext 2010 Finalize doc Assessment End nov. 10 30 nov. 09 31 aug. 10 15 nov. 09 31 mar. 10 30 sept. 09 Work plan from Sept. 2009 to CBS Ext 2010 We don’t have any idea on how many Centres will be ready to start the demonstration process in 2010. The “complete questionnaire” and “assessment” phases should be flexible enough to be applied in time when a candidate is ready to demonstrate its capabilities. Following the initial demonstration cycle, the process will be repeated on an annual basis thereafter • What needs to be assessed and how …. 6 months • Identify and test reference implementations for the various elements of WIS • End of November: release of the documentation to candidate - first major milestone …. ….challenging ! • 4 months to complete the questionnaire if the candidate WIS centres wish to participate to initial round • 5 months to assess …. Including July and August • ~3 months to prepare demo IGC-WIS, Seoul

5. Demonstration of GISC capabilities extract CBS Ext (2006) • The candidate GISCs will be invited to demonstrate to CBS their capabilities to provide WIS services to the accredited users with the necessary reliability and quality • This refers to : • the real-time functions of data and product collection and dissemination • non realtime services for requests • storage functions for the complete set of WIS data and products and relevant up-to-date metadata catalogues • coordination functions with other GISCs and the planning of mutual back-up services should also be demonstrated • adherence to WIS standards and relevant data exchange policies and access rights must be granted • A formal commitment and time schedule to implement the GISC and to provide GISC services in accordance with the offer will be given by the PR of the Member operating the candidate GISC IGC-WIS, Seoul

6. Demonstration criteria • No GISC and DCPC implementation up to now • Development in progress • prototype • Just working on paper • Intention to be ready by … • Different categories of demonstration criteria • Intention criteria • Track record • Current infrastructure (system and telecom) • Implementation criteria • Plan to upgrade the infrastructure ( system and network) … project plan ? By when ? • Organisation to ensure the service (manpower, SL) • roadmap • WIS compliance criteria • Technical, functional and organisational criteria • Operational criteria Demonstration of capabilities is realist only for operational or “pre-operational” WIS centre Demonstration cannot be based on prototype IGC-WIS, Seoul

7. Demonstration Criteria • The candidate WIS Centre should demonstrate its capability on an integrated system, that is in working order and ready for operational use. • This demonstration can take place in a development environment, as long as the system that is demonstrated (software, hardware and support) is identical to the system that will be used routinely in operations. • In the event that the demonstration does not make use of the system that will be used for operations, the candidate shall list all differences with respect to the operational configuration, together with a description of the activities that need to be undertaken to enable the system to reach an operational status and an implementation plan. IGC-WIS, Seoul

8. Precondition : Endorsement by ICG-WIS WMO Members fill out the questionnaire, and conduct the necessary demonstration tests Submission evidence Provide feedback Assessment (ET-GDDP) Validation/on-site audit for GISC Findings and conclusion. Assessment level: -endorsed; -endorsed but with qualification; -not endorsed. Arrange Demonstration to CBS Review by CBS of Findings and Demonstration Recommendation to EC Demonstration process • Candidate Centres provide ET-GDDP with information on their capabilities to offer GISC or DCPC functions, using the questionnaire tool • ET-GDDP assess the information received, asked for clarifications, help the Members in providing the relevant information, run test cases • include a formal visit/audit for the candidate GISC • Similar to a quality audit in that Centres will be “endorsed”, “endorsed with qualifications” or “not endorsed”. • Assessment process and interaction with WIS candidates can start for Centres providing intention information and an implementation plan • Validation can be done only once the plan has been implemented • 31 March 2010 for initial round IGC-WIS, Seoul

9. Assessment process • Questionnaire • paper exercise supported by evidence • Demonstration test cases • GISCs and DCPCs will have to demonstrate either to the ET-GDDP or to CBS some functionalities such as metadata harvesting, metadata publishing, discovery of data, ad-hoc request, user authentication, access authorisation… • The ET-GDDP expects to be able to run these Demonstration test cases on the Centre’s system via the internet and, for GISCs, on site during the site visit • For GISC candidates, the assessment will include a site visit, to enable the ET-GDDP to audit the technical infrastructure, the organization in place and to review the WIS procedures. Some test cases will be run during this site visit • Centres that receive a qualified endorsement will have to demonstrate the functions defined by ET-GDDP during CBS sessions in order to obtain a full endorsement • Centres candidates that have received the full endorsement and are considered to have “exemplar” capabilities may be asked by the ET-GDDP to demonstrate these capabilities to CBS sessions and/or Executive Council and/or Congress for the benefit of other Members IGC-WIS, Seoul

10. Questionnaire’s area • Track record • Production • Operation • Collection • Dissemination • DAR • GISC’s interfaces • Performance monitoring • Network • Security and access control • Funding IGC-WIS, Seoul

11. Questionnaire’s area • Identification Information • Identification facts about the candidate WIS Centre such as its name and where it is located; • General Criteria • Organizational commitment, provision of physical and staffing resources, and coordination arrangements with other Centres • Functional Requirements • How WIS Functional Requirements will be addressed by the candidate WIS Centre • Demonstration Tests • Details concerning the WIS Demonstration Test Cases IGC-WIS, Seoul

12. Guidelines example • WIS Functional Requirement 5 - GISC: Maintain, in accordance to the WMO standards, a catalogue of all data and products for global exchange available within WIS and provide access to this catalogue Guidance GISCs are required to maintain and provide access to a catalogue of all information within WIS in support of the Discovery, Access and Retrieval function. Centres will be asked to demonstrate their capability for Use Cases B3 and B6 (see Annex C) within the technical specification section (see Annex B). Please: • Describe the mechanism for management of metadata including uploading, changing and deleting of metadata, including by batch mode; • Describe how users will discover and access metadata; • Describe how you will keep the metadata catalogue synchronised with other GISCs; • Provide a list of centres you are collaborating with to establish the required metadata synchronisation for your initial operating capability or for your demonstrating this capacity; • Provide evidence that metadata from different WMO programs are managed by the catalogue. IGC-WIS, Seoul

13. Test cases • Metadata management • including uploading, DAR catalogue and maintenance • Synchronisation of DAR catalogues between GISCs • Uploading and downloading of information between WIS centres • GISC cache of 24 hours of information available for global distribution • User management • including registration, validation, authentication and access control • Discovery, Access and Retrieval • including search, and use of GISC DAR Catalogue and GISC Cache IGC-WIS, Seoul

14. Test case example IGC-WIS, Seoul

15. Milestones • CBS XIV (Mar 2009) – Expects ET-GDDP to have established a work plan • EC LXI (June 2009) – Expects to have a candidate list and draft demonstration processes • ICG-WIS (Oct 2009) – Expects to review ET-GDDP work plan and demonstration processes • EC LXII (Jun 2010) – Expects a progress report on identification, endorsements and demonstrations. • ICG-WIS (Aug 2010) – Expects to review progress in preparation for CBS Ext and Cg XV. • CBS Ext (Nov 2010) – Will assess demonstrations and make recommendations for Cg XV • Cg XV (May 2011) – Will consider list of candidate centres, results of demonstrations and endorsements from TCs and RAs IGC-WIS, Seoul

16. Workplan  CBS Ext 2010 • Start assessing interactively and as soon as first case comes in • Group’s members informed that answers have arrived • Wiki at ECMWF to exchange info and comments • WMO Sec. Prepare draft comment. For each Centres, Zip file containing all documents together with the replies and uploaded to wiki. • Compile all responses received : after 31 March 10 • Meeting in April : • quickly go to through the answers received … focus on GISC • Define global assessment tactics and practises • Define tests criteria • Split the work • Verify the answers, interact with candidates, run the tests and visit candidate GISCs which have fully completed the assessment between April and 1 October 2010 • pre-operational environment should be ready at candidate sites by 15 May at the latest IGC-WIS, Seoul