Towards an assessment of the european ecv cdr capability
This presentation is the property of its rightful owner.
Sponsored Links
1 / 19

Towards an assessment of the European ECV CDR capability PowerPoint PPT Presentation

  • Uploaded on
  • Presentation posted in: General

Towards an assessment of the European ECV CDR capability. Jörg Schulz, EUMETSAT. Content . Need to assess the capability Tools Inventories System Maturity Matrix Approach Application Performance Matrix Approach Assessment Workshop Summary. Need to Assess European Capability.

Download Presentation

Towards an assessment of the European ECV CDR capability

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

Towards an assessment of the european ecv cdr capability

Towards an assessment of the European ECV CDR capability

Jörg Schulz, EUMETSAT



  • Need to assess the capability

  • Tools

    • Inventories

    • System Maturity Matrix Approach

    • Application Performance Matrix Approach

  • Assessment Workshop

  • Summary

Need to assess european capability

Need to Assess European Capability

  • The 2010 European capacity analysis (JRC report by Wilson et al.) concentrated on the space segment andwas analysing data records only with a helicopter view;

  • Many European activities (EC projects, ESA CCI, EUM SAFs) work in parallel and we may be in danger of loosing track;

  • Europe has very capable institutions and project consortia to provide climatedata records from in situ and satellite data as well as reanalysis (as shown by the FP7 EUGENE project) but what do we know about their maintainability and comparative quality?

  • Long term investment into a space-based architecture for climate monitoring serving the Copernicus Climate Change Service and the Global Framework of Climate Services needs clear knowledge about the joint capability of Europe.

Need for tools to assess the capability

Need for Tools to Assess the Capability

  • We often use nomenclature and methods that are difficult for non-specialists, and sometimes even specialists, to understand;

  • We must do a better job in standardizing our nomenclature and methods, and more clearly communicate with the user’s of the resulting products;

  • We need tools that provide a basis for information preservation, expectations, and a metric for progress to completeness that can be used to assess the capability in the most objective way possible;

  • We need to be clear about what those tools can and what they can’t;

Need for tools to assess the capability1

Need for Tools to Assess the Capability

  • We need to consider different aspects of our capability:

    • Scientific and engineering practises,

    • Utilisation of products,

    • Quality of products with respect to applications;

  • Assessing if data record generation follows best practises provides an internal view on strengths and weaknesses of the processes to generate data record for agencies (including funding) and data record providers themselves;

  • The assessment of quality of products is facilitating an external view on the data record trying to answer the most important user question: Is the quality good enough for my application.

Common climate observations business practices

Common Climate ObservationsBusiness Practices

  • Steps to long-term monitoring

    • Over the last 20-30 years many investigators have developed methods for seaming together observations with evolving coverage and accuracies

    • From these experiences, common elements are emerging on how climate scientists do business

  • How do we capture and make available these business practices?

Courtesy of John J Bates, NOAA/NCDC

Tools used by core climax project

Tools Used by CORE-CLIMAX Project

  • We defined three elements for a capability assessment:

    • Data Record Inventories that contain technical specifications and also links to documented information on quality;

    • A System Maturity Matrix (SMM) that evaluates if the production of the ECV CDR follows best practices for science, engineering and utilisation;

    • An Application Performance Matrix (APM) that evaluates the performance of an ECV CDR with respect to a specific application.

  • In addition User Requirements for each applicationare needed to ‘measure’ the performance.

The core climax system maturity matrix

The CORE-CLIMAX System Maturity Matrix

Example public access feedback update

Example: Public Access, Feedback, Update

Prerequisites and needs for the application performance matrix

Prerequisites and Needs for theApplication Performance Matrix

  • Needs useful User Requirements for an application that ideally provide 3 levels (breakthrough, target and optimum);

  • Needs useful technical specification and published validation results (ideally from data set quality assessments) for products assessed;

  • Need a weighting scheme for the columns as importance is different for different applications;

  • Need to define a function that maps distance to User Requirement into index 1-6;

  • Should jointly be populated by expert on data product and expert for application;

  • Result shall be an understandable message on the usability of a data record for a specific application.

The application performance matrix draft

The Application Performance Matrix (Draft)

Example mid tropospheric temperature trend

Example: Mid-Tropospheric Temperature Trend

Product Technical Specification

1 anomalies are considered

User Requirements Table – Trend Analysis – Mid Tropospheric Temperature

Example mid tropospheric temperature trend1

Example: Mid-Tropospheric Temperature Trend

Leroy et al., 2008, J. Clim.

33 years

35 years

46 years

Potential mapping function

Potential Mapping Function

  • In this case the mapping would be based on the signal to noise ratio;

  • Following Ohring et al. (2004) a signal to noise of 5 is fulfilling the stability and random uncertainty requirement;

  • The mapping could be:

Link to gcos 143 guidelines

Link to GCOS-143 Guidelines

Link to gcos climate monitoring principles

Link to GCOS Climate Monitoring Principles

Gcos principles satellite specific

GCOS Principles Satellite Specific

Core climax capability assessment workshop

CORE-CLIMAX Capability Assessment Workshop

  • Workshop is to:

    • Perform a self assessment using the new capability assessment tools and GCOS guidelines foreach participating data record;

    • Perform independent (our SAG, the consortium members and external experts) assessment of the same data records;

    • Discuss the assessment outcome differences and find consensus on the result;

    • Integrate the results into an electronic data base for EC and Copernicus;

  • The workshop shall discuss the initial report on the European capability to create CDRs for the European Commission;

  • Proposed workshop date and venue: 21-23 January 2014 @EUMETSAT



  • CORE-CLIMAX facilitates a capability assessment by:

    • Using and contributing to data record inventories;

    • Using an updated Maturity Matrix approach to‘measure’ if data records are produced employing best practises for science, engineering and utilisation;

    • Using a novel approach of an Application Performance Matrix to break down comprehensive information on data record quality into a performance index;

  • The Maturity Matrix is independent of individual applications and it is assumed that following best practises results in better data records.

  • The Performance Matrix depends on well formulated user requirements and results change with changing user requirements.

  • Caveat: Any index that is produced need to be carefully interpreted before used for decisions on program contents and/or funding;

  • The CORE-CLIMAX Capability Assessment Workshop aims at using the tools to establish a first rendition of a European capability data base.

  • Login