1 / 26

Report on Product & Data servers

Report on Product & Data servers. Strengths & Weaknesses. Strong  Understanding of systems (homogeneous description, primary product viewing),  Opendap/Thredds delivery technology together with NetCDF/CF (a GODAE standard)

zoltin
Download Presentation

Report on Product & Data servers

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Report on Product & Data servers Strengths & Weaknesses • Strong  Understanding of systems (homogeneous description, primary product viewing),  Opendap/Thredds delivery technology together with NetCDF/CF (a GODAE standard)  lot of good tools available and underwork for data access • Weak ocean catalogues of reference  user guidance  operationality & quality proof  user feedback analysis  volume handling on internet  education on data management issues Contribution from F. Blanc for IGST, August 2007

  2. Report on Product & Data servers Outcome 1 Catalogue • Embedded GODAE catalogues (// Seadatanet): systems – products – services (action 27 done  template for catalogue of systems) • Master ocean data catalogues • Identified first • Push interdependencies • Record product (inventory level) into relevant master catalogue Contribution from F. Blanc for IGST, August 2007

  3. Metadata Contact ISO 19115 Organization Data Identification Info Responsible Party Content Information Distribution Info Online Source Spatial Representation Data Quality Info Metadata Reference System Citation Metadata Maintenance Language Character Set Hierarchy Standard Name, Version Date Metadata Constraints Required Application Schema Info Conditional or Optional Portrayal Catalog Info Contribution from F. Blanc for IGST, August 2007 Extension Information

  4. Report on Product & Data servers Outcome 2 Data server report • Do we want to revise report format ? • Report made available on the public web (‘cms’ format prefered) • KPI ? (action 28) Contribution from F. Blanc for IGST, August 2007

  5. What do we want to know ?What we know ! Following on KPI action • KPI stands for Key Performance Indicators.  The main goal of the KPIs is the provision of needed information to measure & evidence the end to end performance of GODAE.  KPIs are Quantifiable, Synthetic, Accurate, Targeted.  Among others, KPIs are also good tools to point out strengths and weaknesses. Contribution from F. Blanc for IGST, August 2007

  6. What do we want to know ? What we know ! Following on KPI action • 3 profiles of KPI users: • the GODAE Boardto report to the GODAE Patrons on feasibility & utility • the GODAE Operators to report on implementation& usefulness, • the GODAE Users  to ensure that products are visible, accessible and useable, and have feedback on products use and needs Contribution from F. Blanc for IGST, August 2007

  7. What do we want to know ? What we know ! Following on KPI action • 3 key issues identified so far: • KP1: Quality of organisation (& efficiency) “Do the systems do what they say they will do?” • KP2: Quality of production (& consistency)  “Have the productions reached the operational and qualified level?” • KP3: Use performance “How well the products meet user needs?” Contribution from F. Blanc for IGST, August 2007

  8. What do we want to know ?What we know ! Following on KPI action KP1: Quality of organisation (& efficiency) • Where are we in implementation? • Number of regional and global demonstrations • Clear visibility & understanding of systems • How many systems are operational or suited for reanalysis? • Can we evaluate the gain in implementation (faster or delayed)? • Long-term technical coordination solutions? • Other? • Commitment of systems to the data sharing plan? • Metadata • Vocabulary • Format • Access Tools • Reference fields Contribution from F. Blanc for IGST, August 2007

  9. What do we want to know ?What we know ! Following on KPI action KP1: Quality of organisation (& efficiency) • Has this ease product access? • Availability of products • Confidence in products • Any integrated application …. • Other ? • For what they are used? • Countries & visitors (evolution curve) • Range of applications, and number per year • Range of services (ocean catalogues, operational applications) Contribution from F. Blanc for IGST, August 2007

  10. What do we want to know ? What we know ! Following on KPI action KP2: Quality of production (& consistency) • How far in operationality? • System status clear(research & development, reanalysis mode, demonstration, pre-operational, operational, stopped) • Dissemination/accessibility status clear(production OK, dissemination OK, timeliness, be it for real time or historical data, services failure) • Track of changes and key data streams clear (cf. synchronised observations)Long term issues (time series context & consistency) • Back-up scenario Contribution from F. Blanc for IGST, August 2007

  11. What do we want to know ? What we know ! Following on KPI action KP2: Quality of production (& consistency) • How far in qualification? (report with a qualification status, may depend on system type - reanalysis, operational forecast, observations -) • agreement on metrics products • production set up • routine production • How is shown qualification? • Report with a qualification status (research & development, periodic/operational assessment) • Qualification data (random or regular validation report, ocean resolution achieved, forecast skill computation, model errors) • Dissemination & availability of the qualification indication Contribution from F. Blanc for IGST, August 2007

  12. What do we want to know ? What we know ! Following on KPI action KP2: Quality of production (& consistency) • Is the products well defined & described (coherent and meaningful)? • Use of common vocabulary • Coherency in system description • Guidance for access • Guidance for use • Guidance for qualification Contribution from F. Blanc for IGST, August 2007

  13. What do we want to know ? What we know ! Following on KPI action KP3: Use performance • How the user is aware of products?(visibility of key data streams) • In Google • Federated catalogues • List of available systems (with user guidance) • List of products servers (with user guidance) • List of integrated services (with user guidance) • How simple to access the products? (effective distributed dissemination system) • Registration process • Interoperable use (pull) versus push system • Advanced tools (extractors) • Internet capacity • Distribution services capacity (volume/needs) Contribution from F. Blanc for IGST, August 2007

  14. What do we want to know ? What we know ! Following on KPI action KP3: Use performance • How they are used? • Datasets used • Parameters selected • Space and time window • How often • Preferred services (catalogue, access, advanced tools) • Any user feedback? • Is the product well understood?Strengths and drawbacks, Complaints • Showcases and age of showcase • Number of distributed working group and size of the group • Number of projects or collaborations liaised to GODAE • Benefit? Other ? Contribution from F. Blanc for IGST, August 2007

  15. Report on Product & Data servers Outcome 2 Data server report • Do we want to revise report format ? • Report made available on the public web (‘cms’ format prefered) • KPI ? Does GODAE need a quantitative measurement system ? What indicator is worth to be maintained and monitored in time? Is the context, clear enough to get coherent & useful indicators ? Contribution from F. Blanc for IGST, August 2007

  16. Report on Product & Data servers ERS SAR catalogue Envisat ASAR catalogue RadarSat catalogue Wave height & direction model Ship detection processor ERS SAR online data access Oil spill detection processor ERS SAR online data access Outcome 3 OGC standards (action 30) • See Keith Haines & Jon Blower paper • Web Coverage Service (WCS) Opendap serve gridded data in continuous “coverages” • Web Map Service (WMS):  serve 2D Geospatial maps for GIS applications. • Web Feature Service (WFS):  to serve Geospatial feature data like terrestrial limits, river positions, ARGO float locations, satellite/ship track. Contribution from F. Blanc for IGST, August 2007

  17. Report on Product & Data servers Outcome 3 Application cases • DEWS (UKMO), ATOLL-MOTU (CLS) serve NetCDF data • Godiva2, Argonautica  serve Google Maps What’s next ? • Cf. presentation (Stefano Nativi, nativi@imaa.cnr.it) Contribution from F. Blanc for IGST, August 2007

  18. Security Discovery & Query Evaluation & Browsing Portrayal & Visualization Inventory, Access & Download A common interoperability architecture Interoperability SOCIETY INFRASTRUCTURES, PLATFORMS and SYSTEMS • A service view • Data Observation & Measurement services • Data Storage, Management & Processing services • Data Inventory & Access services • Data Discovery & Query services • Data Browsing and Evaluation Services • Data Portrayal and Visualization services • Data Download services • Data Security services Observation & Measurement Contribution from F. Blanc for IGST, August 2007 Storage, Management & Processing

  19. Data discovery & query Services Data Inventory, Access & Download Services Data storage. Management & processing Services Data Visualization Services ISO 19115 19119 (Profiles) SHP ISO GF Data Model GeoTIFF netCDF . . . Others... The GI community architecture Thematic Portals View services WFS WMS CS-W (ISO profiles) WMS GeoBrowser WCS View services Data Tier Contribution from F. Blanc for IGST, August 2007 Data Access & Inventory Tiers Data Catalog Tier Data Presentation Tier

  20. Data Inventory, Access & Download Services Data storage. Management & processing Services Data Visualization Services Dataset Inventory Catalog Model GRIB NetCDF & the Common Data Model HDF netCDF 19115 ISO profiles . . . Others... The netCDF-Community architecture HTTP Visualization tools THREDDS Data Server OPeNDAP ODV WCS Data Tier Contribution from F. Blanc for IGST, August 2007 Data Access & Inventory Tiers Data Presentation Tier

  21. WFS CS-W (ISO profile) WMS SHP GRIB View services WCS NetCDF & the Common Data Model ISO GF Data Model Mediation & Brokering service GeoTIFF HDF ISO 19115 ISO 19119 Profile Models Dataset Inventory Catalog Model WMS netCDF netCDF CDI service . . . . . . ODV View services Others... Others... THREDDS Catalog Service Other ISO Compliant services GeoBrowser Thematic Portals HTTP OPeNDAP Visualization tools WCS Contribution from F. Blanc for IGST, August 2007 Data Tier Data Access & Inv. Tiers Data Catalog Tiers Data Presentation Tier

  22. ncML EncodingModel GML 3.x EncodingModel Data model harmonization Data Models Mediation ncML-GML Encoding Model netCDF Data Model CF Metadata ISO 19123 Data Model Earth Sciences Information Community GIS Information Community Contribution from F. Blanc for IGST, August 2007

  23. ncML-GML • Mediation Markup Language • An extension of ncML (netCDF Markup Language) based on GML (Geography Markup Language) grammar Contribution from F. Blanc for IGST, August 2007

  24. And nowmerging possible with other type of data Contribution from F. Blanc for IGST, August 2007

  25. Contribution from F. Blanc for IGST, August 2007

  26. Report on Product & Data servers Outcome 3 GIS service for system assessment ? Contribution from F. Blanc for IGST, August 2007

More Related