1 / 23

Results of IODE Ocean Data Portal project for 2013-2018

An overview of the IODE Ocean Data Portal project, including its history, structural elements, and progress made from 2013 to 2018. The review of the Partnership Centre for the ODP highlights its achievements and contributions to the seamless access and exchange of marine data.

jamiea
Download Presentation

Results of IODE Ocean Data Portal project for 2013-2018

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Results of IODE Ocean Data Portal project for 2013-2018 Dr Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  2. Table of contents • History of the IODE ODP project • Structural elements of the IODE ODP • Project progress report for 2013-2018 Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  3. 1. History. Phase 1 –Concept • 2003 Draft version of the “end-to-end data management” concept presented at the First Session of the JCOMM ETDMP (Expert Team on Data Management Practices) session by Nikolay Mikhaylov. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  4. 1. History. Phase 2 - Inception • 2004 • Adoption of the “E2EDM” concept and work plan on prototype by the JCOMM ETDMP • First technical specification on the E2EDM technology and alpha-version of the E2EDM software (Data Provider, Integration Server). The E2EDM technology web site http://e2edm.meteo.ru has been launched. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  5. 1. History. Phase 3 - Establishment • 2005 • Data centres were connected: • Flanders Marine Institute (VLIZ, Belgium) • National Oceanographic Data Center (RIHMI-WDC, Russia) • Ifremer (France) • Met Office (UK) Datasets: Research vessels data, real-time GTS data, Argo, voluntary ships • First version of the portal user interface was created • Prototype was demonstrated on the 18thSessionofthe IOC Committeeon IODE and IOC/WMO JCOMM-II session. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  6. 1. History. Phase 4 - Transformation • 2006 -2007 • Collaboration between the IODE E2EDM and WIS has been established. The IODE E2EDM became a WIS DataCollectionorProductionCentres(DCPC) • The E2EDM data sources were expanded to provide functions for Marine warning system support (E2EDM Marine Warning System) • Demonstration on the 19thSessionofthe IOC Committeeon IODE • The E2EDM adopted as a core technology for the IODE Ocean Data Portal project Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  7. 1. History. IODE Ocean Data Portal project The OceanDataPortal was formally established at IODE-XIX through Recommendation IODE-XIX.4 (THE IODE OCEAN DATA PORTAL PROJECT) (2007). Terms of references:  • Facilitate and promote the exchange and dissemination of marine data and services hosted by NODCs; • Provide the seamless access to marine data to NODCs across the IODE network through the discovery, evaluation and access to data via web services; • Identify and recommend standards to provide interoperability with IODE data centres to allow shared use of metadata, data and products. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  8. 1. History. ODP Implementation & Architecture OCEAN DATA PORTAL V1 2007 -2009 • Based on the technical specifications and software of the E2EDM technology OCEAN DATA PORTAL V2 2009 -2012 • ODP V2 is aimed to withdraw from standalone web-services, to implement and standardize methods and means of interface interaction. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation) 8

  9. Core principles • Interoperability Ocean Data Portal (ODP) should be interoperable with existing systems • Non-intervention ODP should not obligate to change NODCs legacy systems (structures, formats, etc.) • Data and services available free and without registration According to the IOC Data Exchange Policy Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  10. 2. Structural elements of the IODE Ocean Data Portal According to the Recommendation IODE-XXII.8 the structural elements of the IODE Ocean Data Portal are as follows: • ODP global node • ODP regional/specialized nodes (ODINs centres, GDACs and centres of JCOMM and centres of other IOC/IODE programmes and projects) • ODP national node (NODCs) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  11. 2. Structural elements of the IODE Ocean Data Portal. ODP global node ODP global node • Coordinate the IODE distributed data system including the monitoring of performance, system statistics and reporting; • Manage consolidated metadata catalogues (nodes, data and services, user metadata) by accumulating metadata from associated data providers (national nodes) and synchronizing of this metadata with other nodes; • Manage and disseminate among other nodes the common controlled dictionaries, basic electronic maps and other cross-system data and metadata; • Provide the user access to data and services submitted by all ODP nodes. If required, it redirects users to the portal of other nodes; Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  12. 2. Structural elements of the IODE Ocean Data Portal. ODP regional/specialized node ODP regional/specialized nodes •  Coordinate the IODE distributed data system including associated data providers of its area of responsibility;    • Manage the metadata catalogues of its area of responsibility and synchronize this metadata with other nodes;   • Provide access to the IODE distributed data system of its area of responsibility and redirects users to the portal of other nodes, if required. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  13. 2. Structural elements of the IODE Ocean Data Portal. ODP regional/specialized node ODP national node (NODCs) • Submit metadata and data sets to IODE distributed data system for shared use. • Undergo an accreditation procedure, based upon the IODE Quality Management Framework. • Be reviewed periodically by the IODE Steering Group for the IODE Ocean Data Portal and the IODE Steering Group for the Quality Management Framework Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  14. 3. Project progress report for 2013-2018 ODP nodesestablished: • ODP global node - RIHMI-WDC (www.oceandataportal.net) • ODP regional/specialized nodes – ODINWESTPAC (http://portal-odp.nmdis.gov.cn), ODINAFRICA(http://portal.odp.odinafrica.co.ke), Sistema Nacional Datos del Mar (Argentina) (http://portal.mincyt.gob.ar) • ODP national nodes – NODC (Russia), NODC (USA)*, NODC (Canada)*, NODC (Japan), NODC (China), NODC (Kenya), NODC (Korea)*, 9 data centres(Argentina), NODC (UK) * - using virtual Data Provider Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  15. 3. Project progress report for 2013-2018 Data contributions: ODP global node – 366 data sets (near real-time, historical) ODP ODINAFRICA node – 272 data sets (historical) ODP ODINWESTPAC node – 7 data sets (historical) ODP SNDM – 91 data sets (near real-time, historical) Total: 736 data sets * - using virtual Data Provider Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  16. 3. Project progress report for 2013-2018 Data provision: 15 data sets to EMODNet Physics on regular basis (delivery on FTP) Data search, retrieval and subscription services - http://www.oceandataportal.net/portal/auth/portal/odp2/data 50 OGC WMS/WFS/WCS Services - http://gis.oceandataportal.net:8083/resources/ Metadata catalogue - http://metadata.oceandataportal.net/ * - using virtual Data Provider Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  17. 3. Project progress report for 2013-2018 Technology and support • ODP V2 toolkit - plug-and-play base back-office software stack supports the deployment of ODP nodes via virtual machine packages maintained by the ODP Partnership Centre. Includes 9 components from Data Provider to Portal. Available on request (individual customization). • Full set of documentation on ODP V2 is available - http://www.oceandataportal.org/?page_id=39 • Public REST & SOAP services available for metadata & data retrieval • Support to node providers has been improved through bug tracking and management tools accessible to both the ODP technical team and technical staff operating the nodes. * - using virtual Data Provider Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  18. 3. Project progress report for 2013-2018 Technology and support • Online monitoring system • Bug-tracking and project management system • Source code repository (GIT) • Sandbox for testing and evaluation • Regular software updates • High-Availability cluster model for ODP global node • Web presence (www.oceandataportal.org) * - using virtual Data Provider Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  19. 3. Project progress report for 2013-2018 Collaboration with other programmes and activities: • EMODNET (active) • Collaboration has been initiated through the EMODNet Physics team in order to foster closer collaboration by leveraging the EMODNet Physics portal technologies and to refocus some Ocean Data Portal efforts towards data access and less towards portal development. The options of supporting EMODNet have been presented in whitepaper “IODE Ocean Data Portal – Current status and future direction” has been presented and discussed during IODE Officers Meeting in January 2016 * - using virtual Data Provider Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  20. 3. Project progress report for 2013-2018 Collaboration with other programmes and activities: • GEO/GEOSS (ongoing) • ODP contributes to GEOSS catalogue • WIS (active) • IODE ODP is active JCOMM DCPC for Oceanography registered in WIS database and available via GISC Moscow • Collaboration will be continued through the results of the activities of the JCOMM IPET-MOIS (ex. TT-MOWIS) * - using virtual Data Provider Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  21. 3. Project progress report for 2013-2018 Collaboration with other programmes and activities: • ODIP (project ended) • ODIP Prototype Project 1: Establishing interoperability between SeaDataNet CDI, US NODC, and IMOS MCP Data Discovery and Access services, making use of a brokerage service, towards interacting with the IODE-ODP and GEOSS portals • As a participant in this prototype development, the IODE ODP is harvesting metadata from GEO-DAB using OAI-PMH: • SeaDataNet – 513 records; • US NODC – 29817 records; • AODN – 128 records And providing access to metadata and data via http://www.oceandataportal.net/portal/auth/portal/odp2/interoperability * - using virtual Data Provider Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  22. 3. Project progress report for 2013-2018 Capacity activities • TRAINING COURSE ON ESTABLISHMENT OF THE OCEAN DATA PORTAL REGIONAL NODE AND DATA NETWORK FOR SNDM-ARGENTINA (7 – 11 October 2013, Buenos Aires, Argentina) • TRAINING COURSE ON ESTABLISHMENT OF THE OCEAN DATA PORTAL DATA NETWORK FOR Southeast Pacific data and Information Network in support to Integrated Coastal Area Management (SPINCAM)  (Buenos Aires, Argentina, 15 – 16 October 2013) • ODINAFRICA Ocean Data Portal training-of-trainers course (16 – 21 December 2013, Oostende, Belgium) • ODINAFRICA Training Course of Ocean Data Portal (10-14 March 2014, Oostende, Belgium) – coordination by WebEx • ODINWESTPAC Ocean Data Portal training course (21 – 25 April 2014, Tianjin, China) Latest training materials (videos + presentrations) are published in IODE OceanTeacher http://classroom.oceanteacher.org/course/search.php?search=ODP * - using virtual Data Provider Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  23. Questions? Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

More Related