External observatory integration
This presentation is the property of its rightful owner.
Sponsored Links
1 / 25

External Observatory Integration PowerPoint PPT Presentation


  • 85 Views
  • Uploaded on
  • Presentation posted in: General

External Observatory Integration. Christopher Mueller Life Cycle Architecture Review December 13, 2010. Agenda. Life Cycle Architecture Review Subsystem Purpose Release 1 Product Description Use Case Overview Architectural Overview Status of Progress

Download Presentation

External Observatory Integration

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


External observatory integration

External Observatory Integration

  • Christopher Mueller

  • Life Cycle Architecture Review

  • December 13, 2010


Agenda

Agenda

Life Cycle Architecture Review

  • Subsystem Purpose

  • Release 1 Product Description Use Case Overview

  • Architectural Overview

  • Status of Progress

    • Use Cases Address, Use Cases Demonstrated

  • Technology Challenges and Achievements

  • Plan for Construction

  • Risk Assessment

  • Demonstration

2


External observatory integration subsystem purpose

External Observatory Integration Subsystem: Purpose

  • Integrates external observatories (IOOS in R1) with the OOI Integrated Observatory

  • Facilitates inclusion of external data

  • Delivers data in community specific forms

  • Allows immediate full scale testing of the OOI-CI System

  • Introduces OOI to a community of early adopters

3


Eoi r1 product description use case overview

EOI R1 Product Description Use Case Overview

Responsible For

Supports

Uses

4


Dataset agents supporting uc r1 04

Dataset Agents  Supporting UC.R1.04

  • EOI Supports this use case by providing Dataset Agents that facilitate acquisition of data from external repositories (such as NDBC and AOML)

  • The Dataset Agents are responsible for mapping between the data format provided by the external repository and the OOI Canonical Data Model

5


Uc r1 21 derive data product externally

UC.R1.21: Derive Data Product Externally

  • Normalization of disparate data sources

  • Transformation to the desired output format

  • Automated delivery of data to the end user (R1 modeling groups)

  • Automated launching of client-side processing scripts

  • Resulting data may be sent back to OOI-CI

6


Architectural overview

Architectural Overview

7


Architectural overview client view

Architectural Overview – Client View

OOI-CI

Service

Translation

Format

Conversion

Notification

Feeds/

Subscriptions

2010 OOI-CI – IOOS Collaboration

External Observatory Integration (EOI)

Espresso ROMS

other models

OOI-CI

Service

Translation

Format

Conversion

Notification

Feeds/

Subscriptions

External Observatory Integration (EOI)

External Observatory Integration (EOI)

IOOS

Catalog

IOOS

Catalog

SOS

TDS

SOS

SOS

WaterML

HTTP

USGS

AOML

NDBC

Wx

NDBC

HFR

CO-OPS

WL

IOOS

RAs

Non-IOOS Sources

IOOS Data Sources

8


Maracoos integration design

MARACOOS Integration Design

9


Architectural overview ooi ci view

Architectural Overview – OOI-CI View

IOOS Modeling Groups

User

Interfaces

Externalization and

Integration

Instrument

Agents

External

Observatory

Integration

Application Level

Services

Sensing &

Acquisition

Data Distribution and

Preservation Infrastructure

DataManagement

Core Infrastructure

Services

Common

Operating

Infrastructure

Common

Execution

Infrastructure

10


Architectural overview ooi ci view1

Architectural Overview – OOI-CI View

IOOS Modeling Groups

Application

Services

Infrastructure

Services

2650-00007 OV2 CI

11


Architectural overview ooi ci view2

Architectural Overview – OOI-CI View

Publish(Dataset Agents)

Subscribe(Dispatcher)

http://oceanobservatories.org/spaces/display/syseng/CIAD+OV+06+External+Observatory+Integration

12


Architectural overview dataset agent

Architectural Overview – Dataset Agent

(3)

(2)

(1)

(6)

(5)

(4)

(7)

http://oceanobservatories.org/spaces/display/syseng/CIAD+EOI+Dataset+Agents

13


Architectural overview dataset agent1

Architectural Overview – Dataset Agent

http://oceanobservatories.org/spaces/display/syseng/CIAD+EOI+Dataset+Agents

14


Architectural overview dispatcher

Architectural Overview – Dispatcher

http://oceanobservatories.org/spaces/display/syseng/CIAD+EOI+Dispatcher

15


Status of progress

Status of Progress

  • Implemented end-to-end exchange of messages on both the Publication (Dataset Agent) and Subscription (Dispatcher) sides of the system.

  • Completed Dataset Agent implementations for all data required by Rutgers modeling group

  • Completed Dispatcher implementation capable of receiving notification and reacting by launching an external workflow script

16


Status of progress rutgers data sources

Status of Progress –Rutgers Data Sources

Currently Implemented Capabilities

  • Providers:

    • PFEG, NAVY, USGS, RADS, NCEP, AOML, NDBC

  • Acquisition Protocols:

    • OPeNDAP, SOS, WaterML, urlread

  • CDM Types:

    • Grid, Station, Station Profile, Trajectory

  • Data Variables:

    • Sea Surface Height, Currents, Winds, Salinity, Temperature, River Discharge, …

  • Acquisition Forms:

    • NetCDF, ASCII

  • 17


    Eoi technology list

    EOI Technology List

    NetCDF Java

    Matlab

    18


    Plan for construction

    Plan for Construction

    Current Schedule:

    • Three 6 week Construction Iterations – 12/20/2010  5/2/2011

    • IOC Review – week of 5/3/2011

      Considering rescheduling to bring EOI into alignment with core subsystems:

    • Two 8 week Construction Iterations – 12/20/2011  4/1/2011

      • EOI will be aligned for the 2nd iteration

  • R1 Deployment concurrent with the rest of the system

  • http://www.oceanobservatories.org/spaces/display/CIDev/EOI+Release+1+Construction+Plan

    19


    Plan for construction r1c1

    Plan for Construction – R1C1

    Theme:Analysis of 2nd & 3rd Modeling Group & Refinement of Elaboration Implementations

    • Analysis of modeling group data needs

      • University of Hawaii

      • Texas A&M

  • Integration of mature ION capabilities

    • Refactoring of Dataset Agent & Dispatcher implementations

  • Thorough documentation

  • http://www.oceanobservatories.org/spaces/display/CIDev/EOI+Release+1+Construction+Plan

    20


    Plan for construction r1c2

    Plan for Construction – R1C2

    Theme:Development of Additional Dataset Agents & Adoption of OOI-CI as the Data Provider for R1 Modeling Groups

    • Continued integration of mature ION capabilities

    • Development of Additional Dataset Agents

      • For University of Hawaii data

      • For Texas A&M data

    • Incorporation of OOI-CI as the data providerin the acquisition scripts of the 3 R1 Modeling Groups

    http://www.oceanobservatories.org/spaces/display/CIDev/EOI+Release+1+Construction+Plan

    21


    Risk assessment eoi

    Risk Assessment – EOI

    22


    Eoi technologies at risk for release 1

    EOI Technologies at Risk for Release 1

    None at this time!

    23


    End to end demonstration

    End-to-end Demonstration

    For Demo Only!!

    Translation from raw form to OOI-CI Canonical Data Model

    Transmission of data via ION Messages

    https://docs.google.com/drawings/edit?id=1HDMg7rLhic5dIeZ_iWpez8EokfTh0bnFrpNZHXteNYA&hl=en&authkey=CLG0xoMI

    24


    External observatory integration

    Thanks !

    Questions ?

    25


  • Login