Global imagery browse services gibs project management review
Download
1 / 36

Global Imagery Browse Services (GIBS): Project Management Review - PowerPoint PPT Presentation


  • 124 Views
  • Uploaded on

Global Imagery Browse Services (GIBS): Project Management Review. Charles Thompson Matthew Cechini. Tuesday, September 10, 2013. Outline. Introduction Project Overview Description Organization Chart Objectives Integration with EOSDIS Use Cases Applications

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Global Imagery Browse Services (GIBS): Project Management Review' - quincy


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Global imagery browse services gibs project management review

Global Imagery Browse Services (GIBS):Project Management Review

Charles Thompson

Matthew Cechini

Tuesday, September 10, 2013


Outline
Outline

  • Introduction

  • Project Overview

    • Description

    • Organization Chart

    • Objectives

    • Integration with EOSDIS

    • Use Cases

    • Applications

  • Development Details and Status

    • TIE and OnEarth

      • Introduction

      • Workflows

      • Current status

      • Open source status

    • Current cost and labor summaries (JPL)

  • Project Schedule Review

    • Evolution

    • Completed Activities

    • Planned Activities

    • Transition Planning

    • Issues and Risks

  • Questions

  • Worldview demo



What is gibs
What is GIBS?

  • Value-added image archive and access services for NASA Earth Science data products

  • Collaboration between JPL and GSFC

    • JPL: server-side software

      • Image management and workflow: The Image Exchange (TIE)

      • Image processing and image access: OnEarth

    • GSFC: hardware and infrastructure

      • Configuration

      • System administration

      • Testing

      • Operation and maintenance

    • Both

      • Project management

      • System engineering



Gibs objectives vision
GIBS Objectives: Vision

  • Influence the EOSDIS data search and discovery process

    • Transform

    • Streamline

    • Enhance

    • Make it visual


Gibs objectives drivers
GIBS Objectives: Drivers

  • Necessity

    • Rapid expansion of Earth Science data holdings

    • Current search & discovery paradigm does not scale well

    • Need to incorporate data reduction/characterization/summary techniques, especially in data-as-a-service (DaaS) endpoints

  • User feedback

    • Need common form of data representation

    • Web services


Gibs objectives benefits
GIBS Objectives: Benefits

  • Intuitive interface to science data

  • Minimal user intimidation

  • Extended customer base

  • Wide array of applications

  • Cohesive approach to EOSDIS image management

  • Facilitates cross-discipline research

  • Publicity


Eosdis components where gibs fits in
EOSDIS Components:Where GIBS fits in

Web Applications (Reverb, Worldview)

Web Portals (Standard and Mobile)

Web Services

Web Infrastructure

Collection and Inventory Metadata

ECHO, GCMD

User Registration

EOSDIS URS

Global Image Browse Services

GIBS

Content Management Drupal, CMSs

User Support System

Kayako

Service Metadata

Metrics

EMS

Content Discovery

Google

Bug Issue Tracking

Jira

Collaboration Tools

Doc. Mgt., Wiki

Code Repository

GIT, Stash

Direct Data Access

HTTP, FTP

Data as a Service (DaaS)

OPeNDAP, WCS, Live Access Server

Ingest and Archive Systems

ECS, DMAS, S4PA…

EDOS, MEaSUREs, SIPS, External Data


Global imagery browse services gibs project management review

GIBS: Core Use Scenarios

Metadata First

Imagery First

ESDSWG

Visualization

Working Group

Recommendations

October 2013


Global imagery browse services gibs project management review

Environmental Forecasting

  • EPA’s AirNow-Tech Navigator

    • Air Quality Data

    • Surface Weather

    • Satellite Data

AOD

0.70

Smoke

24-hr average PM2.5 – AirNow WMS

HYSPLIT Trajectory – NOAA ARL

Terra True Color – NASA GIBS WMS

24-hr average PM2.5 – AirNow WMS

HYSPLIT Trajectory – NOAA ARL

Terra & Aqua AOD – NASA GIBS WMS

0.27


Gibs applications mission planning
GIBS Applications:Mission Planning


Gibs applications education
GIBS Applications:Education

  • Science on a Sphere

  • PBS NOVA Labs – Cloud Lab

  • American Museum of Natural History


Worldview soto
Worldview & SOTO

  • Worldview

    • Reference client for GIBS

    • Browser-based, developed using open standards

    • Currently tailored toward NRT data community

    • Supports polar viewing, full-res image download

  • State of the Ocean (SOTO)

    • Enables interactive viewing of ocean parameters

    • Includes external contextual overlays (buoys, currents)

    • Moving 30-day viewing period including NRT data

    • Raster and vector overlays

    • SOTO 3D: Google Earth client

    • SOTO 2D: OpenLayers client, under development

  • Demonstrations of Worldview and SOTO 2D Wednesday 10-11 here!



Gibs software constituents
GIBS Software Constituents


Onearth
OnEarth

  • Image transformation and serving software

  • Emphasis on extremelyefficient (fast)image serving capabilities

  • Keys off a specialized image pyramid encoded into the Meta Raster Format (MRF)

  • Consists of Layer Generation and Layer Access components

  • Developed at JPL by Lucian Plesea


The image exchange tie
The Image Exchange (TIE)

  • Image management and workflow package

  • Based upon PO.DAAC’s Data Management & Archive Software (DMAS)

  • Ingests and archives provider imagery and associated “image metadata”

  • Triggers and monitors OnEarthprocessing


Tie workflow overview
TIE Workflow Overview

Imagery Data Handler

Imagery

Internet

Image provider

Input

Image

Extract metadata

Validate

SIP

Inventory

Register

Layer Generation

MRF

Image

yes

Check for new files

Archive

Copy

Data Subscriber

Manager & Ingest Engine

Layer Access

Legend

OnEarth

TIE

Internet

Image user


Onearth workflow overview
OnEarth Workflow Overview


Onearth current work
OnEarth: Current Work

  • Understanding internal processes and roles of each routine

  • Documentation and diagramming

  • Code reorganization

  • Merging multiple instances of source code

  • Establishing formal version control

  • Developing TIE interface specifications

  • Purpose: Setting the groundwork for software development phase


Tie current work
TIE: Current Work

  • Extending and enhancing DMAS for GIBS

  • Building data handlers for imagery

  • Solidifying interfaces with OnEarth

  • Establishing some level of end-to-end throughput


Open sourcing gibs software
Open Sourcing GIBS Software

  • Why?

    • Facilitate continued relationship with original OnEarth developer

    • Widen possible collaboration possibilities

    • Promotes open standards

    • Cost effective

  • Status

    • OnEarth

      • License type and repository determined, all required signatures gathered, now awaiting JPL authorization process to play out

    • TIE

      • Will follow OnEarth process after it has been smoothed out


Gibs jpl planned vs actual cost
GIBS (JPL): Planned vs. Actual Cost

$K

OnEarth

Software

Engineer

hired

Month


Gibs jpl planned vs actual labor
GIBS (JPL): Planned vs. Actual Labor

FTE

OnEarth

Software

Engineer

hired

Month



Gibs evolution
GIBS Evolution

2010

  • Infancy

    • Developed as Rapid Response extension, fast access to NRT imagery

    • Demonstrated overlay utility (MODIS True Color & AMSR-E Rain Rate)

  • JPL Involvement

    • State of the Earth (SOTE) pilot project testing image serving software

    • White paper recommending JPL software as best option for serving imagery

  • Operating Prototype

    • Standardized (OGC WMTS/TWMS/KML) service endpoints

    • Access to ~100 imagery products

    • Multiple clients: Worldview, World Wind, EPA, iPhone App, SOTO

  • Beginning of Formal Development

    • ConOps, design documents, schedule, v0.2 “Operationalization”

  • V1.0 release

    • Improved Reliability, Fault Tolerance, Scalability, and Performance

    • Improved Governance Processes

    • Increased Ingest of new Products

2011

2012

2013

2014


Completed activities
Completed Activities

  • Systems Engineering

    • System Requirements

    • “Web Layer” Trade Study

    • System Architecture

    • Concept of Operations (Public Draft)

  • Development

    • Software Development Plan

    • TIE Software Detailed Design

    • OnEarth Software Detailed Design (Draft)


Completed activities cont
Completed Activities (cont)

  • Infrastructure

    • SAN Initial Configuration

    • Development Environment Installation

    • Procurement for Dev/Test/UAT/Prod Hardware

  • Testing

    • Performance Test Plan (Draft)


Planned activities
Planned Activities

1/14

9/9

10/11

12/13

Dev Sprint v0.2a

Dev Sprint v0.2b

Test Support & Bug Fixes

Bug Fixes

Dev

v0.2b Functional/Performance Testing

User Acceptance Testing

v0.2a Functional Testing

Test

“Go Live”

Concurrent Operations

Ops

Network, Storage, Backup, Database Testing/Implementation


Transition planning
Transition Planning

  • Concurrent Operations w/ “Old GIBS”

    • Reduced imagery migration

    • Increased period of performance and stability testing

    • Additional enhancements to address functional issues or improvements (TBD)

  • “Seemless” Cut-Over

    • Ensure imagery synchronization

    • Redirect web traffic to new endpoints

    • Shut down ingest into “Old GIBS”