important esdis 2009 tasks review n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Important ESDIS 2009 tasks review PowerPoint Presentation
Download Presentation
Important ESDIS 2009 tasks review

Loading in 2 Seconds...

play fullscreen
1 / 45

Important ESDIS 2009 tasks review - PowerPoint PPT Presentation


  • 68 Views
  • Uploaded on

Important ESDIS 2009 tasks review. Kent Yang, Mike Folk The HDF Group April 1st, 2010. Outline. HDF-EOS Website HDF OPeNDAP support HDF-EOS5 Augmentation tool. HDF-EOS Web Site http://hdfeos.org. Main page : http://hdfeos.org. New Webpage. Old Webpage.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Important ESDIS 2009 tasks review' - giovanna-abbott


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
important esdis 2009 tasks review

Important ESDIS 2009 tasks review

Kent Yang, Mike Folk

The HDF Group

April 1st, 2010

Annual briefing to ESDIS

outline
Outline
  • HDF-EOS Website
  • HDF OPeNDAP support
  • HDF-EOS5 Augmentation tool

Annual briefing to ESDIS

hdf eos web site http hdfeos org

HDF-EOS Web Sitehttp://hdfeos.org

Annual briefing to ESDIS

slide4

Main page:http://hdfeos.org

New Webpage

Old Webpage

  • Reorganize the overall structure
  • Update the main page

11/28/2014

Annual briefing to ESDIS

4

help http www hdfeos org help
Help: http://www.hdfeos.org/help

11/28/2014

Annual briefing to ESDIS

5

examples
Examples

Added a new “Examples” section

- C, Fortran, IDL and MatLab examples to access HDF-EOS2 and HDF-EOS5 Grid and Swath files

- Examples on how to use tools such as HEG, GrADS, NCL, Using IDV via OPeNDAP to access HDF-EOS 2 and HDF-EOS5 data

Annual briefing to ESDIS

6

software
Software

Evaluated 35 tools and libraries

Added 11 tools and libraries

Added detailed descriptions

November 3-5, 2009

HDF/HDF-EOS Workshop XIII

Annual briefing to ESDIS

7

forum
Forum

November 3-5, 2009

HDF/HDF-EOS Workshop XIII

Annual briefing to ESDIS

8

hdf eos website statistics

HDF-EOS website statistics

Current Period: Nov. 1st 2009 – Feb. 28th 2010

Previous Period: July 4th 2009 – Oct. 31st 2009

Annual briefing to ESDIS

definitions
Definitions

Visits – The total number of visits to the website.

Pageviews – The total number of pages viewed on the website. Repeated views of a single page are counted.

Pages/Visit – The average number of page views per visitor.

Bounce Rate – The percentage of single-page visits. (Total number of visits viewing one page) / (Total number of visits)

Avg. Time on Site – The average visit duration.

% New visits – The percentage of visits by people who had never visited the website before.

Organic – Web traffic which comes from unpaid listing at search engines or directories.

Annual briefing to ESDIS

slide11

HDF-EOS Website Statistics Comparison

Oct

Jul

Aug

Sep

Annual briefing to ESDIS

month by month visits comparison
Month by Month Visits Comparison

Annual briefing to ESDIS

traffic sources
Traffic Sources

- Visitors who typed in the URL directly

  • Visitors who clicked a link from another
  • website

- Visitors who used a search engine

Annual briefing to ESDIS

pageviews
Pageviews

Annual briefing to ESDIS

slide16

Top Pages Viewed

Annual briefing to ESDIS

current work

Current work

Annual briefing to ESDIS

current work1
Current Work
  • Collect sample files for NASA HDF4/HDF-EOS2 products
  • Provide special HDF-EOS description for each sample file
  • Examine the access of each sample file with widely used tools
  • Provide the codes and the plots generated from the tools for each sample file

Annual briefing to ESDIS

tools to access the hdf data
Tools to access the HDF data
  • NCL
  • MatLab
  • IDL

Annual briefing to ESDIS

datapool example
Datapool Example

11/28/2014

Annual briefing to ESDIS

24

hdf opendap work update

HDF OPeNDAP Work Update

Annual briefing to ESDIS

hdf5 opendap handler
HDF5 –OPeNDAP Handler
  • Four official releases from OPeNDAP website
  • The latest release date is February 2010
  • Add the support for HDF-EOS5 Aura swath files
  • Aura MLS, OMI, HIRDLS files are served via OPeNDAP
  • URL: http://opendap.org/download/hdf5_handler.html

Annual briefing to ESDIS

slide27

Access Aura MLS data via OPeNDAP

http://hdfeos.org/software/ncl_opendap_mls.php

Annual briefing to ESDIS

hdf4 opendap handler

HDF4 OPeNDAP Handler

Annual briefing to ESDIS

phase 1 work review
Phase 1 work review
  • Time: April 2009 – October 2009
  • Enhanced the original HDF4-OPeNDAP handler
  • Some HDF-EOS2 data can be served via OPeNDAP
  • Provided a version to GES DISC

Annual briefing to ESDIS

phase 2 work
Phase 2 work
  • Time: November 2009 – July 2010
  • Goal: Enhance the HDF4-OPeNDAP handler so that more NASA HDF-EOS2 and HDF4 data can be served via OPeNDAP

Annual briefing to ESDIS

phase 2 work1
Phase 2 work
  • Comprehensive examinations of all NASA HDF-EOS2 data products

- NASA Data pool in the previous slides

  • Come up with the re-design based on the examinations
  • Re-implement the HDF-EOS2 module of HDF4-OPeNDAP handler
  • Add the support for handling some NASA pure HDF4 data

Annual briefing to ESDIS

phase 2 current status
Phase 2 - Current Status
  • We finished the examination of NASA HDF-EOS2 products
  • We finished the design note of HDF-EOS2 module of HDF4-OPeNDAP handler
  • We finished implementing 90% features of the HDF-EOS2 module
  • We provided a customized version for GES DISC to test

Annual briefing to ESDIS

phase 2 current work highlights
Phase 2 – Current Work Highlights
  • Focus on making the data accessible by Java-based OPeNDAP clients
  • Strictly Follow CF/COARD conventions
  • Handle different HDF-EOS2 cases

Annual briefing to ESDIS

phase 2 work plan
Phase 2 work plan
  • Time: Now to July 14th, 2010
  • Finish all features for the HDF-EOS2 module
  • Handle Hybrid HDF-EOS2 files
  • Handle some NASA HDF4 files

Annual briefing to ESDIS

hdf eos5 augmentation tool

HDF-EOS5 augmentation tool

Annual briefing to ESDIS

hdf eos5 and netcdf 4
HDF-EOS5 and NetCDF-4
  • Enabling NetCDF4 to access HDF-EOS5 data
    • Conversion
    • Augmentation
      • One file can be used for both EOS5 and NetCDF-4.
      • Note that EOS5 users are not affected at all.

NetCDF-4

file

Augmentation

HDF-EOS5

file

HDF-EOS5

Augmented

HDF-EOS5

file

NetCDF4

HDF5

HDF5

Annual briefing to ESDIS

goals
Goals
  • Augmented file must be readable through
    • NetCDF-4 API as well as HDF-EOS5 API
  • How?
    • Read info in theHDF-EOS5 part.
    • Transform it to conform to NetCDF-4 model. .
    • Append the new info.

+ =

Annual briefing to ESDIS

past work review
Past Work Review

Collected and Examined different HDF-EOS5 data

  • Not all Aura HDF-EOS5 files use projection for storing dimension values.
  • For example, OMI L2G grid files store lat/lon in data fields.
  • TES grid files use both ways.

Annual briefing to ESDIS

past work review1
Past Work Review

Provided a customized version for HIRDLS team

  • To follow the netCDF4 data model, we need users to provide the information about the dimension fields.
  • MLS and HIRDLS data are vertical profilers. The dimension fields are Pressure and Time.
  • We need similar information for other instruments.

Annual briefing to ESDIS

future work
Future Work
  • Handle other cases:

OMI L2G,future HIRDLS/MLS grid

  • Design a general input file for insufficient information
  • Continue testing with NetCDF-4 snapshots
  • Consistency checker
    • If one modifies dim info in an augmented file, file becomes inconsistent.
  • Testing, Documentation

Annual briefing to ESDIS

thank you

Thank You!

Annual briefing to ESDIS

acknowledgements
Acknowledgements

This work was supported by the Cooperative Agreement with the National Aeronautics and Space Administration (NASA) under NASA grant NNX06AC83A and NNX08A077A.

Any opinions, findings, conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of NASA.

Annual briefing to ESDIS

questions comments

Questions/comments?

Annual briefing to ESDIS

backup slides

Backup slides

Annual briefing to ESDIS

role of hdf4 opendap handler
Role of HDF4-OPeNDAP handler

OPeNDAP Clients

OPeNDAP

HDF-EOS2

HDF4-OPeNDAP handler

Annual briefing to ESDIS