HDF-EOS Data Extractor & Metadata Updater
Sponsored Links
This presentation is the property of its rightful owner.
1 / 17

Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC PowerPoint PPT Presentation


  • 96 Views
  • Uploaded on
  • Presentation posted in: General

HDF-EOS Data Extractor & Metadata Updater. Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC NASA/GSFC, Code 423 For HDF-EOS Workshop VII September 23-25, 2003. HEEX.

Download Presentation

Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


HDF-EOS Data Extractor & Metadata Updater

Zhangshi Yin, Jingli Yang, Bob Bane,

Muhammad Rabi, Richard Ullman

Data Usability Group, NASA/GSFC

NASA/GSFC, Code 423

For HDF-EOS Workshop VII

September 23-25, 2003


HEEX

  • HDF-EOS Data Extractor (HEEX) is a tool for data users to extract HDF-EOS data to binary or ASCII data format in HTML or XML.


Motivation

  • Flat binary and ASCII data are required by some users.

  • They can be imported to IDL, ARC/INFO and used in any programming.

  • Extracted flat binary and ASCII data can be another intermediate data format for storing EOS data.


HEEX Flowchart

HDF-EOS Data

HTML

XML

Binary Data

ASCII Data

Binary Data

ASCII Data


Usage

heex [-aehx] [-f] [FieldName] -o OutputDirectory HDF-EOS5FileName

HDF-EOS5FileName: HDF-EOS5 file name. Required.

-a Extract data to ASCII format. Default is binary. Optional.

-e Extract every field. Optional.

-f FieldName: extract a field data specified by objec/field. Optional.

If no -e and -f options, only index file, no data.

-h Help message. Optional.

-o OutputDirectory: the directory to put data. Required.

-x Extract IndexFile data to XML format. Default is html. Optional.


Extracted Data

  • HEEX will extract all data into a directory indicated in -o optional by user.A file called Index.html or Index.xml in the directory will show all HDF-EOS data structure and where data are.


Inex File

 -HDFEOS-File Name=grid.he Type="HDFEOS" -HDFEOS

-GRIDS

-Grid

+Parameters

+Dimension

-GridDataField

+sst_mask_1

-HDFEOS_INFORMATION

-COREMETADATA

+CoreMetadata.0

+ARCHIVEMETADATA


Inex File

 -sst_mask_1

DataType=Integer

Sign=false

Size=1

+DimList

+FieldStorage

Data: ./Grid/sst_mask_1.dat


HEMU

  • HDF-EOS Metadata Updater (HEMU) is a tool for data producers or usersto update metadata inside an HDF-EOS file (HDF-EOS2 and HDF-EOS5).


Motivation

  • Users need to read metadata from HDF-EOS data.

  • Users need to write metadata files to HDF-EOS data replace all metadata in the HDF-EOS data.

  • Users need to update metadata in HDF-EOS data by merging metadata inside HDF-EOS data and metadata from .met files.


Capabilities

 1. Extract metadata from a dataset (-x option) to a text file which can then be modified with any text editor. This option does not modifythe HDF-EOS file.

2. Replace metadata with text from an external file (-f option). Thetext is syntax-checked for validity as ODL before updating.

 3. Update metadata with text from an external file (-m option). Thisoption is designed to update metadata using a .met file.


HEMU Read Flowchart

HDF-EOS Data

Read

CoreMetadata

InventoryMetadata

ArchiveMetadata

Metadata


HEMU Write Flowchart

.Met Data

HDF-EOS Data

Read Metadata

Read Metadata

Check Syntax

Check Syntax

Check Values:

SHORTNAME

PRODUCTIONDATETIME

VERSIONID

If equal, replace

metadata in HDF-EOS

using metadata in .met

If not equal, exit


HEMU Merge Flowchart

.Met Data

HDF-EOS Data

Read Metadata

Read Metadata

Check Syntax

Check Syntax

Check Values:

SHORTNAME

PRODUCTIONDATETIME

VERSIONID

If equal, replace metadata

in HDF-EOS using

CollectionMetadata

InventoryMetadata in .met

and ArchiveMetadata in HDF-EOS

If not equal, exit


Usage

 hemu [-h] HDF-EOSFileName -xmf [MetadataFileName]

-h Print help message.

-x Extract metadata from HDFEOS file.

-m Update metadata with a .met file input.

-f Forcibly replace metadata with metadata from input.

HDF-EOSFileName: HDF-EOS file. Required.

MetadataFileName: Metadata file. Optional

(default is standard input/output).


Syntax and Value Check

  • HEMU will check metadata syntax by ODL program. For -m and –f options (update metadata with a .met file), three parameters in INVENTORYMETADATA group (SHORTNAME, PRODUCTIONDATETIME, and VERSIONID) must match before the tool will modify the metadata.


Get HEEX & HEMU

  http://hdfeos.gsfc.nasa.gov/hdfeos/index.cfm


  • Login