HDF-EOS Data Extractor & Metadata Updater
Download
1 / 17

Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC - PowerPoint PPT Presentation


  • 107 Views
  • Uploaded on
  • Presentation posted in: General

HDF-EOS Data Extractor & Metadata Updater. Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC NASA/GSFC, Code 423 For HDF-EOS Workshop VII September 23-25, 2003. HEEX.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha

Download Presentation

Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


HDF-EOS Data Extractor & Metadata Updater

Zhangshi Yin, Jingli Yang, Bob Bane,

Muhammad Rabi, Richard Ullman

Data Usability Group, NASA/GSFC

NASA/GSFC, Code 423

For HDF-EOS Workshop VII

September 23-25, 2003


HEEX

  • HDF-EOS Data Extractor (HEEX) is a tool for data users to extract HDF-EOS data to binary or ASCII data format in HTML or XML.


Motivation

  • Flat binary and ASCII data are required by some users.

  • They can be imported to IDL, ARC/INFO and used in any programming.

  • Extracted flat binary and ASCII data can be another intermediate data format for storing EOS data.


HEEX Flowchart

HDF-EOS Data

HTML

XML

Binary Data

ASCII Data

Binary Data

ASCII Data


Usage

heex [-aehx] [-f] [FieldName] -o OutputDirectory HDF-EOS5FileName

HDF-EOS5FileName: HDF-EOS5 file name. Required.

-a Extract data to ASCII format. Default is binary. Optional.

-e Extract every field. Optional.

-f FieldName: extract a field data specified by objec/field. Optional.

If no -e and -f options, only index file, no data.

-h Help message. Optional.

-o OutputDirectory: the directory to put data. Required.

-x Extract IndexFile data to XML format. Default is html. Optional.


Extracted Data

  • HEEX will extract all data into a directory indicated in -o optional by user.A file called Index.html or Index.xml in the directory will show all HDF-EOS data structure and where data are.


Inex File

 -HDFEOS-File Name=grid.he Type="HDFEOS" -HDFEOS

-GRIDS

-Grid

+Parameters

+Dimension

-GridDataField

+sst_mask_1

-HDFEOS_INFORMATION

-COREMETADATA

+CoreMetadata.0

+ARCHIVEMETADATA


Inex File

 -sst_mask_1

DataType=Integer

Sign=false

Size=1

+DimList

+FieldStorage

Data: ./Grid/sst_mask_1.dat


HEMU

  • HDF-EOS Metadata Updater (HEMU) is a tool for data producers or usersto update metadata inside an HDF-EOS file (HDF-EOS2 and HDF-EOS5).


Motivation

  • Users need to read metadata from HDF-EOS data.

  • Users need to write metadata files to HDF-EOS data replace all metadata in the HDF-EOS data.

  • Users need to update metadata in HDF-EOS data by merging metadata inside HDF-EOS data and metadata from .met files.


Capabilities

 1. Extract metadata from a dataset (-x option) to a text file which can then be modified with any text editor. This option does not modifythe HDF-EOS file.

2. Replace metadata with text from an external file (-f option). Thetext is syntax-checked for validity as ODL before updating.

 3. Update metadata with text from an external file (-m option). Thisoption is designed to update metadata using a .met file.


HEMU Read Flowchart

HDF-EOS Data

Read

CoreMetadata

InventoryMetadata

ArchiveMetadata

Metadata


HEMU Write Flowchart

.Met Data

HDF-EOS Data

Read Metadata

Read Metadata

Check Syntax

Check Syntax

Check Values:

SHORTNAME

PRODUCTIONDATETIME

VERSIONID

If equal, replace

metadata in HDF-EOS

using metadata in .met

If not equal, exit


HEMU Merge Flowchart

.Met Data

HDF-EOS Data

Read Metadata

Read Metadata

Check Syntax

Check Syntax

Check Values:

SHORTNAME

PRODUCTIONDATETIME

VERSIONID

If equal, replace metadata

in HDF-EOS using

CollectionMetadata

InventoryMetadata in .met

and ArchiveMetadata in HDF-EOS

If not equal, exit


Usage

 hemu [-h] HDF-EOSFileName -xmf [MetadataFileName]

-h Print help message.

-x Extract metadata from HDFEOS file.

-m Update metadata with a .met file input.

-f Forcibly replace metadata with metadata from input.

HDF-EOSFileName: HDF-EOS file. Required.

MetadataFileName: Metadata file. Optional

(default is standard input/output).


Syntax and Value Check

  • HEMU will check metadata syntax by ODL program. For -m and –f options (update metadata with a .met file), three parameters in INVENTORYMETADATA group (SHORTNAME, PRODUCTIONDATETIME, and VERSIONID) must match before the tool will modify the metadata.


Get HEEX & HEMU

  http://hdfeos.gsfc.nasa.gov/hdfeos/index.cfm


ad
  • Login