HDF-EOS Data Extractor & Metadata Updater
This presentation is the property of its rightful owner.
Sponsored Links
1 / 17

Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC PowerPoint PPT Presentation


  • 89 Views
  • Uploaded on
  • Presentation posted in: General

HDF-EOS Data Extractor & Metadata Updater. Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC NASA/GSFC, Code 423 For HDF-EOS Workshop VII September 23-25, 2003. HEEX.

Download Presentation

Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

HDF-EOS Data Extractor & Metadata Updater

Zhangshi Yin, Jingli Yang, Bob Bane,

Muhammad Rabi, Richard Ullman

Data Usability Group, NASA/GSFC

NASA/GSFC, Code 423

For HDF-EOS Workshop VII

September 23-25, 2003


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

HEEX

  • HDF-EOS Data Extractor (HEEX) is a tool for data users to extract HDF-EOS data to binary or ASCII data format in HTML or XML.


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

Motivation

  • Flat binary and ASCII data are required by some users.

  • They can be imported to IDL, ARC/INFO and used in any programming.

  • Extracted flat binary and ASCII data can be another intermediate data format for storing EOS data.


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

HEEX Flowchart

HDF-EOS Data

HTML

XML

Binary Data

ASCII Data

Binary Data

ASCII Data


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

Usage

heex [-aehx] [-f] [FieldName] -o OutputDirectory HDF-EOS5FileName

HDF-EOS5FileName: HDF-EOS5 file name. Required.

-a Extract data to ASCII format. Default is binary. Optional.

-e Extract every field. Optional.

-f FieldName: extract a field data specified by objec/field. Optional.

If no -e and -f options, only index file, no data.

-h Help message. Optional.

-o OutputDirectory: the directory to put data. Required.

-x Extract IndexFile data to XML format. Default is html. Optional.


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

Extracted Data

  • HEEX will extract all data into a directory indicated in -o optional by user.A file called Index.html or Index.xml in the directory will show all HDF-EOS data structure and where data are.


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

Inex File

 -HDFEOS-File Name=grid.he Type="HDFEOS" -HDFEOS

-GRIDS

-Grid

+Parameters

+Dimension

-GridDataField

+sst_mask_1

-HDFEOS_INFORMATION

-COREMETADATA

+CoreMetadata.0

+ARCHIVEMETADATA


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

Inex File

 -sst_mask_1

DataType=Integer

Sign=false

Size=1

+DimList

+FieldStorage

Data: ./Grid/sst_mask_1.dat


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

HEMU

  • HDF-EOS Metadata Updater (HEMU) is a tool for data producers or usersto update metadata inside an HDF-EOS file (HDF-EOS2 and HDF-EOS5).


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

Motivation

  • Users need to read metadata from HDF-EOS data.

  • Users need to write metadata files to HDF-EOS data replace all metadata in the HDF-EOS data.

  • Users need to update metadata in HDF-EOS data by merging metadata inside HDF-EOS data and metadata from .met files.


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

Capabilities

 1. Extract metadata from a dataset (-x option) to a text file which can then be modified with any text editor. This option does not modifythe HDF-EOS file.

2. Replace metadata with text from an external file (-f option). Thetext is syntax-checked for validity as ODL before updating.

 3. Update metadata with text from an external file (-m option). Thisoption is designed to update metadata using a .met file.


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

HEMU Read Flowchart

HDF-EOS Data

Read

CoreMetadata

InventoryMetadata

ArchiveMetadata

Metadata


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

HEMU Write Flowchart

.Met Data

HDF-EOS Data

Read Metadata

Read Metadata

Check Syntax

Check Syntax

Check Values:

SHORTNAME

PRODUCTIONDATETIME

VERSIONID

If equal, replace

metadata in HDF-EOS

using metadata in .met

If not equal, exit


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

HEMU Merge Flowchart

.Met Data

HDF-EOS Data

Read Metadata

Read Metadata

Check Syntax

Check Syntax

Check Values:

SHORTNAME

PRODUCTIONDATETIME

VERSIONID

If equal, replace metadata

in HDF-EOS using

CollectionMetadata

InventoryMetadata in .met

and ArchiveMetadata in HDF-EOS

If not equal, exit


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

Usage

 hemu [-h] HDF-EOSFileName -xmf [MetadataFileName]

-h Print help message.

-x Extract metadata from HDFEOS file.

-m Update metadata with a .met file input.

-f Forcibly replace metadata with metadata from input.

HDF-EOSFileName: HDF-EOS file. Required.

MetadataFileName: Metadata file. Optional

(default is standard input/output).


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

Syntax and Value Check

  • HEMU will check metadata syntax by ODL program. For -m and –f options (update metadata with a .met file), three parameters in INVENTORYMETADATA group (SHORTNAME, PRODUCTIONDATETIME, and VERSIONID) must match before the tool will modify the metadata.


Zhangshi yin jingli yang bob bane muhammad rabi richard ullman data usability group nasa gsfc

Get HEEX & HEMU

  http://hdfeos.gsfc.nasa.gov/hdfeos/index.cfm


  • Login