slide1
Download
Skip this Video
Download Presentation
Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC

Loading in 2 Seconds...

play fullscreen
1 / 17

Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC - PowerPoint PPT Presentation


  • 119 Views
  • Uploaded on

HDF-EOS Data Extractor & Metadata Updater. Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC NASA/GSFC, Code 423 For HDF-EOS Workshop VII September 23-25, 2003. HEEX.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC' - kinsey


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide1
HDF-EOS Data Extractor & Metadata Updater

Zhangshi Yin, Jingli Yang, Bob Bane,

Muhammad Rabi, Richard Ullman

Data Usability Group, NASA/GSFC

NASA/GSFC, Code 423

For HDF-EOS Workshop VII

September 23-25, 2003

slide2
HEEX
  • HDF-EOS Data Extractor (HEEX) is a tool for data users to extract HDF-EOS data to binary or ASCII data format in HTML or XML.
slide3
Motivation
  • Flat binary and ASCII data are required by some users.
  • They can be imported to IDL, ARC/INFO and used in any programming.
  • Extracted flat binary and ASCII data can be another intermediate data format for storing EOS data.
slide4
HEEX Flowchart

HDF-EOS Data

HTML

XML

Binary Data

ASCII Data

Binary Data

ASCII Data

slide5
Usage

heex [-aehx] [-f] [FieldName] -o OutputDirectory HDF-EOS5FileName

HDF-EOS5FileName: HDF-EOS5 file name. Required.

-a Extract data to ASCII format. Default is binary. Optional.

-e Extract every field. Optional.

-f FieldName: extract a field data specified by objec/field. Optional.

If no -e and -f options, only index file, no data.

-h Help message. Optional.

-o OutputDirectory: the directory to put data. Required.

-x Extract IndexFile data to XML format. Default is html. Optional.

slide6
Extracted Data
  • HEEX will extract all data into a directory indicated in -o optional by user.A file called Index.html or Index.xml in the directory will show all HDF-EOS data structure and where data are.
slide7
Inex File

 -HDFEOS-File Name=grid.he Type="HDFEOS" -HDFEOS

-GRIDS

-Grid

+Parameters

+Dimension

-GridDataField

+sst_mask_1

-HDFEOS_INFORMATION

-COREMETADATA

+CoreMetadata.0

+ARCHIVEMETADATA

slide8
Inex File

 -sst_mask_1

DataType=Integer

Sign=false

Size=1

+DimList

+FieldStorage

Data: ./Grid/sst_mask_1.dat

slide9
HEMU
  • HDF-EOS Metadata Updater (HEMU) is a tool for data producers or usersto update metadata inside an HDF-EOS file (HDF-EOS2 and HDF-EOS5).
slide10
Motivation
  • Users need to read metadata from HDF-EOS data.
  • Users need to write metadata files to HDF-EOS data replace all metadata in the HDF-EOS data.
  • Users need to update metadata in HDF-EOS data by merging metadata inside HDF-EOS data and metadata from .met files.
slide11
Capabilities

 1. Extract metadata from a dataset (-x option) to a text file which can then be modified with any text editor. This option does not modifythe HDF-EOS file.

2. Replace metadata with text from an external file (-f option). Thetext is syntax-checked for validity as ODL before updating.

 3. Update metadata with text from an external file (-m option). Thisoption is designed to update metadata using a .met file.

slide12
HEMU Read Flowchart

HDF-EOS Data

Read

CoreMetadata

InventoryMetadata

ArchiveMetadata

Metadata

slide13
HEMU Write Flowchart

.Met Data

HDF-EOS Data

Read Metadata

Read Metadata

Check Syntax

Check Syntax

Check Values:

SHORTNAME

PRODUCTIONDATETIME

VERSIONID

If equal, replace

metadata in HDF-EOS

using metadata in .met

If not equal, exit

slide14
HEMU Merge Flowchart

.Met Data

HDF-EOS Data

Read Metadata

Read Metadata

Check Syntax

Check Syntax

Check Values:

SHORTNAME

PRODUCTIONDATETIME

VERSIONID

If equal, replace metadata

in HDF-EOS using

CollectionMetadata

InventoryMetadata in .met

and ArchiveMetadata in HDF-EOS

If not equal, exit

slide15
Usage

 hemu [-h] HDF-EOSFileName -xmf [MetadataFileName]

-h Print help message.

-x Extract metadata from HDFEOS file.

-m Update metadata with a .met file input.

-f Forcibly replace metadata with metadata from input.

HDF-EOSFileName: HDF-EOS file. Required.

MetadataFileName: Metadata file. Optional

(default is standard input/output).

slide16
Syntax and Value Check
  • HEMU will check metadata syntax by ODL program. For -m and –f options (update metadata with a .met file), three parameters in INVENTORYMETADATA group (SHORTNAME, PRODUCTIONDATETIME, and VERSIONID) must match before the tool will modify the metadata.
slide17
Get HEEX & HEMU

  http://hdfeos.gsfc.nasa.gov/hdfeos/index.cfm

ad