hdf eos5 validator tool n.
Skip this Video
Download Presentation
HDF-EOS5 Validator Tool

Loading in 2 Seconds...

play fullscreen
1 / 16

HDF-EOS5 Validator Tool - PowerPoint PPT Presentation

  • Uploaded on

HDF-EOS5 Validator Tool. Bob Bane Jingli Yang Richard Ullman Data Usability Task NASA/GSFC. HDF-EOS5 Validator. Validates HDF-EOS5 files against guidelines Guidelines are encoded in XML Output is a report with specific non-conformance messages. Why HDF-EOS5 Validator?.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'HDF-EOS5 Validator Tool' - mira-bond

Download Now An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
hdf eos5 validator tool

HDF-EOS5 Validator Tool

Bob Bane

Jingli Yang

Richard Ullman

Data Usability Task


HDF-EOS Workshop VII

hdf eos5 validator
HDF-EOS5 Validator
  • Validates HDF-EOS5 files against guidelines
  • Guidelines are encoded in XML
  • Output is a report with specific non-conformance messages

HDF-EOS Workshop VII

why hdf eos5 validator
Why HDF-EOS5 Validator?
  • Insures that product files:
    • Have all data and metadata items they are supposed to contain
    • Those items are of correct name, type, and size
  • Validator is a tool mainly for data producers to check format of files before delivering them to users.

HDF-EOS Workshop VII

hdf eos5 validator1

HDF-EOS5 file





(in XML)

HDF-EOS5 Validator

HDF-EOS Workshop VII

xml description of file format guidelines
Like a checklist

List of features that must/should be in file

And their characteristics

Not all-inclusive

Extra things in file will not be reported

XML Description of File Format Guidelines

HDF-EOS Workshop VII

what can be validated
What can be validated?
  • Swaths
    • Every swath
    • Swaths with a specific name
    • Fields
      • Data
        • Every/specific name
      • Geolocation
        • Every/specific name
    • Dimensions
      • Name, size

HDF-EOS Workshop VII

what can be validated cont
What can be validated (cont)?
  • Attributes
    • Global/Swath/Field
    • Type
      • String
        • Value/Set/regular expression
      • Integer/Float
        • Value/Range

HDF-EOS Workshop VII

examples stringvalue
Examples: StringValue
  • <StringValue/>
    • Any string
  • <StringValue matches=“seconds *”/>
    • “seconds” followed by spaces
  • <StringValue><OneOf><s>foo</s><s>bar</s></OneOf></StringValue>
    • “foo” or “bar”

HDF-EOS Workshop VII

examples intvalue
Examples: IntValue
  • <IntValue/>
    • Any integer value
  • <IntValue min=“17” max=“42”/>
    • Integer between 17 and 42 inclusive
  • <IntValue> min=“0”/>
    • Non-negative integer

HDF-EOS Workshop VII

example dimension
Example: Dimension
  • <Dimension name=“Latitude”/>
    • name is required
  • <Dimension name=“Height” size=“100”/>
    • size is fixed
  • <Dimension name=“X” min=“5” max=“10”/>
    • Size can be in range 5-10

HDF-EOS Workshop VII

examples attributes
Examples: Attributes



<Attribute name=“InstrumentName”>





<Attribute name=“FieldCount”>

<IntValue min=“0” max=“10”/>




HDF-EOS Workshop VII

overall file structure
Overall File Structure








<Dimension … />


<Dimension … />

HDF-EOS Workshop VII

overall file structure cont
Overall File Structure (cont.)



<DataType … />




<GeolocationField-Named name=“LatLon”>

<DataType … />

<Dimensions> …

<Attributes> …

HDF-EOS Workshop VII

  • Command line
  • C
  • HDF-EOS5 library
  • Open source XML parsing libraries
    • expat
    • SCEW
  • Portable to any HDF-EOS5 platform

HDF-EOS Workshop VII

sample output report
Sample Output Report

$ validate_hdfeos5 -x HIRDLS-definition.xml -h test.h5


Missing mandatory dimension: nWavel


string "TAI "

doesn't match <StringValue value="seconds"/>


Missing mandatory geolocation field: Altitude


Missing mandatory data field: TemperatureNormChiSq

Errors: 4

HDF-EOS Workshop VII

  • Supports needs of Aura (our test case)
    • Swaths (no Grids/Points yet)
    • Prototype descriptions
      • For HIRDLS, MLS, OMI, TES
      • Based on Aura Data Format Guidelines document
      • Tested against Aura data samples, and correctly reported variances from guidelines
    • Goal is for product producers to write/maintain their own description files

HDF-EOS Workshop VII