Idn task team update
This presentation is the property of its rightful owner.
Sponsored Links
1 / 102

IDN TASK TEAM Update PowerPoint PPT Presentation


  • 104 Views
  • Uploaded on
  • Presentation posted in: General

IDN TASK TEAM Update. Presented by Lola Olsen Budapest, Hungary CEOS WGISS-21 May 9, 2006. Notes from the Ukraine meeting. MD9.5ß Software Release Demonstrated Primary action items assigned to the IDN Task Team Completed tasks: Set up GEOSS portal for WGISS to review

Download Presentation

IDN TASK TEAM Update

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Idn task team update

IDN TASK TEAMUpdate

Presented by

Lola Olsen

Budapest, Hungary

CEOS WGISS-21

May 9, 2006


Notes from the ukraine meeting

Notes from the Ukraine meeting

  • MD9.5ß Software Release Demonstrated

  • Primary action items assigned to the IDN Task Team

    • Completed tasks:

    • Set up GEOSS portal for WGISS to review

    • Prepared related service/tool (SERF) descriptions for GEOSS-related services.

    • Sent the URL to all of WGISS for the Conference Calendar (provided on IDN website-see “calendar” tab).

    • Updated lyrics of ‘We WGISS’ and captured into an audio file.


Idn website current homepage

IDN Website – Current Homepage


New idn map

New IDN Map


New idn web site header

New IDN Web Site Header

New tabs that link Data Sets, Data Services & the

Conference Calendar. Action (3) from Cordoba


Status of idn site

Status of IDN Site

  • IDN Website continues to use Zope/Plone.

  • Discussion List. Used the Interoperability Forum to provide feedback on:

    • Data resolution options

    • DIF extension for Models

    • Platform/Instrument Restructure

    • Renaming of Keyword Fields

    • Geographic Location Hierarchy


Numerical model fields proposed 2002 03

Numerical Model Fields Proposed (2002/03)

  • Anne Sophie Archambeau from IPSL, France proposed an addition to the DIF to handle numerical output data sets:

    Group: Numerical_Experiment

    Model_Name:

    Model_Version:

    Model_URL:

    Model_Configuration:

    Model_Resolution:

    Model_Calendar:

    Group: Model_Integration_Period

    Start_Date:

    Stop_Date:

    End_Group

    Simulation_Name:

    Initial_Conditions:

    Perturbation:

    Imposed_Boundary_Conditions:

    End_Group

  • Interop discussions on the proposed new fields are summarized in the CEOS IDN Interop Newsletter #15 for April 2003:

First proposed in 2002

http://gcmd.gsfc.nasa.gov/pipermail/interop/2003-April/000011.html


Instrument and platform upgrade

Instrument and Platform Upgrade

  • Implement an option to list all instruments and platforms alphabetically for searching.

  • Expanded database table structures for Instrument and Platform information and categories.

  • Extend Supplemental Information to include expanded Instrument and Platform information.

  • Feedback Welcome!


Instrument and platform upgrade1

Instrument and Platform Upgrade

  • Instrument database information can include:

    • Instrument Name (currently exists as short name > long name

    • Categories: types, subtypes (can be used in web interface for browsing. For example:

      • Earth Viewing vs. Space Viewing vs. in situ, etc.

      • Wavelength region (microwave vs. visible, etc.)

    • Channels (if appropriate)

    • Spectral information; instrument information.

  • Platform database information can include:

    • Platform name (currently exists as short name > long name

    • Categories: type of platform (e.g. Landsat Series)

    • Instrument names (if appropriate): link to instrument database table.

    • Platform orbital and launch information.


Instrument group

Group: Instrument

Group: Instrument_Identification

*Instrument_Category:

*Instrument_Class:

*Instrument_Type:

*Instrument_Subtype:

*Short_Name:

*Long Name:

End_Group

Group: Associated_Sensors

*Short_Name (r):

End_Group

Group: Spectral/Frequency Information

*Wavelength Keyword: (r)

Number_Channels:

Spectral/Frequency Coverage/Range:

Spectral/Frequency Resolution:

IFOV:

Radiometric_Resolution

End_Group

Group: Description

End_Group

Online_Resource: (r)

Creation_Date:

Revision_Date:

*IDN_Node: (r)

Group: Instrument_Logistics

Instrument_Start_Date:

Instrument_Owner (r):

End_Group

End_Group

Instrument Group

(r) = repeatable field

* = controlled keywords

italics = required fields.


Platform group

Group: Platform

Group: Platform_Identification

*Platform_Category:

*Platform_Series/Entity:

*Short_Name:

*Long_Name :

End_Group

Group: Alternate_Platform_Names

Short_Name (r):

End_Group

Group: Associated Instruments

*Short_Name: (r)

End_Group

Group: Orbit

Orbit_Altitude:

Orbit_Inclination:

Equator_Crossing:

Period:

Repeat_Cycle:

Perigee:

Apogee:

*Orbit_Type:

End_Group

Group: Description

<text>

End_Group

Creation_Date:

Revision_Date:

Online_Resource: (r)

*IDN_Node: (r)

Group: Platform_Logistics

Launch_Date:

Launch_Site:

Primary_Sponsor (r):

End_Group

End_Group

Platform Group

(r) = repeatable field

* = controlled keywords

italics = required fields.

Note: Instrument short_names will be valid Sensor_Names in the database.

Note: Alternate Platform Names will refer to Platform short names in the database


Instrument example

Group: Instrument

Group: Instrument_Identification

Instrument_Category: Earth Remote Sensing Instruments

Instrument_Class: Active Remote Sensing

Instrument_Type: Altimeters

Instrument_Subtype: Lidar/Laser Altimeters

Short_Name: GLAS

Long Name: Geoscience Laser Altimeter System

End_Group

Group: Associated_Sensors

*Short_Name:

End_Group

Group: Spectral/Frequency Information

Wavelength_Keyword: Radar

Number_Channels: 2

Spectral/Frequency Coverage Range: 1064 nm, 532 nm

Spectral/Frequency Resolution:

IFOV: 70 m

Radiometric_Resolution:

End_Group

Group: Description

End_Group

Online_Resource: http://www.csr.utexas.edu/glas/Instrument_Description/

Creation_Date: 2006-03-23

Revision_Date:

IDN_Node: USA/NASA

Group: Instrument_Logistics

Instrument_Start_Date:

Instrument_Owner: NASA

End_Group

End_Group

Instrument Example


Instrument example1

Instrument Example

Group: Instrument

Group: Instrument_Identification

*Instrument_Category: Earth Remote Sensing Instrument

*Instrument_Class:Passive Remote Sensing

*Instrument_Type: Photon/Optical Detectors

*Instrument_Subtype: Photometer

*Short_Name: Sun Photometer

*Long Name: Sun Photometer

End_Group

Group: Associated_Sensors

*Short_Name (r): Photometer

End_Group

Group: Spectral/Frequency Information

*Wavelength Keyword: (r) Varied

Number_Channels:

Spectral/Frequency Coverage Range:

Spectral/Frequency Resolution:

IFOV:

Radiometric_Resolution

End_Group

Group: Description

End_Group

Online_Resource: (r)

Creation_Date: 2006-04-04

Revision_Date: 2006-04-04

*IDN_Node: USA/NASA

Group: Instrument_Logistics

Instrument_Start_Date:

Instrument_Owner (r):

End_Group

End_Group


Platform example

Platform Example

Group: Platform

Group: Platform_Identification

Platform_Category: Earth Observing Satellite

Platform_Series/Entity: EOS

Short_Name: Aqua

Long_Name: Aqua

End_Group

Group: Alternate Platform Names

Short_Name: PM-1

End_Group

Group: Associated Instruments

Instrument_Short_Name: MODIS

Instrument_Short_Name: AMSR-E

Instrument_Short_Name: AMSU-A

Instrument_Short_Name: CERES

Instrument_Short_Name: AIRS

Instrument_Short_Name: HSB

End_Group

Group: Orbit

Orbit_Altitude: 705 km

Orbit_Inclination: 98.2 degrees

Equator_Crossing: 1:30 pm, ascending node

Period: 99 minutes

Repeat_Cycle: 16 days

Perigee: 673 km *

Apogee: 686 km *

Orbit_Type: Sun Synchronous

End_Group

Group: Description

End_Group

Creation_Date: 2005-08-25

Revision_Date: 2006-03-22

Online_Resource: http://aqua.nasa.gov

IDN_Node: USA/NASA

Group: Platform_Logistics

Launch_Date: 4 May 2002

Launch_Site: Vandenberg AFB

Primary_Sponsor: NASA

End_Group

End_Group


Node reports

Node Reports


Jcadm report

JCADM Report


Idn task team update

Antarctic Master Directory (AMD)

  • 3900 Total Records

  • 30% Contain Direct Data Links (estimated)

  • Cover 13 Earth Science Disciplines

  • Contributions from

  • 22 Countries

  • Over 10,000 Hits in 2005

  • - 5,500 Retrievals in 2005

  • Highly Customized

  • Portal Interfaces with 16 NADC Portals

http://gcmd.nasa.gov/portals/amd/


Idn task team update

Data Access Portals

The GCMD hosts a total of 70 highly customized portals

16 NADC AMD portals

8 new portals:

Spain, Uruguay,

Italy – Feb.

France – Jun.

Chile – Jul.

New Zealand,

Malaysia – Oct.

China – Apr. ‘06

http://gcmd.nasa.gov/portals/amd_my/


Idn task team update

Antarctic Master Directory - NADC PortalsThe alias format is http://gcmd.nasa.gov/portals/portal_name/Examples of alias: http://gcmd.nasa.gov/portals/amd_ar/

  • Belgium Antarctic Program – Jan. 2003

  • Finnish Antarctic Program – Jan. 2003

  • Centro de Datos Antárticos, Argentina – Aug. 2003

  • Canadian Polar Commission/Canadian Committee for Antarctic Research – Oct. 2003

  • Swiss Committee on Polar Research – Nov. 2003

  • US Antarctic Data Centers/US Antarctic Data Coordination Center - Feb. 2004

  • Japan National Institute for Polar Research – Feb. 2004

  • Estonian Antarctic Data Center – Jul. 2004

  • Centro Nacional de Datos Antárticos, Spain – Feb. 2005

  • Instituto Antartico Uruguayo – Feb. 2005

  • Italian Antarctic Program – Feb. 2005

  • Institut Polaire Francais Paul Emile Victor, France – Jun. 2005

  • Centro Nacional de Datos Antarticos, Chile – Jul. 2005

  • Malaysian Antarctic Data Center – Oct. 2005

  • Antarctica New Zealand Data Center – Oct. 2005

  • Chinese Antarctic and Arctic Data Centre – Apr. 2006


Idn task team update

AMD Content Growth


Idn task team update

AMD Content Distribution by Country

Contributions from 22 Countries


Idn task team update

AMD Search Page Hits by Country

Most Hits in 2005 from US, Italy, Argentina, Belgium, and New Zealand


Idn task team update

AMD Search Page Hits vs. Retrievals

10,000 Hits in 2005

5, 500 Retrievals in 2005


Idn task team update

ARCTIC PORTAL

~ 900 Records

http://gcmd.nasa.gov/portals/arctic/


Idn task team update

OBIS: Following the JCADM Model …

  • Portal created in Dec. 2005

  • 40+ metadata Records

  • All have a “GET DATA” link

  • 10 Regional OBIS Portals

  • Customized “Templates”

OBIS Taxonomic Categories

http://iobis.org/CategorySearch

- to be implemented in GCMD


Idn task team update

Creating/Using Templates …

  • Select Document Type

  • Either select existing template or “no template”

  • Either select “create new document” or “working with an existing document”

  • Enter Document Identifier

  • Enter fields that apply - select

  • for help documentation

  • 2. Options:

  • -“Preview Document Display”

  • -“Save As Template”

  • -“Email Document to Yourself”


Support for foreign and mathematical characters in dif serf display

Support for foreign and mathematical characters in DIF/SERF display

DIF

SERF


Demo mapserver for budapest

Demo Mapserver for Budapest


Gcmd prototype mapserver

GCMD Prototype Mapserver

Tools

GIS Data Layers

Map View

OGC WMS Get Capabilities Request:

http://mapserver.gsfc.nasa.gov/wmsconnector/com.esri.wms.Esrimap/CEOS_2005?request=getcapabilities&service=WMS&version=1.1.1


Prototype mapserver interoperability

Prototype Mapserver Interoperability

  • Access GCMD’s Web Mapping Service (WMS) through an OGC WMS GET Capabilities Request.

  • OGC WMS compatible clients can access GCMD’s map services.

User Friendly Desktop Internet GIS (WMS Client)

GCMD Mapserver


Mapdex indexes gcmd mapserver

Mapdex Indexes GCMD Mapserver

http://www.mapdex.org


New keywords since last ceos meeting

New Keywords since Last CEOS Meeting

PART C


New modified earth science keywords since september 2005

New/Modified Earth Science Keywords Since September 2005

NEW Variables for Numerical Models

  • Decision Support Models

  • Digital Elevation/Terrain Models

  • Earth System Component Models

  • Global Coupled Climate System Models

  • Global General Circulation Models

  • Phenomenological Models

  • Process Models

  • Regulatory Models

  • Solar-Atmosphere/Space Weather Models


Idn task team update

URL Content Type Keywords Cleanup

  • Provide accurate descriptions of related information in DIFs and SERFs.

  • Provide “Direct Access” to URL for quick access to data.

    1. GET DATA

    e.g: http://www.mgs.md.gov/coastal/vmap/erosion/shp/Aberdeenshp.zip

    2. GET WEB MAPPING SERVICE (WMS)

    e.g: http://www.kgis.scar.org/cgi-bin/kgis_wms?

  • Provide “Direct Access” to Services

    1. GET SERVICE

    e.g: http://ldas.gsfc.nasa.gov/


Url content type keywords cleanup

ASSOCIATED DATA SET(S) BDP METADATA CALIBRATION/VALIDATION DATA DIAL DATA SERVER DISC-AIRS DISC-MODIS DISC-OMI DODS_DIR DODS_FILESERVER DODS_LAS DODS_URL EML METADATA FGDC METADATA GCMD MAPSERVER GET DATA GET SERVICE NBII METADATA NOMADS DATA SERVER PROJECT HOME PAGE REFERENCE MATERIALS RELATED DATA SET DESCRIPTION RELATED DATA SET METADATA RELATED SERVICE METADATA SOAP API SOFTWARE PACKAGES UDDI REGISTRY WEB COVERAGE SERVICE (WCS) WEB FEATURE SERVICE (WFS) WEB MAPPING SERVICE (WMS)

URL Content Type Keywords Cleanup

Previous List

New List

GET DATA

VIEW EXTENDED METADATA

GET SERVICE

VIEW PROJECT HOME PAGE

VIEW RELATED INFORMATION

GET RELATED DATA SET METADATA (DIF)

GET RELATED SERVICE METADATA (SERF)

ACCESS WEB SERVICE

GET SOFTWARE PACKAGE

GET WEB COVERAGE SERVICE (WCS)

GET WEB FEATURE SERVICE (WFS)

GET WEB MAPPING SERVICE (WMS)

GET MAP SERVICE

ACCESS MAP VIEWER


New data center location instrument and platform hierarchies for improved search

New Data Center, Location, Instrument, and Platform Hierarchies for Improved Search

Multi-year Effort

Comments Welcome


New location hierarchy search

New Location Hierarchy Search

New search box for location

Search or map date search


New location hierarchy search1

New Location Hierarchy Search

Select

Continent

Choose from among top level

location categories


New location hierarchy search2

New Location Hierarchy Search

Breadcrumbs show where you are in the hierarchy

Select Europe

“Continent” category subdivided

into individual continents


New location hierarchy search3

New Location Hierarchy Search

Breadcrumbs

Category “Europe” is further subdivided into individual countries and regions.

Select Eastern Europe


New location hierarchy search4

New Location Hierarchy Search

Breadcrumbs

Category “Eastern Europe” is further subdivided into individual countries and regions.

Select Hungary


New location hierarchy search5

New Location Hierarchy Search

Breadcrumbs

Results for search on

“Hungary” displayed.


Dif serf population

DIF/SERF POPULATION


Total difs january 2000 april 2006

Total DIFs January 2000 - April 2006

WHFC children DIFs

split of Aqua MODIS DIFs from Terra MODIS DIFs

new Antarctic DIFs


Cumulative dif population 2003 2006

Cumulative DIF Population 2003-2006


New and revised supplemental descriptions

New and Revised Supplemental Descriptions


New revised and deleted difs 2003 2006

New, Revised, and Deleted DIFs 2003-2006


Dif population by earth science topic

DIF Population by Earth Science Topic


Dif population by node

DIF Population by Node


Dif population by node april 2006

DIF Population by Node, April 2006


Idn serf population

IDN SERF Population


Total serfs in gcmd jan 2001 april 2006

Total SERFs In GCMDJan. 2001- April 2006


Distribution of serfs

Distribution of SERFs


Distribution of serf usage

Distribution of SERF Usage


Web usage

WEB USAGE


Idn usage by domain type 2006

IDN Usage by Domain Type - 2006


Idn usage by domain 2002 2006

IDN Usage by Domain 2002-2006

Cache opened to

Internet robots

Introduction of the new web page


Web page hits since january 2001

# Web Page Hits Since January 2001

Cache opened to Internet

Search robots

Introduction of the new web page


Dif serf search retrieval

DIF/SERF SEARCH/RETRIEVAL


Searches by controlled keyword

Searches by Controlled Keyword


User support questions answered

User Support Questions Answered


Conference calendar entries

Conference Calendar Entries


Idn task team update

7) Refines search

Result

Processor

4)

Set of unique IDs

Search

Results

5)

Title set information, brief

summary, dataset links, etc.

6)

Returns to user

Middleware Search/Retrieval Component

(Integration of spatial, freetext, and controlled queries)

Multi-Layer Search Component

Controlled Vocabulary Database Layer

3)

joins

delegates

Freetext (Lucene) Database Index Layer

SpatialDatabase Index Layer

User performs

query

1)

Controller

2)

Cache


New features

New Features


New features added since september 2005

New Data Resolution refinement available in NASA DAAC portals

Earth-Sun System DAACs

Goddard Space Flight Center

Langley Research Center

National Snow and Ice Data Center

A New Advanced Free-text Search

Map/Date search

Uses new Google Map

docBUILDER

New preview of tool available on start pages

Supplemental descriptions supported

New collaborative portals

16 portals added

New Keyword Subscription Service

Receive Science and/or Service keyword updates

New Features added since September 2005


New portals added since september 2005

(Current total: 70)

New Portals added since September 2005

  • OBIS

    • Australia

    • Canada

    • Europe

    • Indian Ocean

    • New Zealand

    • South America

    • Sub-Saharan Africa

    • United States

  • NASA Langley DAAC

  • NASA NSIDC

  • China AMD

Tropical Cyclones

GoMODP

Malaysia AMD

New Zealand AMD


Data resolution valids

Horizontal Resolution Range:

Temporal Resolution Range:

< 1 m

1 m - < 30 m

30 m - < 100 m

100 m - < 250 m

250 km - < 500 m

500 m - < 1 km

1 km - < 10 km

10 km - < 50 km

50 km - < 100 km

100 km - < 250 km

250 km - < 500 km

500 km - < 1000 km

> 1000 km or > 10 degrees

< 1 second

1 second - < 1 minute

1 minute - < 1 hour

Hourly - < Daily

Daily - < Weekly

Weekly - < Monthly

Monthly - < Annual

Hourly Climatology

Daily Climatology

Pentad Climatology

Weekly Climatology

Monthly climatology

Annual

Annual climatology

Decadal

Climate Normal (30-year climatology)

Vertical Resolution Range:

< 1 m

1 m - < 10 m

10 m - < 30 m

30 m - < 100 m

100 m - < 1km

> 1km

Data Resolution “Valids”

  • Reminder! DIF authors can now populate their DIFs by selecting horizontal, vertical and temporal resolution in docBUILDER.

  • Vertical Resolution refers to both Altitude and Depth resolution.


Md9 5 1 release highlights

MD9.5.1 Release: Highlights

  • Spatial Search with Map

  • Refinement by Data Resolution (for NASA DAAC portals only)

  • Support for refinement in SERFs (platforms, instruments, service providers, science parameters, service parameters, etc.)

  • Support for foreign characters in DIF/SERF display

  • Support for supplemental descriptions in HTML docBUILDER

  • Subscription Service for Science Keywords

  • OAI Repository

  • Web Page design mockups for 12 NASA Application Areas and 7 NASA focus areas

  • Several bugs fixed and enhancements added (208 total)


Postgresql

PostgreSQL

  • Database setup scripts are being customized to work with an open source database.

    • Scripts are being updated to work with PostgreSQL 7.4.7 database.

    • Currently testing MD Server setup with PostgreSQL.

    • Install instructions will be rewritten to make installation as easy as possible for Nodes.


Highlights of new docbuilder tool changes the users will see

= HTML

= Standalone

= Both

Highlights of New docBUILDER Tool(Changes the users will see)

  • Offers option to use personalized templates.

  • Supports three-color coding for required, recommendedand optional fields.

  • Provides automatic population of Data Center /Service Provider URLs.

  • Allows direct editing of the XML document.

  • Offers more intuitive interface for Personnel and Data Center fields.

  • Incorporates spell-checker for all fields and full document.


Highlights of new docbuilder tool changes behind the scenes

Highlights of New docBUILDER Tool (Changes “behind the scenes”)

  • Complies fully with XML Schema (previous version only supported DTD).

    • Provides capability of rendering custom authoring tool according to the XML schema

    • Renders customized widgets based on XML element names association.

  • Contains new business logic with a completely rewritten business layer, resulting in much faster access to XML documents and valids.

  • Separates business logic from presentation logic, making changes to presentation much easier.

    • Refactored framework using Struts and JSP allowing for complete portal customizations.


Idn task team update

docBUILDER

HTML docBUILDER


Html docbuilder opening screen

HTML docBUILDER(Opening Screen)


Html docbuilder main screen

HTML docBUILDER(Main Screen)

Menu with options

to save, email, etc.

Legend

Checkboxes indicating progress

Editable text area


Html docbuilder data resolution field

HTML docBUILDER(Data Resolution Field)

Field Name

Field Description:short description of the filed, including the type of information expected.

Link to full field description:link to the DIF/SERF Writer's Guide page that fully describes the field, including characters allowed, definition, format, etc.

Add/Remove field:user can click the green (+) to add a new field, or the red (–) to remove that field.


Html docbuilder science keywords field

HTML docBUILDER(Science Keywords Field)

Subset list selector

Variable level filter:if checked, removes all items with Variable level

List search: filters list as you type, keeping only those items that match.

Option to add detailed variable:allows user to add detailed variables to any selected items in the list


Html docbuilder personnel field

HTML docBUILDER(Personnel Field)

c l i c k !

Personnel Lookup link:when clicked, presents the user with all personnel currently in the GCMD DB. After the user selects a person and clicks the Accept button, the information is then populated in the form on the Personnel page.


Html docbuilder data center field

Data Center Lookup link:allows the user to select from a current list of data centers, then populates the Data Center form with this info, including URL.

HTML docBUILDER(Data Center Field)

c l i c k !


Keyword subscription service

Keyword Subscription Service

  • Receive notifications of updates, removals, and additions to keywords for:

    • Data Centers/Service Providers

    • Platforms

    • Instruments

    • Locations

    • Projects


Search refinements for serf

Search Refinements for SERF

  • Refine by:

    • Service Providers

    • Instruments

    • Platforms

    • Projects

    • Science Keywords

    • Service Keywords

    • Parent SERFs

    • Child SERFs


Close up of refinement

Close-up of Refinement

Methods to refine by


Idn task team update

Users can also refine by Parent and Children SERFs


Idn task team update

New Refinement for Data Services

2. Refine by “Science Parameters”

+

Free-Text Search

1. Select

“Models”

266 Records

3. Select

Query Result #1

Metadata Record

2 Records


Idn task team update

Refine by Temporal/Spatial Resolution

1. Refine By “Temporal Resolution Range”

2. Select

“Daily - <

Weekly” &

result #1


Idn task team update

Query Refinement by Data Resolution

  • 1. Query by:

  • Platform AQUA

  • Sensor MODIS

2. Refine by Data Resolutions


Idn task team update

Query Refinement by Data Resolution

  • 3. Choose Refine by:

  • Horizontal Resolution Range

  • 250 meters - < 1 km

4. Query Results


Idn task team update

New Spatial Search using Technology

  • Enhanced capability for performing spatial searches.

  • Intuitive tools such as directional arrows and zooming assist in choosing a geographic area on the map.

  • Integration with keyword and temporal search provides more precise results.


Conducting a spatial search

Conducting a Spatial Search

Example showing a search for data sets in the United Kingdom.


Conducting a spatial search continued

Conducting a Spatial Search Continued ……

Narrow spatial search using zoom tools


Conducting a spatial search continued1

Conducting a Spatial Search Continued ……

Spatial Search Results


Idn task team update

Map/Date Search – Google Earth

User Performs

a Spatial,

Keyword,

& Temporal

Search

Legend


Idn task team update

OAI-PMH Architecture

OAI-PMH Repository

Computer running harvester software

  • Why OAI-PMH?

  • OAI Server independent of main database

  • Administrator controls metadata availability

  • Queries standardized

  • Software is open source

  • Metadata Compatibility

    • Dublin Core, FGDC, DIF, ISO-19115

    • XSLT or XML Schema

II.

  • Harvesting Process

  • Metadata subset transferred from a database to a repository

  • Metadata is harvested from the repository

Database

I.


Idn task team update

GCMD OAI-PMH Capabilities

List Metadata Formats – Lists available metadata formats

http://gcmd.gsfc.nasa.gov/OAIPMH/oai.do?verb=ListMetadataFormats

List Sets – Lists all sets of metadata on server (Can be disabled)

http://gcmd.gsfc.nasa.gov/OAIPMH/oai.do?verb=ListSets

List Identifiers – Lists all document names in set.

http://gcmd.gsfc.nasa.gov/OAIPMH/oai.do?verb=ListIdentifiersmetadataPrefix=dif&set=NCAR

List Records – Lists all XML documents in set.

http://gcmd.gsfc.nasa.gov/OAIPMH/oai.do?verb=ListRecords&metadataPrefix=dif&set=NCAR

Identify – Lists information about the server

http://gcmd.gsfc.nasa.gov/OAIPMH/oai.do?verb=Identify

Get Record – Retrieve individual XML document

http://gcmd.gsfc.nasa.gov/OAIPMH/oai.do?verb=GetRecord&metadataPrefix=dif&set=NCAR&identifier=GCMD_NCAR_DS123.1


Idn task team update

GCMD OAI-PMH Capabilities ctd.

OAI Repository Explorer (a tool for testing OAI-PMH servers)

baseURL – URL for the GCMD OAI-PMH Server

Verbs- list metadata attributes and request metadata

Parameters – Refine by dates, metadata formats, ID’s, metadata set names

Validate – Authenticate metadata against an XML Schema

“OAI Repository Explorer” courtesy of U. of Cape Town http://re.cs.uct.ac.za/

Formatting – View metadata as “parsed” or “raw” XML


Oai pmh open archives initiative protocol for metadata harvesting capabilities

OAI/PMH (Open Archives Initiative-Protocol for Metadata Harvesting) Capabilities

OAI-PMH

Repository

  • Identify

  • ListMetadataFormats (DIF, FGDC, Dublin Core)

  • ListIdentifiers

  • Get Record

  • ListRecords

Get records

GCMD

Retrieves DIF

Metadata identifiers, records in XML

Identifies

protocol; supported formats

Metadata

OAI-PMH

Harvester

Controlled

Vocabulary


Converting metadata using xslt technology

Converting Metadata using XSLT Technology

1. Apply Mapping to an XSLT Stylesheet

Sample ISO 19115 XML document

Edit XSLT Stylesheet

DIF XML

XSLT Editor

DIF HTML

2. Translate, Format, and Submit to the GCMD

ISO19115 XML

Formatted DIF XML

Format using HTML Tidy

Translate using Xalan


Dif vs iso 19115 core metadata

DIF vs. ISO 19115 Core Metadata

DIF Recommended Fields:

Data Set Citation

-Dataset Title

-Dataset Release Date

Personnel (DIF Author)

Instrument

Platform

Temporal Coverage

Spatial Coverage

Location

Data Resolution

Project

Quality

Access Constraints

Use Constraints

Distribution

Related URL

DIF Revision History

DIF Required Fields:

Entry ID

Entry Title

Science Keywords

*ISO Topic Category

Data Center

Summary

*Metadata Name

*Metadata Version

DIF Optional Fields:

Keyword

Paleo-Temporal Coverage

Data Set Progress

Data Set Language

Originating Center

Multimedia Sample

Reference

Parent DIF

IDN Node

DIF Creation Date

Last DIF Revision Date

Future DIF Review Date

*Field added for ISO 19115 compliance

*Mandatory ISO fields

*Mandatory under certain conditions or optional ISO fields

http://gcmd.nasa.gov/Aboutus/standards/


Dif vs fgdc core metadata

DIF vs. FGDC Core Metadata

DIF Recommended Fields:

Data Set Citation

Personnel (DIF Author)

Instrument

Platform

Temporal Coverage

Spatial Coverage

Location

Data Resolution

Project

Quality

Access Constraints

Use Constraints

Distribution

Related URL

DIF Revision History

DIF Required Fields:

Entry ID

Entry Title

Science Keywords

ISO Topic Category

Data Center

Summary

Metadata Name

Metadata Version

DIF Optional Fields:

Keyword

Paleo-Temporal Coverage

Data Set Progress

Data Set Language

Originating Center

Multimedia Sample

Reference

Parent DIF

IDN Node

DIF Creation Date

Last DIF Revision Date

Future DIF Review Date

  • * Mandatory FGDC fields

  • Mandatory under certain conditions or optional FGDC fields

http://gcmd.nasa.gov/Aboutus/standards/


Gcmd idn achieves cmmi level 2

GCMD/IDN Achieves CMMI Level 2

CMMI: Capability Maturity Model Integration

A set of best practices that address the development and

maintenance of products and services covering the product

life-cycle from conception through delivery and maintenance.

  • CMMI certification is through the Software Engineering

  • Institute (SEI) of Carnegie Mellon University (CMU).

  • There are 6 Capability levels. Level 2 is the “Managed” level.

  • GCMD demonstrated capability in 7 Process Areas:

    • Requirements Management

    • Project Management

    • Project Monitoring and Control

    • Supplier Agreement Management

    • Measurement and Analysis

    • Process and Product Quality Assurance

    • Configuration Management

After 5 months of intensive training and review, CMMI Level 2 was achieved

on February 24, 2006.


New dif serf changes

New DIF/SERF Changes

  • Parameters:will be renamed toScience Keywords:

  • Service Parameters:will be renamed to Service Keywords:

  • Keyword:will be renamed to Ancillary Keyword:

  • Add field to Temporal Coverage for Relative Time:

    Group: Temporal Coverage

    Start_Date: [yyyy-mm-dd]

    Stop_Date: [yyyy-mm-dd]

    Relative_Start_Date:-x (where x= # days ago)

    End_Group

    Relative time permits:

    • Auto-updating of temporal coverage for near-real time data.

    • Specifying number of days data available.


  • Login