1 / 68

IDN Metadata Overarching goal: A dynamic component for energizing CEOS Cyber-infrastructure.

IDN Metadata Overarching goal: A dynamic component for energizing CEOS Cyber-infrastructure. Wilkinson Microwave Anisotropy Probe | http://map.gsfc.nasa.gov/index.html. WGISS23- IDN TT Hanoi , Vietnam presented by Arturo Restrepo - Task leader: Lola Olsen. Introduction

sorley
Download Presentation

IDN Metadata Overarching goal: A dynamic component for energizing CEOS Cyber-infrastructure.

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. IDN Metadata Overarching goal: A dynamic component for energizing CEOS Cyber-infrastructure. Wilkinson Microwave Anisotropy Probe | http://map.gsfc.nasa.gov/index.html

  2. WGISS23- IDN TT Hanoi , Vietnampresented by Arturo Restrepo - Task leader: Lola Olsen • Introduction • Review of Minutes on Action Items from Annapolis

  3. Portals created in response to CEOS/GEOSS requests * • Ocean Climate • Global Climate Observing System (GCOS) • (2) PODAAC Data Center • GEOSS Data • GEOSS Data Services • In Response to Proposed GEOSS Action Items… • List of GEOSS demonstration portals: • Tsunami Data • Tsunami Data Services • Forest • Ecosystems • Water Management Data in Latin America New Portals added since September 2006 NASA Atmospheric Science Data Center National Snow and Ice Data Center AMD: China AMD:Korea AMDMalaysia AMD: The Netherlands SCAR-MarineBiodiversity Information Network Currently being reviewed *

  4. IDN Newsletter and Plans for Germany IDN Newsletter |April 2007 Volunteers for Articles to be published at next WGISS Germany

  5. IDN Usage Statistics CEOS IDN Task Team

  6. MetricsTools Used by the IDN • Analalog Webalizer (AW) Stats • Free, open source, real-time log analyzer • Basic web usage: unique hosts, pages viewed, hits • Includes graphs • Runs daily • Provides GCMD and IDN metrics for hits on web site • Nettracker • Commercial, Goddard Space Flight Center-licensed product; currently being upgraded by NASA • Highly customizable • Includes graphs • Runs daily • Provides GCMD search and retrieval and portal usage metrics • Custom • In-house log analysis • Highly customizable • Metrics can be imported into spreadsheets • Runs monthly • Provides GCMD and IDN metrics on population , search and retrieval, portal usage. Provides custom AMD and IDN portal metrics

  7. Total DIFs January 2001 - Apr 2007 Replacement of Antarctic DIFs Removal of 400+ EOSWEBSTER ESIP Child DIFs Split of Aqua MODIS DIFs from Terra MODIS DIFs New Antarctic DIFs

  8. New, Revised and Deleted DIFs 2003-2007 Actions

  9. DIF Population by Earth Science Topic

  10. “Searches” as a function of science “Topic” population in 2006. Topic

  11. DIF Population by Internal Directory Node* Total Through April 2007

  12. Web Usage Metrics

  13. Total Unique Users 1999 - 2007

  14. Number of Web Page Hits Since January 2003 Cache opened to Internet Search robots Problem with Google Cache Introduction of the new web page Summer Declines

  15. Search Metrics

  16. Searches by Controlled Keyword

  17. User Activity (Service Keywords Hits)August 2004 – Mar 2007 Index by Google Several GIS conferences

  18. User Support and Metadata Authoring Tool Usage

  19. Usage of the IDN Web Page (idn.ceos.org)

  20. New Features in MD 9.7 Demo

  21. Highlights of new 9.7 web page web New graphical title and color scheme New area for latest GCMD features and highlights Two main focus areas “Find Data”and “Find Data Services” easier to locate and distinguish on page New Topic Keyword Full text services search (allows users to only view one search box on home page by default) Geographic related search features grouped using map icon Full text search offered within Find Data search box

  22. Map/Date Search; Combined Spatial, Temporal & Full-Text Search

  23. Query Refinement Example • Query by Science Keyword: • Biological Classification > Vertebrates > Mammals > Cetaceans

  24. Query Refinement Example(cont’d) 2. Refine by Spatial Search: 3. Results

  25. Data Set Description Data Service Description New! Instrument Description New! Platform Description New!

  26. New DIF Display New! New! Direct Access to Data & Services (FTP, HTTP, OpenDAP, THREDDS, WMS, WFS, WCS..etc)

  27. New DIF Display New! • Direct access to data or images through multimedia sample • Multiple bounding coordinates and/or points on Google map • Horizontal/vertical and temporal data resolution ranges in Brief Display

  28. New DIF Display Improved! FGDC Display Note: The DIF has also been mapped to metadata standards such as ISO19115, Dublin Core, and ANZLIC.

  29. Expanded database table structures forInstrument and Platform hierarchical keywords. 3 Instrument Categories 25 Instrument_Classes 29 Instrument_Types 22 Instrument_Subtypes 10 Platform Categories 66 Platform Series/Entities

  30. Extended Ancillary descriptions to include expandedInstrument information. Instrument Ancillary Descriptions (AD-I) Instrument_Identification: Instrument_Category Instrument_Class Instrument_Type Instrument_Subtype Short_Name Long_Name Instrument-Associated_Sensors: Short_Name Associated_Platforms: Short_Name Spectral/Frequency_Information: Wavelength_Keyword Number_Channels Spectral/Frequency_Coverage/Range Spectral/Frequency_Resolution Description Creation_Date Revision_Date Online_Resource Sample_Image IDN_Node Instrument_Logistics: Data_Rate Instrument_Start_Date Instrument_Stop_Date Instrument_Owner Controlled keywords Expanded!

  31. Extended Ancillary descriptions to include expanded Platform information. Platform_Identification: Platform_Category Platform_Series/Entity Short_Name Long_Name Synonymous_Platform_Names: Short_Name Platform-Associated_Instruments: Short_Name Orbit: Orbit_Altitude Orbit_Inclination Equator_Crossing Period Repeat_Cycle Perigee Apogee Orbit_Type Description Creation_Date Revision_Date Online_Resource Sample_Image IDN_Node Platform_Logistics: Launch_Date Launch_Site Design_Life Primary_Sponsor Controlled keywords Platform Ancillary Description (AD-P) Expanded!

  32. Enhanced Platform & Instrument Descriptions New Display!

  33. New/Modified Earth Science & Services Keywords Since September 2006 New! NEW Earth Science Keywords • New Topic: Biological Classifications ( User-oriented + non-authori taxonomy) • Takes advantage of full range of new 5-level controlled keyword hierarchy. • Allows for full biological taxonomic classification using ITIS, OBIS, GBIF, Species2000 and nomenclature. • Modified Topic name “Hydrosphere” to “Terrestrial Hydrosphere” and changed all underlying Terms and Variables. • Other science keyword changes pending for expanded 5-level hierarchy. • New daily RSS feed offered for new data set and data service descriptions

  34. Node Reports and Feedback For Joint Committee on Antarctic Data Management (JCADM) / Antarctic Master Directory (AMD) Node Report

  35. Antarctic Master Directory (AMD) Records: > 4300 DIFs (45% with direct data links) Countries: 25 Hits: >14,000 in 2006 (35% increase from 2005) Retrievals: > 6,500 in 2006 (20% increase from 2005) Portals: 19 National Antarctic Data Center (NADC) portals

  36. AMD Content Growth Over 4,300 records as of April 2007

  37. AMD Content Distribution by Country Contributions from 25 countries (mainly Australia, United States, Argentina, New Zealand, Italy and Spain)

  38. OAI - PMH Harvesting IDN is harvesting new/updated records from the Australian Antarctic Data Center (AADC) since Feb. 07. Highly customized HTML docBUILDER & portal. Records are sent to AADC for review/editing and harvested by IDN through OAI-PMH on a weekly basis. http://gcmd.nasa.gov/portals/amd_au/

  39. AMD Hits vs. Retrievals - 2006 14, 000 Hits in 2006 6,500 Retrievals in 2006

  40. AMD Total Hits since 2004 35 % increase in 2006 from 2005

  41. AMD Total Retrievals since 2004 Launching of IPY 2007-2008 (over 500 unique IPs) XXIX SCAR/JCADM Meeting

  42. New NADC Portals Chinese Antarctic and Arctic Data Centre- Apr. 06 Korea Polar Research Institute- Jun. 06 Australian Antarctic Data Centre- Nov. 06 The Netherlands Polar Programme- Feb. 07 http://gcmd.nasa.gov/portals/amd_kr/

  43. IPY 2007/09 Projects: > 200 from over 60 nations The IDN is working with the IPY Data and Information Service (DIS) to host an IPY data and services portal. A prototype is currently underway. The portal will provide links to data, services, projects and other links related to IPY. HTML docBUILDER will be customized to reflect the IPY profile.

  44. Re-emergence of Interoperability The Onslaught of “Standards” DIF evolution Standards Proliferation vs Adopting DIF Darwinism “seems” to have an effect on Metadata Standards Inclusive adoption of metadata Standards>Formats>Profiles>extensions>etc or Integrated Metadata Mining Technologies ?

  45. IDN-DIF |evolution and trends DIF Start-up Global Change & Earth Sci. Appl FGDC-CSDGM node ISO 19115-Compliant BDP-CSDGM Interop 1987 1988 1989 1990 1991 1994 2004 2006+ DIF…

  46. DIF <evolution_adaptation_inclusiveness/> 1987 → Over 100 DIF entries were available in the prototype NMD database. 1988 →After several demonstrations, workshops, and feedback from the scientific community, the Directory Interchange Format (DIF) was formally approved and adopted by a CI science advisory group at a CI workshop in 1988. 1989 →The Committee on Earth Observation Satellites (CEOS) Data Working Group (DWG) began attending the CI Workshop meetings and provided valuable feedback on the DIF structure. 1990 →The Interagency Working Group on Data Management for Global Change (IWGDMGC) adopted the directory as a prototype to facilitate global change research - in response to the challenge by the Earth System Science Committee (ESSC). 1990 →The NMD was renamed the Global Change Master Directory (GCMD) for its Earth sciences applications. 1991 →The first release of the IDN was named the Prototype International Directory (PID) in 1990. [Actual DIF exchange procedures were agreed on by February 1991. 1994 →The GCMD serves as NASA's FGDC Clearinghouse node for geospatial metadata. Elements of the Content Standard for Digital Geospatial Metadata (CSDGM) were incorporated in the DIF in 1994. 2004 →The ISO 19115/TC211 geospatial metadata standard was adopted in GCMD. 2006+ →Planning guidelines to include BDP (taxonomic trees and geo-referencing) within GCMD .

  47. Ecological Network (LTER) highlights the IDN functional development “Advances in database and web-based technologies enabled traditional published data catalogs to be replaced by electronic and searchable data catalogs and data directories. Presently, many such databases that support data discovery are available through the web and provide numerous searching points (e.g. keyword, data, and location). Examples from U.S. include NASA’s Global Change Master Directory (IDN) and USGS-BRD. These databases provide either a controlled vocabulary that facilitates standardization of keywords and subsequent discovery.” William K. Michener. 2006. Meta-information concepts for ecological data management. Ecological Informatics (1):3-7

More Related