1 / 12

A Pilot Data Catalog Bob Cook, Giri Palanisamy, Mike Frame, and Viv Hutchison

A Pilot Data Catalog Bob Cook, Giri Palanisamy, Mike Frame, and Viv Hutchison. Presenter Name. Linking Existing Data Archives. Existing CI: Metadata interoperability. Networks use overlapping, partially compatible metadata and data files standards, and represent overlapping data collections.

lyndon
Download Presentation

A Pilot Data Catalog Bob Cook, Giri Palanisamy, Mike Frame, and Viv Hutchison

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Pilot Data CatalogBob Cook, Giri Palanisamy, Mike Frame, and Viv Hutchison Presenter Name

  2. Linking Existing Data Archives

  3. Existing CI: Metadata interoperability Networks use overlapping, partially compatible metadata and data files standards, and represent overlapping data collections

  4. A pilot catalog for Earth Observations • Build on existing catalog systems and nodes’ metadata • NBII, LTER, ORNL DAAC, USA-NPN, and others • Pilot to demonstrate early functionality of metadata collection, indexing, and searching (not final solution) • Focal point for discussions about requirements, features, and functions • Pilot Catalog • Distributed metadata management, data discovery, and access system • Based on open-source and existing code • Pilot catalog handles disparate metadata standards • FGDC-Biological Data Profile, EML, GCMD, Z39.50, Darwin Core, Dublin Core, ISO 19115 • Metadata extracted and placed in metadata index that can be accessed with numerous search capabilities • User downloads data from distributed nodes

  5. Pilot Catalog Architecture Pilot Catalog for Earth Observations BDP NBII EML LTER BDP USA-NPN Internal Metadata Index FGDC ORNL DAAC Existing Pilot nodes EML OBFS Metadata Extraction FGDC IAI DIF LP DAAC • Single portal • Numerous search capabilities • Search sharing functions (RSS, Web Services) • Metadata has link to data, which reside at node FGDC LBA Stored at Coordinating Node I-LTER Near-term future nodes TERN SAEON

  6. 2. Metadata summaries are returned to the users, including links back to detailed information and data at the PIs’ server or data repository 1. Users query the index via a Web-based browser or a search service P.I. Summary – Olson J. S Global Organic Soil Carbon Project: Soil Collections Status: Completed Download Data Set: http://daac.ornl.gov/cgi- bin/cart/order.pl?ds_id=221 3. Data and documentation are downloaded directly from the node Pilot Catalog: Search and Access Internal Metadata Index Metadata Extraction ME OBFS LP DAAC LTER IAI LBA NBII USA-NPN ORNL DAAC 1. Users query the index via a Web-based browser or a search service

  7. Providing one-stop shopping for data Pilot Catalog: Simple Search Interface (searches entire metadata record) >48,000 Data Set Records NBII Metadata Clearinghouse (39,550) Long Term Ecological Research(LTER)Network (6,897) ORNL Distributed Active Archive Center for Biogeochemical Data (810) Large Scale Biosphere-Atmosphere Experiment in Amazonia (LBA) (783) Organization of Biological Field Stations (124) Inter-American Institute for Global Change Research (IAI) (79) MODIS and ASTER Products (LPDAAC) (38) National Phenology Network (USANPN) (29)

  8. Advanced Search Interface

  9. Search can be emailed, bookmarked, or placed in RSS feed Search can be refined using multiple filters Eurasian Collared Dove in North America

  10. Planned Development for Catalog • DataONE search and access system in planning stages • Pilot is only to present early functionality • Features under consideration include • Implement distributed metadata search • Add globally unique identifiers for provenance • Include versioning of data and metadata • Web Services, • Thesaurus (already implemented for NBII) • Gazetteer Web service • OGC Catalog Service (Web Map / Coverage/ Feature) • Universal Description, Discover, and Integration (UDDI) Directory Services • Possible integration to OPeNDAP • Seamless integration with external visualization tools • Web Service harvest & provider services (OAI-PMH) • Search Sharing using OpenSearch (Search retrieval using a URL) • Next version of Data Catalog in 2010

  11. Pilot Data Catalog • For internal testing only http://mercdev3.ornl.gov/dataone/

  12. Distributed Data Visualization and Extraction Capabilities Metadata clearinghouse harvests metadata from participating data providers Metadata is served from Mercury, the actual data (WMS/WCS) is served from NSIDC, visualization tool is served from CIESIN Mercury enables users to view the data by passing the OGC service information to the external visualization tool

More Related