170 likes | 315 Views
The NOAA National Geophysical Data Center. And Collocated World Data Service for Geophysics. Failure to Connect?. Dan Kowal Data Administrator, Information Services Division NOAA / NESDIS / NGDC dan.kowal@noaa.gov GeoData Workshop 2014 .
E N D
The NOAA National Geophysical Data Center And Collocated World Data Service for Geophysics Failure to Connect? Dan Kowal Data Administrator, Information Services Division NOAA / NESDIS / NGDC dan.kowal@noaa.gov GeoData Workshop 2014
Technical issues of connecting geodatain and between governmental agencies.
Challenges and Accomplishments • Metadata Publication • Software Development • Data Citation
Metadata Tools http://www.ngdc.noaa.gov/docucomp/
Metadata Publication - Local • NGDC Metadata Homepage • Immediately available • NGDC Geoportal • synchronized weekly or upon request
Software Challenges • Wide variety of data types • Diversity of data providers • Decreasing staff and funds • Increasing number of data sets ~ 600 to date • Legacy code bases • Lack of communication
Engineering Objectives • Common framework • standardize on common technologies, shared knowledge, centralization supporting tracking / reporting • Isolate dataset specific components • share things like file handling, messaging across disparate datasets • Modular and extensible • ease maintenance and facilitate testing, phasing in new capabilities (incremental improvements), reduce likelihood of system-wide impacts to errors or malfunctions
Engineering Objectives - cont’d • Industry-standard and best practices and patterns • develop in teams, automated builds, test coverage, leverage industry tools • Resilient • eliminate single points of failure, be able to restart processes following errors without data loss, secure • Minimize custom code • reduce software maintenance
Data Citation Summary • Data Linkage to Publications: • Data Citation Indexin Thomson-Reuters’ Web of Knowledge • Elsevier ScienceDirect – Ongoing discussions. • Procedural Directive for Data Citation in the works. • Leverage ESIP Guidance • NCAR’s Data Citation White Paper • DataCite • ~ 50 Datasets minted through EZID.
In Summary… • Need to fix the catalog publishing disconnect. • Enterprise approach to development paying dividends. • Creating opportunities for reuse. • Generic functionality shared across data sets. • Going to take more resources to transition legacy data sets. • Collaboration in Data Citation practices across Data Centers bodes well for future consolidation. • Begin “Interoperability” discussion early when initiating a new Archive Project.