1 / 28

   Data and Data Management: Introduction to the BCO-DMO

   Data and Data Management: Introduction to the BCO-DMO. Presented to Professor Keiichi Uchida November 16, 2009 Robert C. Groman. Conversation Overview. NSF now says: Your data or your funding Data: – facts, statistics, or items of information; and metadata

fabian
Download Presentation

   Data and Data Management: Introduction to the BCO-DMO

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1.    Data and Data Management:Introduction to the BCO-DMO Presented to Professor Keiichi Uchida November 16, 2009 Robert C. Groman November 16, 2009 Page 1 of 28

  2. Conversation Overview • NSF now says: Your data or your funding • Data: – facts, statistics, or items of information; and metadata • Accessing data: Data discovery, display and retrieval • Data Interoperability November 16, 2009 Page 2 of 28

  3. Points to make • Permanent archive of data • Benefits of early open access to data (with minimum/no restrictions) • Metadata are data and critical for data reuse November 16, 2009 Page 3 of 28

  4. Venn Diagram:Data and Metadata All data and information (D) necessary to use the data. Data (d) facts, statistics, or items of information Metadata (m) D ≠ m + d November 16, 2009 Page 4 of 28

  5. Probability Inversely Proportional to Time • Second order effects: • Length of cruise • Success of cruise • Participants • Immediate activity following the cruise November 16, 2009 Page 5 of 28

  6. Theorems† • Theorem 1: The probability that all the necessary data and information are collected and preserved to allow another researcher to properly use your data is inversely proportional to time since the data were collected. • Corollary: Unless data and information are collected and preserved during the experiment (e.g. cruise), subsequent researchers will have a difficult time using your data. • Theorem 2: The longer the time since the data were collected the less likely the data will be considered “final”. †Left to the reader as an exercise. November 16, 2009 Page 6 of 28

  7. Seeing Versus Using Someone’s Data • Maybe you don’t want others to use your data. • Not done publishing papers based on the data • Graduate student is still analyzing the data • It’s not final yet • Old policies and practices about data archiving • New policies about data publishing and data archiving • Web accessible • NSF mandate November 16, 2009 Page 7 of 28

  8. Better, higher quality data The more people look at the data the higher their quality. November 16, 2009 Page 8 of 28

  9. Ocean Observing → Sharing Data • Northeast Coastal and Ocean Data Partnership (néeGulf of Maine Ocean Data Partnership) • “… to promote and coordinate the sharing, linking, electronic dissemination, and use of data in the Gulf of Maine region. “ • “… linking databases that are created and individually maintained by Participants ….” • “… develops the web-based, visualization, and other information technologies needed for the seamless exchange ….” • 24 member organizations consisting of research, educational, non-profit, commercial, and local, state, and federal agencies. • Ocean observing systems • Oceans.us: National Office for Integrated and Sustained Ocean Observations • NFRA: National Federation of Regional Associations • NERACOOS (Northeast Coastal Regional Observing System), MACOORA, …. • ORION: Ocean Research Interactive Observatory Networks • GOOS: Global Ocean Observing System November 16, 2009 Page 9 of 28

  10. Biological and Chemical Oceanography Data Management OfficeBCO-DMO • NSF funded 3 year project to provide short and medium term data management, including web based access, to all NSF funded projects from the biological and chemical oceanographic programs • Large NSF projects are expected to have their own data management offices – a person • Web site: http://www.bco-dmo.org/ November 16, 2009 Page 10 of 28

  11. MapServer interface and interoperability enhancements • Provides access to geo-referenced scientific data and metadata • Presents distributed data sets in a unified way • Uses MapServer as the visualization application • Visualize data with graphics generated on-the-fly • Request custom subsets of data in a variety of file formats – flat file, Matlab, netCDF, WFS, WMS. • Compare data from different sources November 16, 2009 Page 11 of 28

  12. JGOFS/GLOBEC Data Management System November 16, 2009 Page 12 of 28

  13. http://www.bco-dmo.org/ November 16, 2009 Page 13 of 28

  14. Cruise Tracks November 16, 2009 Page 14 of 28

  15. Select 5 Cruises November 16, 2009 Page 15 of 28

  16. Click on “Show Data” Button November 16, 2009 Page 16 of 28

  17. Select CD data in EN307 November 16, 2009 Page 17 of 28

  18. Shows stations November 16, 2009 Page 18 of 28

  19. EN307 graph it options November 16, 2009 Page 19 of 28

  20. Depth versus salinity and versus temperature November 16, 2009 Page 20 of 28

  21. Select another cruise: AL9906 November 16, 2009 Page 21 of 28

  22. Map it options for abundances November 16, 2009 Page 22 of 28

  23. Graph it option for AL9906 November 16, 2009 Page 23 of 28

  24. AL9906 Nutrient/Phytoplankton Plot November 16, 2009 Page 24 of 28

  25. Interoperability features (for free) November 16, 2009 Page 25 of 28

  26. MapServer Supports Interoperability Features • Open Geospatial Consortium standards • Web Mapping Service (WMS), and • Show me the data • Web Feature Service (WFS) • Get me the data • Retains the functionality of the JGOFS/GLOBEC Data Management System • Download data as ASCII, CSV, Matlab, netCDF • Will be adding Google Earth output file option November 16, 2009 Page 26 of 28

  27. Metadata Schema November 16, 2009 Page 27 of 28

  28. November 16, 2009 Page 28 of 28

More Related