1 / 17

HYCOM CONSORTIUM Data and Product Servers

This project overview discusses the goal of providing public access to HYCOM Consortium data and products through standards and technology adopted by the GODAE community. It explores the options of utilizing existing technology, open source software, or developing in-house software. The chosen approach involves using key tools like LAS and DODS to serve data over the internet with a user-friendly interface.

andersonsusan
Download Presentation

HYCOM CONSORTIUM Data and Product Servers

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. HYCOM CONSORTIUM Data and Product Servers ASHWANTH SRINIVASAN

  2. Project Overview Goal Selecting a server LAS-and-DODS

  3. Goal • To provide public access to HYCOM Consortium generated data and products through standards and technology adopted by the GODAE community.

  4. Selecting a Server Options: • Use existing technology such as FTP • Use open source software developed to address the issue of data access specifically for the community • Develop in-house software

  5. Our Choice: Open Source Software initially favored an in-house server development approach … but now favor Open Source packages due to several benefits • new and better technology • standard user interface • standard data formats

  6. Key Tools – (LAS)Live Access Server • Developed at PMEL • Allows interactive browsing and visualization of data • Allows comparisons between different data sets FOR MORE INFO... www.pmel.noaa.gov/software/las

  7. Key Tools - DODSDistributed Ocean Data System • Developed at URI & MIT • Allows remote data access as if it were locally available • Supports many of the commonly used data formats • now called OPeNDAP FOR MORE INFO... http://unidata.ucar.edu/packages/dods

  8. LAS-and-DODS Approach • LAS and DODS packages are the key tools to serve data to clients over the Internet • Chosen by the ocean data and GODAE community • Presents a user interface consistent with other data providers

  9. http://hycom.rsmas.miami.edu/dataServer/ Live Demo

  10. Implementation Details Hardware Software

  11. Hardware • Server: Dell Power Edge 2500 Dual PIII 1133 MHZ/1.0 GB RAM 400 GB RAID 5 Storage LINUX OS • Storage: CHI Corporation NAS ~2 TB of Storage • Compute Nodes: 4 dual Intel PIII 550 Systems; 8dual AMD Athlon systems • Network: Fast Ethernet

  12. Software Open source software tied together by Perl programs • DODS 3.2.9 • LAS 5.2 • Apache web server 2.0 • DODS Aggregation Server 0.6 beta • NetCDF 3.5.0, COARDS compliant • MySQL 3.2.6

  13. User Client e.g. web browser Campus Network ~ 2 TB Master storage Server LAS DODS Perl Programs Metadata 400 GB Online storage Private Network Work Node 01 Work Node 02 Work Node 03 Work Node 04

  14. Project Status

  15. Phase 1 Phase 2 Phase 3 Jan Feb Mar Apr May Jun July Sep Oct Nov Dec Schedule • Phase 1- hardware acquisition & setup • Phase 2 - LAS and DODS setup • Phase 3 - maintenance and collaboration with other data providers FOR MORE INFO... http://hycom.rsmas.miami.edu/dataServer

  16. Current Status • Two datasets available via our servers • ~ 100 GB of data online • ~ 300 GB data available on demand • Catalog service is operational

  17. Future Work • Set up of the HYCOM node as a sister server with GODAE partners • Implementation of a DODS Aggregation Server to serve datasets as a time-series • Add additional datasets and metadata

More Related