High data volume transfer issues at noaa
This presentation is the property of its rightful owner.
Sponsored Links
1 / 14

High Data Volume Transfer Issues at NOAA PowerPoint PPT Presentation


  • 70 Views
  • Uploaded on
  • Presentation posted in: General

High Data Volume Transfer Issues at NOAA. Christopher D. Elvidge Earth Observation Group National Oceanic and Atmospheric Administration National Geophysical Data Center Boulder, Colorado August 26, 2005 [email protected] NOAA’s Vision and Mission.

Download Presentation

High Data Volume Transfer Issues at NOAA

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


High data volume transfer issues at noaa

High Data Volume Transfer Issues at NOAA

Christopher D. Elvidge

Earth Observation Group

National Oceanic and Atmospheric Administration

National Geophysical Data Center

Boulder, Colorado

August 26, 2005

[email protected]


Noaa s vision and mission

NOAA’s Vision and Mission

  • VISION – An informed society that uses a comprehensive understanding of the role of the oceans, coasts, and atmosphere in the global ecosystem to make the best social and economic decisions.

  • MISSION – To understand and predict changes in the Earth’s environment and conserve and manage coastal and marine resources to meet our Nation’s economic, social, and environmental needs.


Benefits of satellite earth observations

Terrestrial, Coastal & Marine Ecosystems

Water Resources

Natural & Human Induced Disasters

Energy Resources

Sustainable Agriculture & Desertification

Human Health & Well-Being

Biodiversity

Weather Information, Forecasting & Warning

Climate Variability & Change

Benefits of Satellite Earth Observations


Noaa s current satellite observing systems

NOAA’s Current Satellite Observing Systems

  • Polar-orbiting Operational Environmental Satellites (POES) ~10 GB per day.

  • Geostationary Operational Environmental Satellites (GOES) ~ 10 GB per day.

  • Defense Meteorological Satellite Program (DMSP) ~ 8 GB per day.


Noaa s future satellite observing systems

NOAA’s Future Satellite Observing Systems

  • NPOESS Preparatory Project (NPP) ~4 TB per day 2008- 2012.

  • National Polar-orbiting Operational Environmental Satellite System (NPOESS) C1 ~4 TB per day 2010-2015.

  • National Polar-orbiting Operational Environmental Satellite System (NPOESS) C2 ~4 TB per day 2012-2017.

  • National Polar-orbiting Operational Environmental Satellite System (NPOESS) C3 ~4 TB per day 2014-2019.

  • Geostationary Operational Environmental Satellites-R (GOES-R) ~ 2 TB per day 2012-2017.


High data volume transfer issues at noaa

Projected NOAA Data Holdings By Year


High data volume transfer issues at noaa

The NOAA Comprehensive Large Array-data Stewardship System(CLASS) will be the long term archive for the data from these systems, providing data access for the scientific community.


Hardware and network design

Hardware and Network Design

  • CLASS will have three operational sites (NGDC, NCDC, and NASA IV&V)

  • CLASS will have a centralized development environment and a centralized integration and test environment at NSOF

  • CLASS will use a Multi-protocol Label Switching (MPLS)-based peerless IP network used for site to site communication

  • New hardware and network architecture

    • Implemented by January 2006

    • Modular, scalable, and redundant

    • Addresses security requirements


High data volume transfer issues at noaa

CLASS Multi-Site Configuration


Class distribution process

CLASS Distribution Process


High data volume transfer issues at noaa

NGDC will have direct access to the NLR via the Front Range GigaPop for use in delivering data from CLASS


The data hog

The Data Hog?

  • The Visible-Infrared Imaging Radiometer Suite (VIIRS) will fly on NPP and each of the NPOESS satellites.

  • Raw data (RDRs) from a VIIRS will run 116 GB per day.

  • Radiance calibrated geolocated data (SDRs) will tilt to 815 GB per day.

  • Environmental data records (EDRs) will bulge towards 2 TB per day.


The challenges

The Challenges

  • Moving the data within NOAA - from the Suitland to the CLASS nodes.

  • Providing simple, useable tools to establish and manage large volume data subscriptions.

  • Transferring large volumes of data to the users, including those in the APAN region.

  • MAFFIN, Chiba U., U. Tokyo, Tokoku U. in Japan have expressed interest in receiving global VIIRS data!


Thanks for listening questions

Thanks for ListeningQUESTIONS?


  • Login