1 / 14

EOSDIS Core System Architecture

EOSDIS Core System Architecture. 10/21/2009 ESDSWG Dan Marinelli. EOSDIS Context. EOSDIS Context. EOSDIS Core System Architecture. ECS is responsible for the ingest, archive and distribution of NASA earth science data

hallam
Download Presentation

EOSDIS Core System Architecture

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EOSDIS Core System Architecture 10/21/2009 ESDSWG Dan Marinelli

  2. EOSDIS Context

  3. EOSDIS Context

  4. EOSDIS Core System Architecture • ECS is responsible for the ingest, archive and distribution of NASA earth science data • Deployed to three sites, Land Processes DAAC, National Snow and Ice Data Center, and Atmospheres Science Data Center • Supports data management for 9 instruments on 7 spacecraft • Primary stakeholders are: DAACs, SIPS, ECHO Providers (non-ECS), Instrument Teams, Science Users, End Users, ESDIS Project

  5. ECS SDPS Context

  6. SDPS/ECHO Architecture

  7. Current Capacities, etc. • Online Archive volume (current/Jan 2010) • LP ~1PB/1.13PB; NSIDC 98TB/108TB; ASDC 632TB/739TB • Ingest Rates (daily requirement - granules/TB) • LP 111k/1.68; NSIDC 48k/.2; ASDC 36k/2 • Distribution Rates (daily requirement - granules/TB) • LP 428k/5.2; NSIDC 178k/1; ASDC 73k/5.4 • Development facility has 634 TB of test data contained in ~120M granules • Currently, ECHO has over 15000 users searching/ordering data

  8. Other Notes • The Science Data Processing Toolkit (SDPTK) is installed at 15 IT facilities in the US, Japan, and Europe • Metadata Time and Date tools separated out for teams that just need to write metdata • Algorithm Theoretical Basis for the toolkit algorithms was published in 1995!

  9. Backup

  10. Communications (CSS) aInternetworking (ISS) ECHO BMGT (Export Metadata & Browse) PULL PUSH ECHO Orders Data Management DMS Data Pool Ingest (DPL INGST) CLS (Check Order Status) Order Manager (OMS) External Data Sources and Providers SSS Online Archive/ Data Pool (DPL) DSS Insert and Retrieve Science Software and Data Tape Archive (LTO) EMOS ECS Subsystem Architecture Diagram

  11. ECS Subsystem Summary • BMGT - exports inventory status information • CLS - user interface to check order status. • DMS - providing support for data retrieval across all ECS sites. • DPL supporting the search, order, and distribution of selected granules with associated metadata and browse granules (if available).

  12. ECS Subsystem Summary (cont.) • DPL INGEST service will handle the SIPS ingest interface, S4P, cross-DAAC ingest, EDOS ingest, ASTER Ingest and Polling without Delivery Record specifically for EMOS. • DSS with the functions needed to manage the inventory of archived data.

  13. ECS Subsystem Summary (cont.) • OMS managing all orders received from the DMS EWOC (i.e., from WIST and ECHO), the Machine-to-Machine Gateway, and the Spatial Subscription Server. • SSS supporting the creation, viewing and updating of subscriptions and the creation, viewing and deletion of bundling orders (specification of distribution packages and criteria for package completion).

  14. ECS/ECHO References • http://edhs1.gsfc.nasa.gov/ • Design docs, operations procedures, SDPTK user guides, HDF-EOS reference and user guides • For ICDs and other ESDIS-controlled documentation contact me at daniel.j.marinelli@nasa.gov • For ECHO documentation contact andrew.e.mitchell@nasa.gov, or if you’re brave go to our EED RFP website: http://esdis.eosdis.nasa.gov/eed/index.html and find what we’ve posted there (for a limited time!)

More Related