1 / 5

GEO-Amazon Cloud Credit Program and a Prototype Sentinel Data Pipeline

This article discusses the GEO-Amazon Cloud Credit Program, which offers $1.5M USD of cloud credits to developing countries for hosting, processing, and analysis of Earth observation data. It also explores the development of a prototype Sentinel data pipeline for efficient production of analysis-ready data (ARD) in the Amazon cloud.

francescab
Download Presentation

GEO-Amazon Cloud Credit Program and a Prototype Sentinel Data Pipeline

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GEO-Amazon Cloud Credit Programand a Prototype Sentinel Data Pipeline • CEOS SIT-34 Meeting • Session 3.5 • Coconut Grove, Miami, FL, USA • April 3-4, 2019 • Brian Killough • CEOS Systems Engineering Office • NASA Langley Research Center

  2. GEO-Amazon Cloud Credit Program • Amazon Web Services (commercial cloud provider) has offered $1.5M USD of cloud credits to GEO • These credits will allow developing countries access to cloud services to support hosting, processing and analysis of Earth observation data for sustainable development. • Project proposals are due to GEO by 12 April (recently extended). Successful proposals will be announced by 15 May, with the credits being awarded as of 1 June, for a 3-year period. • Evaluation panel includes the GEO Secretariat Director, GEO Senior Scientist and 3 GEO Programme Board members.

  3. CEOS Participation in the GEO-AWS Program • The call for proposals does NOT require the use of Data Cubes, but leaves all options open for use of AWS cloud resources. • GEO does not know who will propose to this call and what those proposals will include. Many proposers could ask for help with CEOS satellite data preparation and Open Data Cube (ODC) installation. • At the annual CEOS-GEO meeting (February 2019), GEO agreed that CEOS would conduct a technical evaluation of the proposals prior to selection and offer an analysis of issues or concerns regarding satellite data provisions and Open Data Cube installation and operation. • The SEO will take the lead on this task. Support from CEOS Agencies is desired and welcome. If the proposers ask for satellite data support and ODC support, we (CEOS Agencies) will need to evaluate whether we can meet those requests, as it will take resources.

  4. Sentinel Data Pipeline The issue ... • The SEO has been engaged in a number of global projects that require S1 and S2 analysis-ready data (ARD). These include the Africa Regional Data Cube (ARDC), numerous country-level data cube prototypes and the future DE-Africa. • S1 and S2 level-1 archive downloads are challenging due to significant data volumes. We would prefer to use cloud computing for ARD creation and storage of data. • The SEO will lead a task to develop a prototype Sentinel “data pipeline” to efficiently and effectively produce ARD and make it available in the Amazon cloud. The SEO has been in contact with ESA (Steven Hosford and Albrecht Schmidt) to discuss implementation options and connections with DIAS as well as European commercial options.

  5. Sentinel Data Pipeline The proposed solution ... • The SEO has begun discussions with e-geos and Sinergise(commercial companies in Europe) to explore approaches for improved S1 and S2 data preparation. Each of these companies is involved with DIAS projects. • e-goes has developed a web-based prototype CUBEO tool that pre-processes Sentinel data to CARD4L format and pushes the products directly to the Amazon cloud ... no downloads. They currently use the Copernicus Open Access Hub for their input data. • Sinergise has extensive experience creating S1 and S2 ARD products for cloud storage (CREODIAS, Amazon). • These solutions could provide critical “data services” for the Africa Regional Data Cube (ARDC), several other global data cube projects, and may serve the data needs for the new continental DE-Africa initiative.

More Related