A Web of EO Processing Services

1. A Web of EO Processing Services Jordi Farres Models for scientific exploitation of EO Data ESRIN, 11-12 Oct 2012 ESA UNCLASSIED - For Offical Use 11/10/2012

2. Agenda • Introduction • A case study - GPOD • A model of scientific exploitation – Earth Web • Conclusions ESA UNCLASSIED - For Offical Use 11/10/2012

3. Intro: GSCB meeting [ESRIN, 6/6/2012] • PI work more frequently on long-term data series (M.Albani) • Sentinel data policy: “data available at no fee within the financial limits for operations costs” (J. Aschbacher) • SAR Data provision limited by “data quota based on technical constraints” (H.Laur) • ESA processing on-demand (GPOD) is employed at 10% in 2009, peaks to 100% in 2012 (J.Farres) • The policy may meet expectations but not its implementation • High pressure for better dissemination and processing services ESA UNCLASSIED - For Offical Use 11/10/2012

4. Intro: Cloud Computing & Large ICT providers • The Science Cloud – Helix Nebula • SuperSites Exploitation Platform • GAIA on Amazon • NASA uses Amazon's cloud computing in Mars landing mission • HPC becomes an utility • Opportunities to team with large ICT providers ESA UNCLASSIED - For Offical Use 11/10/2012

5. What is the preferred exploitation model? An Earth Box An Earth Web Expose data on an exploitation platform Federate services from different EO providers Users develop the value added services on a common framework • Drop all data on large Dropbox • Place all data in the cloud • Users / service autonomously develop: Applications, Services and Research ESA UNCLASSIED - For Offical Use 11/10/2012

6. Intro: An Earth Web • A facility • for EO dissemination and processing services • geographically distributed • in a federated domain • largely scalable • with reliable QoS ESA UNCLASSIED - For Offical Use 11/10/2012

7. Agenda • Introduction • A case study - GPOD • A model of scientific exploitation – Earth Web • Conclusions ESA UNCLASSIED - For Offical Use 11/10/2012

8. A case study: G-POD ESA UNCLASSIED - For Offical Use 11/10/2012

9. A case study: G-POD PORTAL CATALOGUE CATALOGUE DATA DATA DATA COMPUTING COMPUTING COMPUTING ESA UNCLASSIED - For Offical Use 11/10/2012

10. A case study: G-POD PORTAL PROCESSOR PROCESSOR COMPUTING COMPUTING COMPUTING ESA UNCLASSIED - For Offical Use 11/10/2012

11. A case study: G-POD / SSEGrid ESA UNCLASSIED - For Offical Use 11/10/2012

12. Agenda • Introduction • A case study - GPOD • A model of scientific exploitation – Earth Web • Conclusions ESA UNCLASSIED - For Offical Use 11/10/2012

13. An Earth Web Model – Service ladder EO Community Mgt EO Service Provider EO Resources Provider Cloud Provider ESA UNCLASSIED - For Offical Use 11/10/2012

14. An Earth Web Model – Interoperability ESA UNCLASSIED - For Offical Use 11/10/2012

15. An Earth Web Model – Challenges • Execute processing X on data Y over server Z (portability) • Quantify user authorization in relation processing resources • Profile users in relation to QoS • Ability to quote “budget” for processing X on data Y • Accounting à la cloud for ICT resources • Harmonized authorization and accounting • … ESA UNCLASSIED - For Offical Use 11/10/2012

16. Conclusions • An “Earth Web” model is better suited for scientific exploitation than a simple “Earth Box” • Facilities/Institutions can federate their own resources/services and get access to the federated pool. • Facilities can profile different service layers: ICT, Data, Data Mgt, Processing Services, … • BUT Interoperability / Standardization for Processing Services is NOT there ESA UNCLASSIED - For Offical Use 11/10/2012