1 / 22

European EO Long Term Data Preservation M. Albani USNG User Workshop

European EO Long Term Data Preservation M. Albani USNG User Workshop ESA/ESRIN, Frascati, 19 June 2008. Long Term Data Preservation Need and Benefits. Keep track of the past to model the future. Source of requirements I.

zelig
Download Presentation

European EO Long Term Data Preservation M. Albani USNG User Workshop

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. European EO Long Term Data Preservation M. Albani USNG User Workshop ESA/ESRIN, Frascati, 19 June 2008

  2. Long Term Data PreservationNeed and Benefits

  3. Keep track of the past to model the future

  4. Source of requirements I • The requirements for accessing historical archives strongly increased in the last ten years and the trend is likely to increase in the future mainly for long term science and environmental monitoring. • As the time-span of EO data archives extends from a few years to decades, their value as a scientific time-series is highly increased especially for global change. • In the next decade, the wealth of information currently locked inside the global data archives must be fully exploited and re-analysed on a global scale.

  5. Source of requirements II • “The goals of the science strategy will be achieved only if the data gathered are made easily accessible to all user communities concerned - both during the mission lifetime and afterwards (archives).” • [Ref.: The Changing Earth - Science challenges for ESA’s Living Planet Programme] • “Despite laudable efforts, the current situation with respect to the availability of Earth observations is not optimal. […] Moreover, there is an eroding observational infrastructure, inadequate long-term data archiving, and no assured continuity for many essential observing systems.” • [Ref.: GEOSS 10 Year Implementation Plan]

  6. Long Term Data Exploitation Long Term Data Preservation (LTDP) Data Archiving Data Access Long Term Trend Monitoring Long Term Trend Analysis Prediction, Forecast, Expectation

  7. Benefits – Main application areas • EC Policies with long-term perspective. • European and Global Environment (forest monitoring, soil monitoring, urban development, air quality monitoring, ecosystems monitoring and management for protection of resources). • Development and Humanitarian Aid. • Food Security. • Civil Protection and Disaster Monitoring (flood prediction and mitigation, landslides, subsidence, volcanoes monitoring). • Global Climate Change (monitoring the atmosphere, systematic climate observations, drought monitoring). • Global Security and Sustainable Development.

  8. Current Situation & challenges

  9. Current and Future EO Missions (excerpt) Envisat Explorers Sentinels ERS-2 Cosmo-Skymed Radarsat SPOT Pleiades Jason-2 Terrasar-X Rapideye UK-DMC METOP ODIN

  10. ESA: expected volume of data holding archive The plans of new ESA missions indicates 5-10 times more data to be archived in next 10-15 years. Similar trend is expected in most national archives due to the upcoming launch of several EO satellites.

  11. ESA - Archives management • Periodic migration processes to convert data (different media & formats) carried out to exploit the most advanced available technology (today automated tape libraries and disk farms). • Data compacting and conversion to the ESA standard format packaging (SAFE). • The Enhanced On Line data access to the long-term archive will allow online access to all archived data. • All long term data preservation activities executed at a minimum profile (part of operational maintenance).

  12. Main national EO Data Archives Oberpfaffenhofen and Neustrelitz (DLR) DLR missions, ERS-1/2 (DIMS) Indian missions NOAA AVHRR over Europe (since 1986 ?) Envisat TERRASAR X Toulouse (CNES) Altimetry (Topex, Jason, Envisat..) - STAF SPOT CNES Scientific missions (Polder, Parasol) Pleiades (future) Matera (ASI): Envisat, ERS COSMO SKYMED Darmstadt (EUMETSAT) Meteosat (since 1981), MSG EPS (future) Gatineau and Prince Albert (CCRS) Radarsat-1 Radarsat-2 Brandenburg (RapidEye) Rapid Eye (future) Guildford (SSTL, UK) DMC Oxfordshire (RAL, UK) SST from ERS-1/2 ATSR, Envisat AATSR, MODIS AVHRR MERIS Terrestrial Chlorophyll Index (MTCI) Fanborough (Qinetiq) Topsat Oberpfaffenhofen (EUSI) Ikonos over Europe and middle East (since 2003) Recently, many dedicated regional or local EO data archives have been established

  13. National archives • National and EUMETSAT archives mainly centralized in one facility. • Different technologies and data formats used but rather similar policies and procedures. • Each entity deals with its own data (often in a one by one mission basis). • Most missions do not have a committed long term data preservation strategy (typically around 10 years after EOL) • Long Term programmes and funding to support data preservation are generally missing. • Commercial operators could not be interested in maintaining old data (low commercial value).

  14. The European challenge • Access to long time series of EO data for long term science and environmental monitoring is needed. • Weak standardization and poor cooperation at European level even if cooperation and sharing in the LTDP field can bring a benefit. • No common policy for long term data preservation. • There is an urgent need for a coordinated and coherent approach for a harmonized European archives management policy to guarantee the complete European EO data set preservation. • ESA, within its mandate for space coordination, (reinforced in the “Resolution on the European Space Policy” adopted at the 4th Space Council in 2007), can coordinate and share a Common Long Term Data Preservation (LTDP) Policy among all the stakeholders. • LTDP, in the ESA view, represents a unique challenge for a coherent EO data archive management system and a unique opportunity for a coordinated European approach.

  15. European EO LTDP

  16. European LTDP Goals Preserve the European EO space data set for an unlimited time-span. Ensure and facilitate the accessibility and usability of the preserved European EO space data set. respecting the individual entities applicable data policies. Through the implementation of a cooperating/ harmonized distributed solution (European Long Term Data Preservation System): based on the application of a European LTDP Common Policy. sustained through cooperative (multi-source) long term funding schemes. Possibly ensure the coherency with the preservation of other non-space based environmental data and international policies.

  17. European LTDP: Consultation so far • ESA consultation with its Member States. • Consultation with Ground Segment Coordination Body. • LTDP Working Group (ASI, CNES, CSA, DLR, ESA): • Draft European LTDP Common Policy. • Ideas on a Cooperation Scheme and implementation plan to set-up the European LTDP System. • Consultation with all European EO mission and data archive owners.

  18. European LTDP Common Policy • The European LTDP Common Policy is to be intended as a Guideline: • not mandatory, partial adherence could be implemented in the short term and full adherence should be pursued in the mid-long term. • Seven Elements: • Archives maintenance and data integrity • Archives operations • Data security • Data access and interoperability • Reprocessing • Archived data exploitation • Standardization

  19. Cooperation & European LTDP System • Cooperation in the EO Long Term Data Preservation field should aim at the application of the European LTDP Common Policy and at a progressive joint: • technology and methodology development, • standardization activities in close link with international bodies, • implementation of operational solutions, • data exploitation. • The result of this cooperation would be an European LTDP distributed System: • based on the contribution from European EO Space data owners through their infrastructure. • consisting of heterogeneous components / elements cooperating to ensure an harmonized preservation of the European EO Space Data Set. • open to all possible members and sustained through a cooperative (multi-source) programmatic and long term funding framework.

  20. European LTDP: Next Steps • To consolidate a set of commonly agreed recommendations that can be used by each EO data archive owner to: • Ease the preservation and access of the own EO data through proven technologies, procedures and approaches. • Plan future funding schemes for EO data LTDP. • Highlight the importance and increase awareness on LTDP. • Cooperate on technology development, standardization activities, operational solutions and in data exploitation for cost-effective LTDP solutions. • ESA to present an independent, common or even shared approach to its member states and/or the EC. • ESA to present an implementation plan for the ESA missions based on the commonly agreed recommendations.

  21. Thank you for your attention! Contacts: Mirko.Albani@esa.intVincenzo.Beruti@esa.int

More Related