Workshop on Information Access Enablers Météo France Strategy

1. Workshop on Information Access EnablersMétéo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac

2. Information access in Météo France • Stage 1: Current status • Okapi production platform (finalized products) with a Web portal • IAA (Random Access on Legacy databases) with a bespoke language via ftp • Stage 2: Information system evolution • SOA (with a part of OGC services) • Information model with geographic references • Spatial databases • Light and smart client (forecaster station project) • Stage 2 bis: WIS solution • OpenWIS developed with UKMO • Metadata generator

3. Stage 1: Production Service Okapi - IAA • OKAPI: Three software bricks, loosely linked : • Okapi production platform (products factory). • Internal production portal : Okapimet (For web and webservice customers). • production portal : Climatheque (For web and webservice customers). • IAA • Random access • On the legacy databases • Archive access possible • With a bespoke language

4. System schema

5. orchestration, traffic shaping • Traffic shaping mechanisms • Balanced charge. • Product factory (close WTS) • Identity management (authorization, authentication)

6. Stage 2: New project Synopsis: Forecaster tools based on SOA • Two main requirements • SOA • Development efforts factorization • Processing and data pool access • Standard interfaces • Management of different topologies (local or remote server, standalone) • WMO needs and INSPIRE recommendation • Client station • Last technologies • Deployment and support easy • Light or smart client • Scalable, efficient • Multi-platforms

7. Technical choices • Synopsis Server : • Linux 64 bits : • Re-use of current services in different systems • Use of programs and libraries of ECMWF • Use of bricks OpenSource • Databases: PostgreSQL, PostGIS • Image processing: GDAL, Proj4 • Mapserver : services OGC • Geonetwork for the catalogue

8. The services • Different service levels • Metadata access (catalogue) • Data access • Business processing (graphic processing) • Presentation services (images, maps, graphics…); • Interoperability for the map services • So : WMS (Web Map Service) et CSW (Web Catalog Service) • For INSPIRE, interoperability also on data and processing services (transformation and downloading) • So : WCS (Web Coverage Service) WFS (Web feature Service), WPS (Wep processing Service) ….

9. CRUD CRUD CRUD SOA : Reference architecture Engine Orchestration BPM Supervision Application composite Application composite Services Registry Application composite Business process SAM BAM Bus for messages Data access Business services Processing / Transformation Administration Plate-Form SAM : Service Activity Monitoring Legacy databases BAM : Business Activity Monitoring BPM : Business Process Management CRUD : Create Read Update Delete

10. Web Coverage Server Web Feature Server Web Map Server Interoperability • Strategic target • Use of the standards • OGC standards for geo-referenced data • Web Map Service (WMS) • Web Feature Service (WFS) • Web Coverage Service (WCS) • Catalogue (CSW) • Geography Markup Language (GML) • Web Map Context (WMC) • OGC KML • Others…

11. BDMO Geo-extension BDI BDEPI BDE BDAP Geo-ext WPS SOS SPS WMS WCS WFS FPS BDMO Ref) BDI Ref BDEPI Ref BDE Ref BDAP Ref Legacy databases SOA : Architecture interoperability on legacy databases with geographic extension Administration Plate-Form Supervision Plate form Client SYNOPSIS Java Web Start Client SYNOPIS Full Web Interface HPOV Catalogue Other applications composites Bus of messages JMS CSW Data Service Processing service Presentation service

12. Coast map lines Objects : Anasyg Pi, Sympo2, Aeronautic OACI Annex 3 Services de DONNEES WCS WFS SOS WFS Web Feature Service Data Access Services

13. Static geographic layers Images Radar, Sat Observation Services PRESENTATION Models plots Objects : Anasyg Pi, Sympo2, Aeronautic OACI Annex 3 FPS WMS WMS Web Map Service Portrayal Services

14. BDMO Extension BDI Extension BDEPI Extension BDE Extension BDAP Extension WCS WFS WMS FPS SOS WPS SPS CSW BDMO Ref) BDI Ref BDEPI Ref BDE Ref BDAP Ref Legacy databases Different clients Client VGISC OKAPI Advanced Production Client SYNOPIS Light (Full Web) INSPIRE answer VGISC Client SYNOSIS Smart CATALOGUE Service Data access services (CRUD) Processing services Presentation services

15. General Architecture • Data and services catalogue (standard) • On line products and services discovery. • Message bus • Balanced flow (cluster services) • Loosely link between server and client • Spatial database • Using MapServer and other OGC implementations • Standard interfaces used by the clients • Possibility to access to extern services (without guarantee of performances) • Useful for a wandering forecaster

16. Prototype Architecture Client SYNOPSIS Full Web Client SYNOPSIS JAVA Web Start Network (IP) WMS (cartes) CSW Frontal SYNOPSIS (SynFront)HTTP -> JMS CATALOGUE Geonetwork ISO 19115-19119 Middleware ( bus JMS ) Server SYNOPSIS (SynServ) JMS MapServer WMS Business service MapScript Servlet Executable CGI Metadata ISO 19115 ISO 19119 Magics++ Services on cluster Soprano Transmet Retim BD Spatiale (SynBase) PosGIS Alimentation BD (SynDATA) File System

17. Premières maquettes

18. Premières maquettes

19. Architecture Target (Back Office) Clients WMS Présentation cartes WCS Access Images Modèles WFS Object access PI, SYMPO2 AERO (WXXM) WPS Processing CRS transf. … Client Synopsis JAVA Client Synopsis WEB Client Production Front End CSW bus JMS internal CATALOGUE Geonetwork ISO 19115-19119 Serveur SYNOPSIS CLUSTER “Backbone” of services (ESB ?) Monitoring Administration Sécurity Serveur SYNOPSIS Servers WMS Présentation Cartes RMDCN BD’s Spatiales PostGIS BDEPI BDE BDI « new » BD spatiale (SynBase) PostGIS CEP WEB High availability SOS SPS WPS Processing Stats SOS Access Obs validated WMS Présentation Maps Obs Front End BD’s SOPRANO BDM BDCLIM BDAP BDI Obs & time series Front End CBD [OKAPI ?]

20. Stage 2 bis: WIS Approach • OpenWIS development : • Information fetching: Different use cases • OpenWIS: Open interfaces • Request or subscription • Météo France use two diffusion systems • Metadata GTS generator • To populate the WIS catalogue • Mapping between Volume C1 and Core Metadata Profile • Close the prompting question on information sources

21. 7bis: the user receives the products. 1: the user discovers local product type in the catalogue FSS Ad-hoc Request for a product in the Cache – dissemination via the FSS (GISC function) 5bis: the user obtains the products from the shopping cart. 3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options. 4: The product type is part of the global dataset. The requested products are extracted from the Cache. 2: the user is authenticated (several steps) Portal 5: Storage in the shopping cart for an online distrbution, or preparation of the dissemination instructions: they are constructed from the user profile, among other elements. DAR subscriptions (user profile) 6: the products and instructions are forwarded. OpenWIS MSS 7: Dissemination according to instructions. Routing

22. 8bis: the user receives the products. 1: the user discovers local product type in the catalogue FSS Ad-hoc Request for a local product – dissemination via the FSS (NC or DCPC function) 6bis: the user obtains the products from the shopping cart. 3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options. 4: the product type is owned by a local NC or DCPC. 2: the user is authenticated (several steps) Portal 6: Storage in the online shopping cart, or preparation for dissemination. DAR subscriptions (user profile) 7: the products and instructions are forwarded. OpenWIS 5: the required products are extracted and returned. SOURCE MSS 8: Dissemination according to instructions. Routing

23. 6bis: the user receives the product. FSS Arrival of a new GTS product at the MSS (GISC function) 4bis: the user obtains the product from the shopping cart. 3: Is someone subscribed to this type of product ? Portail 4: Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions. DAR subscriptions (user profile) 2bis: the product is collected and inserted in the GISC Cache 5: the product and instructions are forwarded OpenWIS MSS 6: Dissemination according to instructions. 1: the MSS receives a new product 2: the MSS routes the product according to its routing table Routing

24. 7bis: the user receives the product. FSS New local product available (NC or DCPC WIS function) 5bis: the user obtains the product from the shopping cart. 5: Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions. Portal 3: Is someone subscribed to this type of product ? 2: Notification of the product availability DAR subscriptions (user profile) 6: the product and instructions are forwarded OpenWIS 4: the required products are extracted and returned. SOURCE TRANSMET 7: Dissemination according to instructions. Routage 1: New local product

25. Make / Follow Request Browse / Search DAR Manage Requests « Ad Hoc » Routine « Push » DIFF Collection Administration DARMet A2 A4 User Interface (web portal) A7 A6 Admin / Monitoring Metadata service A1 A3 Data service A1 A3 A5 Authentication Security Service Monitoring & Control Service Catalogue Access Cache Monitoring Authorisation Metadata Catalogue Synchro & Harvesting Replication External Interface A1 A3 A5 User & Data Policies POSSIBLE CHOICES OpenWIS UK MetOffice SIMDAT base GeoNetwork base MSS/FSS Sun OpenSSO base MSS SMART / GEMS A1 A5 A5 A1 Local System

26. GTS Metadata GeneratorClose to prompting question on digitization