VOYAGER Data Federation Tools and Services Built and Used by a Virtual Community

1. Publish, Find, Bind Data & Tool Catalog Uniform Access/Retrieval Time Chart VOYAGER Data Federation Tools and Services Built and Used by a Virtual Community Providers Voyager Federation Web Services Users XDim Data Layered Map SQL Table OLAP GIS Data Vector Web Scatter Chart Images Maintain Distributed Data; Heterogeneous coding , access Connect providers to users; Homogenize data access Select, Overlay, Explore; Multidimensional data

2. Idaho Fires, 2000: Overlaying Fire Locations, PM2.5, SewWiFS PM2.5 data from the IMPROVE and AIRS database at Colorado State (VIEWS) Fire locations from European Space Agency (Project IONIA) Reflectance image from NASA SeaWiFS Project FEDERATED DATA SOURCES: CIRA ColoState-VIEWS European Space Agency Generic Map Server NASA SeaWiFS Project CAPITA SeaWiFS AOT

3. Idaho Fires Example (August 2000) Derived aerosol optical depth provides a focused look at smoke dispersion ASTR Fire Locations Processed SeaWiFS image showing aerosol optical depth The SeaWiFS reflectance image is hidden to expose the aerosol optical depth image ‘below’ it

4. The Dvoy Project DVOY is Federated Information System for heterogeneous, multidimensional datasets Voyager is a generic graphic browser for the federated DVOY data. The initial Dvoy infrastructure is being developed at CAPITA, with NSF support Further services for data access, processing and viewing are expected from the community The project evolution is to ride 'web services wave‘ of the Internet CAPITA projects which use DVOY: • NSF ITR Workgroup Collaboration Tool: Aug 2001 - Aug 2004 • EPA Web-based Visibility: Aug 2001 - Apr 2003 • NOAA ASOS Visibility: Sep 2001 - Sep 2002 • MARAMA Chemical Trajectory Tool: Aug 2002 - July 2003 • EPA OAQPS Global Transport Analysis: Nov 2002 – Oct 2003 • NSF DigiGov Fire and Smoke Network: May 2003 – Apr 2006 Pending • NASA ESE Satellite Appl. to PM Management: June 2003 – May 2008 Pending In-kind support by organizations participating in DVOY-based federated data sharing Collaborators/Partners: CIRA (Schichtel), NRL(Westphal), NASA (Goddard)…many data sources. CAPITA cast: R. Husar, S. Falke, K. Hoijarvi, J. Colson, R. Zager)

5. Private Shared Applications PM Policy RPO Federated Data System Data, Tools, Methods Other Federations Regulation VIEWS RPO RPO Mitigation NASA NAAPS Federated Information System • Data producers maintain their own workspace and resources (data, reports, comments). • However, part of the resources are shared through a Federated Information System. • Web-based integration of the shared resources can be across several dimensions: Planned data sharing federations: • Open GIS Consortium (GIS data layers) • NASA SEEDS network (Satellite data) • NSF Digital Government • EPA’s National Env. Info Exch. Network.

6. RPO Data Sharing • Management of visibility and PM requires coordination among local, state, regional and and federal agencies. • data collection • data analysis • forecasting/modeling • communication to managers and the public. • A Federated PM Data Sharing Network could augment the dedicated RPO efforts, e.g VIEWS. • identify and fill data gaps • incorporate new data such as satellite imagery • use community efforts to prepare summary/assessments • present summary/assessments to managers and the public

7. Catalog Wrapper Mediator Service Chaining in Spatio-Temporal Data Browser Data Sources Homogenizer OGC-Compliant GIS Services Spatial Portrayal Spatial Overlay XDim Data SQL Table OLAP Client Browser GIS Data Data Cube Vector Spatial Slice Time-Series Services Time Portrayal Time Overlay Satellite Images Time Slice Cursor/Controller Maintain Data Find/Bind Data Portray Overlay Render

8. Data Space i View 2 View 1 k j j i i Multi-Dimensional Data Model 1 Dimensional e.g. Time dimension Data can be distributed over 1,2, …n dimensions 1 Dimensional e.g. Location & Time Data Granule 1 Dimensional e.g. Location, Time & Parameter Views are orthogonal slices through multidimensional data cubes Spatial and temporal slices through the data are most common

9. Service Broker Publish Find Service User Service Provider Bind Web Services Components and Actions Components: Provider – User – Broker Actions: Publish – Find - Bind • Service providerspublish services to a service broker. • Service usersfind the needed service and get access key from a service broker • With the access key, users bind to the service provider • The result is a dynamic binding mechanism between the service users and providers

10. Data Access though a Web Service Adapter Service Cataloger Ordinary web content can be delivered as a Web Service through a Proxy Server. • The Wrapper Service converts HTTP/FTP service to XML Web service • The Wrapper Service is published as a web service to the Broker • The User finds the service from the broker and accesses the Wrapper to use the service Find UDDI, WSDL Publish UDDI, WSDL Web Publish HTTP, FTP Service Wrapper HTTP/FTP Service Service User Chain Access SOAP, XML Service Consumer

11. Interoperability through a Layered Protocol Stack Interoperability Standards Service Integr. WSFL, XLANG • Web Services are implemented on a layered stack of technologies and standards • The lower layers enable binding and exchange of messages; higher levels enable interoperability • Applications are formed dynamically from distributed components through publish-find-bind mechanisms Service Discovery UDDI OGC Catalog Service Descript. WSDL OGC Coverage, CoordTransfom, WMS Web Service Connectivity Data Binding HTTP, SOAP Data Schema HTML, XML OGC -GML Data Encoding ASCII, XML, etc. Comm. Protocols TCP/IP, HTTP, FTP

12. Architecture of Dvoy Federated Information System • The main software components of Dvoy are wrappers, which encapsulate sources and remove technical heterogeneity, and mediators, which resolve the logical heterogeneity (e.g. Busse et. al., 1999). • Wrapper classes are available for geo-spatial (incl. satellite) images, SQL servers, text files,etc. The mediator classes are implemented as web services for uniform data access to n-dimensional data.

13. Features of the DVOY XML Web Service Architecture Interoperability: Platform and language independence; based on Web Services (XML,SVG) Legacy Support: Encapsulating existing data and exposing them as Web Services. (Access to standard HTTP/FTP servers) Just-in-time integration: Discovery, access to and ad-hoc chaining of services. (Future: Agile application building) DVOY draws on three basic web services: DataCatalogWrapping service is for data registration, finding and wrapping information DataAccess service provides uniform access to heterogeneous, distributed, multidim. data DataPortrayal service prepares input data in form suitable for rendering

14. Data Catalog

15. NRL Forecast Model for Dust, Smoke and SulfateMETAR Surface Haze • Real-time model and surface observations are compared spatially and temporally Smoke Sulfate Dust METAR Haze Time Selector

17. Quebec Fires, July 6, 2002 SeaWiFS satellite and METAR surface haze shown in the Voyager distributed data browser Satellite data are fetched from NASA GSFC; surface data from NWS/CAPITA servers SeaWiFS, METAR and TOMS Index superimposed

18. Trans-Atlantic Transport of Quebec Smoke SeaWiFS Reflectance TOMS Absorbing Aerosol July 10: Quebec smoke over Mid-Atlantic July 11: Smoke approaching Europe E. US Spain SeaWiFS Reflectance TOMS Absorbing Aerosol Spain

19. Browsing of Distributed Data from HTTP/FTP Servers Land Reflectance from SeaWiFS Project, NASA GSFC Fire Pixels, Jan 1997, ESA Ionia Project AVHRR Oceanic Aerosol CAPITA, WashU, STL

20. NSF-NOAA-EPA/EMAP (NASA)? Project:Real-Time Aerosol Watch System Real-Time Virtual PM Monitoring Dashboard. A web-page for one-stop access to pre-set views of current PM monitoring data including surface PM, satellite, weather and model data. Virtual Workgroup Website. An interactive website which facilitates the active participation of diverse members in the interpretation, discussion, summary and assessment of the on-line PM monitoring data. Air Quality Managers Console. Helps PM managers make decisions during major aerosol events; delivers a subset of the PM data relevant to the AQ managers, including summary reports prepared by the Virtual workgroups.

21. wind direction PM/Bext time series Bext contours back trajectories PM2.5 contours satellite image temperature NAAPS model web cam Real-time PM Monitoring DashboardExample Views – Selected from Dozens of spatial, temporal, height cross-sections