Tools for Data Access and Application

1. Tools for Data Access and Application Dave Foley CoastWatch Coordinator Joint Institute for Marine and Atmospheric Research University of Hawaii Fisheries Applications of Satellite Data Corvallis, OR August 22, 2006

2. Overview • Data and derived products made available • Various access mechanisms • Choosing tools appropriate to the application • Outline of Laboratory Section of the course

3. Early Platforms - Balloon

4. Early Autonomous Platforms

5. Composite product

6. Composite Images • Integrate across time on one platform to mitigate obscuring by clouds • Integrate across sensors and platforms (e.g., microwave and Ifrared, polar-orbiting and geostationary)

8. Composite (what we want to use)

9. A Real-Time Blended SST Product using 2DVAR Data Sources: AVHHR, GOES, AMSR-E, TMI, and in-situ

11. Blended 5-day SST

12. New Regional Coverage

14. Include those from satellite sensors that measure SST Ocean color Ocean winds, and Sea surface height. Satellite Ocean Data and Data Products

15. Deliver Useful Products • Easily Accessed (flexible systems) • Acquisition • Transportable formats • Value-added products • Relevant • Simple (indices, thresholds, anomalies) • Sample applications

16. Products for NMFS • Convergence time series • Marine debris • Long-line fisheries • Interaction of LL fishery and turtles • Blended SST • Mesoscale oceanography • Geolocation • Primary Productivity

17. Products for NMFS • Surface ocean currents • Larval transport • Analysis • Extracted time series (simple) • Program design • Data acquisition • Context for data analysis

18. New Satellite Products • Solar irradiance (GOES and GMS) • GOES frontal probability Index • Upwelling Index (PAR, wind, Chl a, SST and SSH) • Convergence index (Wind, Chl a, SST)

19. Product Development • Specific NOAA needs identified • Utilize existing infrastructure and human resources when possible • CoastWatch (funded by NESDIS) • OceanWatch (joint effort NMFS/NESDIS) • Partner with external agencies for data access and new product development • Partner with people who know the critters.

20. GOES SST July 2-11, 2004

21. MODIS Chl a July 2-11, 2004

22. QuikSCAT Wind Stress Curl July 2-11, 2004

23. Jason-1 SSH and OSCAR currents July 2-11, 2004

24. Data Management • Sustaining Operational Data Streams • Establishing and Maintaining Archives of established products • Meeting IOOS/GEOSS Standards • Meeting Specialized Regional Needs for new products • Making data more useful and usable

25. Data Access • Near Real Time • Live access server las.pfel.noaa.gov/oceanwatch.html • Simple SST Browser coastwatch.pfel.noaa.gov • New and improved browser coastwatch.pfel.noaa.gov/coastwatch/CWBrowser.jsp • Delayed science-quality data • Live access server (above) • Archive (????)

26. National Data Centers • NASA DAACS • PODAAC at Jet Propulsion Lab • DAAC at Goddard • CLASS (NOAA)

30. Maintaining Time Series • Develop tools for frequent and long-term monitoring of the ocean environment as it pertains to living marine resources • Integrate complimentary data sets to generate products regionally appropriate • Deliver derived products for timely use by resource managers and researchers from a variety of disciplines

31. Cross-platform Continuity

32. Comparing Different Spatial Scales

33. New Life for Old Time Series

34. Remotely Sensed “Monitoring Stations”

35. Data Integration • Essential types of integration • Ground truth • Improves satellite products

36. SST at Maro Reef • Define minimum acceptable performance • Know when it works • Know when it fails • Devise regional calibrations

37. Data Integration • Essential types of integration • Ground truth • Improves satellite data • Sky truth • Improves in situ collection method

38. Winds at French Frigate Shoals • Identified discrepancy between satellite and in situ • Tested additional in situ platforms • Corrected error in mooring data

39. Applications Tools • ArcGIS (or other ESRI Products) • Excellent geographic referencing • Simple graphical interface • WYSIWYG output • Cannot easily sample at frequencies appropriate to relevant oceanic and atmospheric phenomena.

40. Application Tools • Matlab, IDL, R etc… • Rigorous processing capabilities • Flexible I/O

41. Sample Procedure GOES Frontal Probability Index • Algorithm Development • U. Wisconsin (F. Wu) • NESDIS (T. Mavor) • MLML (L. Breoker) • OSU (T. Strub) • Data delivery • NOAA|NESDIS (GOES) • NASDA (GMS)

42. Sample Procedure Solar Frontal Index • Processing • NOAA|NESDIS|ORA (GOES) • CoastWatch (GMS) • QA/QC • CoastWatch and CIOSS (OSU) • IMERP (Peru) • End product generation • CoastWatch

43. Course Schedule Tuesday Afternoon • ArcGIS I - Luke Spence (SWFSC, Pacific grove) • Accessing and importing satellite data into ArcGIS • Overlay and extract data along animal tracks • Using “BobDAP” for data access

44. Course Schedule Wednesday Morning • ArcGIS II - Carlos Rivera (SEFSC, Miami) • Importing vector and raster data into ArcGIS • Processing data within ArcGIS • Review of data models available • Project-based development

45. Course Schedule Wednesday Afternoon • CDAT - Dave Foley (SWFSC,Pacific Grove) • Basic satellite data manipulation tool • Recently enhanced acquisition capability • Matlab • Data acquisition via OPeNDAP • Data extraction for time/space points • Quick n’ dirty data analysis for tracks • Sample application (xtractomatic).

46. Course Schedule Thursday • Work on projects • Return to earlier topics (user request) • Present/discuss progress on projects in the afternoon • Bomb’s Away