NPOESS Preparatory Project (NPP) Science Data Segment (SDS) Ocean PEATE Status and Plans

1. NPOESS Preparatory Project (NPP) Science Data Segment (SDS) Ocean PEATE Status and Plans January 27, 2010 Ocean PEATE Team

2. SDS Overview • The NASA NPP Science Data Segment is a distributed system consisting of: • Central Science Data Delivery and Depository Element (SD3E) • Discipline-specific Product Evaluation and Analysis Tools Elements (PEATEs) • NPP Instrument Calibration Support Element (NICSE) • Integration and Test Support Element (I&TSE) – the mini-IDPS • Project Science Office Element (PSOE) • The PEATEs are supported by existing NASA discipline data processing centers.

3. CERES Science Users • CERES CARS • Generate Climate Quality Data Products to Characterize Global Climate change NESDIS NSIPS Intermediate Products Ocean PEATE SD3E Atmosphere PEATE (U of Wisconsin) NOAA ADS (CLASS) NICSE • 32 Day Data Buffer for RDR, SDR, EDR, • and 5 days of Retained Intermediate Products SDR, EDR, IP, TDR, LUTs, Algorithms • Assess and Validate VIIRS • Radiometric and Geometric • Calibration Pre- and Post-Launch • Provide Calibration update • Recommendations • Coordinate PEATEs Cal • Related Analysis and Anomaly • Characterization RDR, SDR EDR, IP Quality Control, Cal. LUT and S/W updates • Support EDR Assessment • Support NICSE CV • Assessment Pre-/Post-Launch • Provide Data Analysis • Tools to ST • Develop and Demonstrate • Algorithms enhancements CERES RDRs Land PEATE NESDIS IDPS RDR RDR, SDR EDR, IP RDR, SDR, EDR, IP CERES RDRs, VIIRS Subset SDRs NPP Science Team Pre Launch Data & Algorithms CasaNOSA • A Mini- Version of the IDPS • Demonstration of Algorithm • Enhancement • Generation of Intermediate • Product, if necessary • IDPS Production Algorithms / • Software I&TSE Algorithm Enhancements IP Gen. Request Status reports, Management direction • Support EDR Assessment • Provide Data Analysis tools to ST • Develop and Demonstrate • Algorithms enhancements • Assess and Validate CrIS & • ATMS Calibration Pre- and • Post-Launch Sounder PEATE (JPL) TDR, RDR, SDR, EDR, IP Ozone PEATE EDR Assessment Algorithm Enhancements • Support EDR Assessment • Provide Data Analysis tools to ST • Develop and Demonstrate • Algorithms enhancements • Assess and Validate OMPS • Radiometric and Geometric • Calibration Pre- and Post-Launch NESDIS C3S (WRS) Calibration Tasking Status reports, Management direction • Perform OMPS Limb Cal/Val • Support OMPS Limb Ops. • Generate OMPS Limb SDR EDRs • Transition OMPS Limb Algorithm to NOAA for Operations Ozone Community OMPS Limb SDR EDR • Overall management direction • and science guidance to • the PEATEs • Coordinates EDR Assessment, • Algorithm, and Calibration • recommendations for • submission PSOE NPOESS Algorithm CCB Status reports, Management direction Algorithm Enhancements IP Gen. Request EDR Assessment, Algorithm Enhancements STA Report SDS Architecture

4. SDS Level 1 Requirements • 2.1.2.1 The SDS shall be designed with the assumption that the operational IPO IDPS generated NPP EDRs do not require reprocessing or re-computation in order to support climate research needs. Consequently, the SDS will not be designed to routinely generate climate data products which require long-term archival in the ADS. • 2.1.2.3 In developing the SDS, the Project shall assume that EDRs produced by the IDPS are climate quality and put in place the capability to test that hypothesis in order to contribute to improving the quality of future EDRs. The SDS shall provide suggested algorithm improvements to the IDPS. The SDS is NOT tasked to produce data products for distribution.

5. Primary Tasks of the Ocean PEATE • Acquire VIIRS data products from the SD3E and ADS/CLASS: • Raw Data Records (RDRs) – Level-0 equivalent • Sensor Data Records (SDRs) – Level-1B equivalent • Environmental Data Records (EDRs) – Level-2 equivalent • There are no Level-3 equivalent products. • Assess the quality of the NPP Ocean EDRs for accomplishing NASA’s climate research requirements. • Provide suggested algorithm improvements to the IDPS via the Project Science Working Group (PSWG). • Process selected data subsets in support of Evaluation and Validation activities.

6. VIIRS Ocean Products for Evaluation • All VIIRS Ocean products to be evaluated will be acquired from the IDPS, ADS/CLASS, or the mini-IDPS. • Testing and evaluation of algorithm changes will require regenerating product time series in the mini-IDPS, to be downloaded to the Ocean PEATE. • The Ocean PEATE will design changes to the code in the mini-IDPS for the purpose of algorithm improvement or problem resolution, develop appropriate test cases and request runs to verify and evaluate the changes.

7. Distribution of Ocean Data Products • The Archive Data Segment/Comprehensive Large Array Stewardship System (ADS/CLASS) is the official portal for all NPP distributed data products. • The Ocean PEATE will support limited distribution of available products (i.e., those that have been acquired for evaluation) to VIIRS Ocean Science Team members.

8. IDPS VIIRS Ocean EDR Data Flow Processing Module VIIRS Product VIIRS RDR Dynamic Ancillary Data Previous VIIRS Gridded Products Static Ancillary Data Previous VIIRS Gridded Products NAAPS TOD MODIS Land/Water Mask NCEP Geopotential Height Ancillary Files Ancillary Files DEM NDT

9. IDPS VIIRS Ocean EDR Data Flow VIIRS Geolocation VIIRS SDR Processing Module VIIRS_SDR_01 RDR Decompression VIIRS_GEO_01 Geolocation VIIRS_SDR.MOD 750m SDR VIIRS_SDR.IM 375m SDR VIIRS SDR VIIRS Product VIIRS RDR Dynamic Ancillary Data Previous VIIRS Gridded Products Static Ancillary Data Previous VIIRS Gridded Products NAAPS TOD MODIS Land/Water Mask NCEP Geopotential Height Ancillary Files Ancillary Files DEM NDT

10. IDPS VIIRS Ocean EDR Data Flow VIIRS Geolocation VIIRS SDR Processing Module VIIRS_SDR_01 RDR Decompression VIIRS_GEO_01 Geolocation VIIRS_SDR.MOD 750m SDR VIIRS_SDR.IM 375m SDR VIIRS SDR VIIRS Product VIIRS RDR Dynamic Ancillary Data Previous VIIRS Gridded Products Static Ancillary Data Previous VIIRS Gridded Products VIIRS_GD_08 750m Granulation NAAPS TOD MODIS Land/Water Mask VIIRS_GD_25 NAAPS Granulation NCEP Geopotential Height VIIRS_GD_27 L/W Mask Granulation Ancillary Files Ancillary Files VIIRS_GD_11 Ancillary Profile VIIRS_GD_09 GFS Granulation ALL_GD_01 Time Interpolation VIIRS_GD_28 Surface Pressure Adjustment DEM VIIRS_GD_12 Bathymetry Granulation NDT VIIRS_GD_13 Temperature Granulation

11. IDPS VIIRS Ocean EDR Data Flow VIIRS Geolocation VIIRS SDR Processing Module VIIRS_SDR_01 RDR Decompression VIIRS_GEO_01 Geolocation VIIRS_SDR.MOD 750m SDR VIIRS_SDR.IM 375m SDR VIIRS SDR VIIRS Product VIIRS RDR Dynamic Ancillary Data Previous VIIRS Gridded Products Static Ancillary Data Previous VIIRS Gridded Products VIIRS_GD_08 750m Granulation NAAPS TOD MODIS Land/Water Mask VIIRS_GD_25 NAAPS Granulation VIIRS_LN_06 Active Fires VIIRS_CM_01 Cloud Mask NCEP Geopotential Height VIIRS_GD_27 L/W Mask Granulation Ancillary Files Ancillary Files VIIRS_GD_11 Ancillary Profile VIIRS_GD_09 GFS Granulation ALL_GD_01 Time Interpolation VIIRS_GD_28 Surface Pressure Adjustment DEM VIIRS_GD_12 Bathymetry Granulation NDT VIIRS_GD_13 Temperature Granulation

12. IDPS VIIRS Ocean EDR Data Flow VIIRS Geolocation VIIRS SDR Processing Module VIIRS_SDR_01 RDR Decompression VIIRS_GEO_01 Geolocation VIIRS_SDR.MOD 750m SDR VIIRS_SDR.IM 375m SDR VIIRS SDR VIIRS Product VIIRS_SN_02 Ice Quality VIIRS RDR Dynamic Ancillary Data Previous VIIRS Gridded Products Static Ancillary Data VIIRS_CL_01 Cloud Optical Properties Previous VIIRS Gridded Products VIIRS_GD_08 750m Granulation VIIRS_ST_02 Surface Temp NAAPS TOD VIIRS_SN_03 Ice Concentration MODIS Land/Water Mask VIIRS_GD_25 NAAPS Granulation VIIRS_LN_06 Active Fires VIIRS_CM_01 Cloud Mask NCEP Geopotential Height VIIRS_GD_27 L/W Mask Granulation Ancillary Files Ancillary Files VIIRS_ST_01 Sea Surface Temperature SST EDR VIIRS_GD_11 Ancillary Profile VIIRS_GD_09 GFS Granulation VIIRS_AR_01 Aerosol Type ALL_GD_01 Time Interpolation VIIRS_GD_28 Surface Pressure Adjustment VIIRS_OC_01 Ocean Color / Chlorophyll DEM VIIRS_GD_12 Bathymetry Granulation OCC EDR NDT VIIRS_GD_13 Temperature Granulation

13. VIIRS Ocean EDRs • The Ocean Color and Chlorophyll (OCC) EDR contains: • Chlorophyll-a concentration • nLw at 412, 443, 488, 555 and 672 nm • IOP-a at 412, 443, 488, 555 and 672 nm • IOP-s at 412, 443, 488, 555 and 672 nm • Quality flags • The Sea Surface Temperature (SST) EDR contains: • Skin SST • Bulk SST • Quality flags • The content and structure of the NPP data products are described in the Common Data Format Control Books.

14. Evaluation Vs. Product Level • Level-1 (SDR) Evaluations • Onboard calibration analyses • Vicarious calibration • Level-2 (EDR) Evaluations • Matchup analyses • Residual detector (striping) and scan (RVS) dependence • Level-3 Product Evaluations • Sensor cross-comparisons • Algorithm comparisons • Temporal anomaly evaluations

15. Level-3 Product Generation • Sensor and algorithm cross-comparisons and interannual comparisons require Level-3 products. The IDPS does not produce the equivalent of Level-3 Ocean products. • The Ocean PEATE has implemented software to process VIIRS EDRs to Level 3 binned products in current OBPG format. • Current OBPG binning code with new EDR input functions • This will automatically provide the additional capabilities to produce multi-temporal composites and standard mapped image (SMI) products.

16. Example: Sensor Zonal Cross-Comparisons

17. Ocean PEATE Design • The NPP Ocean PEATE will be implemented within the framework and facilities of the current NASA Ocean Data Processing System (ODPS) • This system has been successfully supporting operational, satellite-based remote-sensing missions since 1996, and its capabilities continue to evolve and expand to meet the demands and challenges of future missions.

18. Ocean PEATE Gap Analysis • Acquire, ingest and catalog NPP VIIRS data products: RDRs, SDRs and Ocean EDRs (Data Acquisition & Ingest and Data Cataloging). • Status: Testing of acquisition and ingest scripts has been completed based on sample products in SD3E. • Process Ocean EDRs (SST and OCC) to Level-3 to support data product and algorithm evaluations (Level-3 Scheduler, VDC and Level-3 binner). • Status: Level-3 processing software modification is completed; installation in ODPS is in progress. • Perform VIIRS EDR matchups with Ocean CARS in situ data (extract code). • Status: Need to incorporate VIIRS spatial metadata into matchup procedure; need to develop in situ test data sets.

19. Ocean PEATE Gap Analysis (cont). • Incorporate VIIRS SDR processing for vicarious calibration analysis. • Status: This has been performed as part of the VIIRS simulator development. • Produce VIIRS simulated data using VOST-developed software. • Status: Simulator development in progress. • Acquire SST in situ data from RSMAS and perform matchups with SST EDRs • Status: Need to incorporate VIIRS spatial metadata into matchup procedure; need to identify in situ test data sets. • Support distribution of data products for team members. • Status: In progress.

20. NPP Ground Segment Testing • The NPP Project System Integration and Test (SI&T) team is planning a Ground Segment Integration Test (GSIT). • This test will encompass all systems and facilities of the NPP Ground Segment, including the PEATES. • The current schedule is for this to be performed in March 2010. • The PEATEs are working with the SI&T team to generate test procedures, and are developing test-unique capabilities to create and deliver test artifacts regularly during the test. • Future Ground Segment test opportunities are still TBD.

21. Initial Capability (L-18 months) All interfaces fully implemented and tested (subject to external Project schedules) Verify initial versions of operational code running in I&TSE L-3 product code developed and tested Prelaunch VIIRS test data storage and SDS interface testing with existing ODPS storage capacity Initial test products acquired for review by VIIRS Ocean Science Team Schedule Full Mission Capability (L-12 months) • Routine exercise of interfaces to acquire proxy, surrogate and/or simulated data • Verify pre-launch version of operational code running in I&TSE • Distribution capability developed and tested • Test products routinely acquired based on simulated data and posted for access by VIIRS Ocean Science Team • Data storage for 1 year The current NPP launch readiness date is September 22, 2011.

22. Conclusion • Ocean PEATE requirements will be supported using the proven capabilities of the ODPS, which will support EDR evaluation strategies successfully employed on current missions. • Our approach provides progressive stages of evaluation for Level-1B (SDR), Level-2 (EDR) and Level-3 products. • Evaluation methodologies and tools are already established for data sets cataloged within the ODPS. • Additional development effort (Level-3 products) leverages existing software. • The charter of the PEATE is to support NASA’s evaluation of the NPP data products. • However, if NASA assigns additional responsibilities and provides resources, the OBPG is prepared to support VIIRS at the same level as MODIS and SeaWiFS.