LOSSLESS COMPRESSION STUDIES OF GRATING SPECTROMETER DATA

1. LOSSLESS COMPRESSION STUDIES OF GRATING SPECTROMETER DATA FOR NOAA GOES-R HYPERSPECTRAL ENVIRONMENTAL SUITE Bormin Huang1, Alok Ahuja1, Yagneswaran Sriraja1, Hung-Lung Huang1, Mitchell D. Goldberg2, Timothy J. Schmit2, and Roger W. Heymann2 1Cooperative Institute for Meteorological Satellite Studies, University of Wisconsin-Madison, 2NOAA, National Environmental Satellite, Data, and Information Service 1. INTRODUCTION 5. TOWARDS ERROR RESILIENCE IN SATELLITE NOISY TRANSMISSION 6. TOWARDS HARDWARE IMPLEMENTATION FOR REAL-TIME SATELLITE REBROADCAST • Error contamination after JPEG2000 decoding • To support GOES-R data compression studies for the possible grating-type HES sounder, we investigate various 2D and 3D lossless compression methods using the grating-type Atmospheric Infrared Sounder (AIRS) data. • These data compression techniques are applicable for GOES-R rebroadcast • We show that an average lossless compression ratio of 3.89 is achievable for NASA EOS AIRS ultraspectral sounder data A memory-limited DSP version of 3DWT-RVLC is implemented to explore feasibility of 3DWT-RVLC for real-time satellite rebroadcast processing 2. ULTRASPECTRAL DATA FOR LOSSLESS COMPRESSION STUDIES Location of erroneous pixels after 2D JPEG2000 source decoding for 1-bit nonheader error after channel decoding Location of erroneous pixels after 2D JPEG2000 source decoding for 1-bit header error after channel decoding 10 selected AIRS digital counts granules on March 2, 2004 • Error-Correcting Channel Coding Studies • Digital Video Broadcasting Second Generation Low Density Parity Check (DVB-S2 LDPC) code from Comtech AHA • It consists of BCH outer code + LDPC inner code • We investigated code rates of 9/10 and 8/9 for JPEG2000 compressed ultraspectral sounder data Texas Instruments’ TMS320C6416 DSP board TMS320C6416 two-level cache-based architecture • Each granule consists of 135 scan lines containing 90 • cross-track footprints per scan line. • Publicly available via anonymous ftp • (ftp://ftp.ssec.wisc.edu/pub/bormin/Count) AIRS digital counts at wavenumber 800.01cm-1 for the 10 selected granules (with the 1502-channel subset) Bit error rate vs. signal-to-noise ratio after LDPC channel decoding of a JPEG2000 compressed granule LM1000 PCI board carrier card Block data transfer to the DSP memory • Error-Resilient Source Coding Study: 3D Wavelet Reversible Variable-length Coding (3DWT-RVLC, Huang et al. 2005) has significantly better error resilience than 3D JPEG2000 (Part 2) Each granule is divided into 8 blocks to feed into the external memory on the DSP board 3. CIMSS-DEVELOPED DATA PREPROCESSING SCHEME CIMSS’s Bias-Adjusted Reordering (BAR) data preprocessing scheme(Huang et al. 2004) improves the performance of state-of-the-art compression methods (2D CALIC, 2D JPEG-LS, 2D JPEG2000 (Part 1), 3D JPEG2000 (Part 2)) Compression ratios of 3DWT-RVLC vs. the DSP version of 3DWT-RVLC Future work will include more DSP implementations of other compression methods 7. SUMMARY 3D Wavelet decomposition for ultraspectral sounder data • CIMSS’s BAR data preprocessing scheme significantly improves the compression ratios of such state-of-the-art compression methods as 2D JPEG2000 (Part 1), 3D JPEG2000 (Part 2), 2D CALIC, and 2D JPEG-LS • After applying the BAR preprocessing scheme, the standard state-of-the-art compression methods perform almost equally well !! • New compression methods (Lossless PCA, PPVQ, FPVQ) show better results on ultraspectral sounder data than standard compression methods, achieving anaverage lossless compression ratio of 3.89 • Newly developed 3DWT-RVLC method provides significantly better error resilience than 3D JPEG2000 (Part 2) 4. CIMSS-DEVELOPED NEW LOSSLESS COMPRESSION METHODS • Lossless PCA (Huang et al. 2004) • Predictive Partitioned Vector Quantization (PPVQ) (Huang et al. 2004) • Fast Precomputed Vector Quantization (FPVQ) with optimal bit allocation(Huang et al. 2005) Average number of erroneous pixels after 3D JPEG2000 (Part 2) and 3DWT-RVLC decoding due to 1 bit random error added in different wavelet resolutions for 4 granules Spatial scenes for 1 bit-error corruption in lowest wavelet resolution for 3D JPEG2000 (Part 2) and 3DWT-RVLC compressed granule 182 Acknowledgement: This work is prepared in support of National Oceanic & Atmospheric Administration (NOAA) GOES-R data compression research under grant NA07EC0676.