AMSR-E Near Real Time Processing

1. AMSR-E Near Real Time Processing Helen Conover and Kathryn Regner Information Technology and Systems Center University of Alabama in Huntsville Presented at the AMSR-E Joint Science Team Meeting June 29, 2011

2. Outline • Overview: What is LANCE? • Data Flow • Hardware Configurations • Software Architecture • Users, Statistics, Outreach • Prototyping Efforts • Rapid Response Products • Direct Broadcast Investigation • Data Casting • Points of Contact

3. What is LANCE? • Land Atmosphere Near real-time Capability for EOS • provides access to near-real time (NRT) data products in less than 3 hours of the observation time. • supports a wide variety of applications users who are interested in monitoring natural and man-made hazards • LANCE products are freely available, but registration is required.

4. LANCE Central Term used to describe all of the instruments and distributed processing systems by the “LANCE Elements” GSFC Earth Sciences Data and Information Services Center MODIS (Moderate Resolution Imaging Spectroradiometer Adaptive Processing System Ozone Monitoring Instrument Science Investigator-led Processing System

5. LANCE AMSR-E • System Highlights • Fully redundant strings of equipment in different locations on the UAHuntsville campus greatly reduce the likelihood of data unavailability due to system outage. • SIPS is using the same science algorithms running at the distributed processing sites, but with a direct input stream from NASA EDOS, minutes after downlink from the ground stations. • In addition to processing and distribution, the SIPS provides full data center support, including user services and documentation.

6. Move from GSFC to SIPS In March 2010, the AMSR-E SIPS was tasked to transition the AMSR-E processing from the MODAPS systems at GSFC to the SIPS in Huntsville. Work started in April. • First string of hardware began operations on September 27th • Redundant second string of equipment began operations on November 1st. • Both strings include • authentication via ESDIS User Registration System, • logging statistics into the ESDIS Metrics System, • local and LANCE-central web pages, • publicly accessible FTP servers and • data access via web interfaces and subscription service

7. SIPS Enhancements • Integration of Remote Sensing System’s (RSS) new Level-2A algorithm, designed and implemented specifically for near real-time processing • Our latest comparison study shows that AMSR-E brightness temperatures generated by the Land Atmosphere Near-real-time Capability for EOS (LANCE) system are quantitatively very close to brightness temperatures generated by the AMSR-E standard products generation system.  The one week sample size evaluated  shows that 99.7% of the values differed by 0.6K or less.  The Level-2B rain products, as predicted, are almost identical (99.9% of the values differed by 0.2K or less).  More information about the comparison can be found in the following document:  lance.nsstc.nasa.gov/LANCE_AMSRE_Product_Evaluation_V5.docx

8. SIPS Enhancements (2) • In addition to Level-1 and Level-2 products generated previously at MODAPS, SIPS began generating Level-3 daily land, ocean, sea ice and snow • System Upgrades • Fully automated subscription service with failover • Generation of “incremental” or partial Level-3 daily files several times per day • Evaluating browse requirements specifically for near real time products

9. AMSR-E Data Flows

10. LANCE AMSR-E at NSSTC

11. LANCE AMSR-E at TH

12. Software Architecture Near Real Time Ingest from EDOS Product Generation Scheduling ------------- On Demand ~ 29 times per day On Demand ~ 29 times per day Level-0 GBAD Ephemeris and Science Rate Buffered Data Level-1A Raw Observation Counts Level-1B Global Brightness Temperatures On Demand ~ 29 times per day On Demand ~ 29 times per day Multiple times per day Level-2A Global Swath Spatially-Resampled Brightness Temperatures L2B Ocean (1/2-orbit) L2B Rain (1/2-orbit) L2B Land (1/2-orbit) L3 Ocean (Daily) L3 Sea Ice (Daily, 3 Res) L3 Snow (Daily) L3 Land (Daily)

13. LANCE Users

14. AMSR-E User Characterization

15. Product Distribution Summary Most recent three weeks. Information extracted from User Registration System (URS) Reports

16. Presentation • “Introducing NASA’s Near-real-time Processing Capability for Aqua AMSR-E, A Component of LANCE” poster presentation: • Earth Science Data Systems Working Group meeting in New Orleans, October 2010 • A-Train Symposium in New Orleans, October 2010 • 2010 Fall American Geophysical Union meeting in San Francisco, December 2010

17. Prototyping Efforts • Generation of select AMSR-E products for ingest into the LANCE (was MODIS) Rapid Response System http://lance.nasa.gov/imagery/rapid-response/ • AMSR-E Products and Use Cases • Rain Rate (severe storms and flood applications) • Snow Depth (land transportation applications) • Sea Ice Concentration (shipping and fishing applications) • Soil Moisture (drought and flooding applications)

18. 6/24/2011 Rapid Response Image

19. Prototyping Efforts (2) • Direct Broadcast • Investigating the use of existing AMSR-E Level-1 code, without modification, to generate Level-2A products from Level-0 data received directly from satellite. • Data Casting • Investigating the use of GeoRSS data casting to enhance data discovery. http://datacasting.jpl.nasa.gov/

20. Points of Contact Staff shared with GHRC DAAC and AMSR-E SIPS Management: Dr. Sara Graves, Director, ITSC Team Leader: Helen Conover Software Engineering: Bruce Beaumont Metrics and Statistics: Mary Nair Systems Engineering: Kathryn Regner Hardware and Network Engineering: Sandra Harper User Services and Web Updates: Sherry Harrison Data Management: Lamar Hawkins Systems Administration: Will Ellett, Lead Michele Garrett, NSSTC Michael McEniry, TH

21. Backup Slides • Products

22. LANCE AMSR-E Products

23. LANCE AMSR-E Products (Continued)