1 / 15

AMSR-E SIPS Processing Status

AMSR-E SIPS Processing Status. Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville JAXA / AMSR-E Working Group Meeting June 2-3, 2010 Huntsville, AL

tryna
Download Presentation

AMSR-E SIPS Processing Status

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville JAXA / AMSR-E Working Group Meeting June 2-3, 2010 Huntsville, AL kregner@itsc.uah.eduwww.itsc.uah.eduhttp://ghrc.msfc.nasa.gov 256.961.7791

  2. Outline • Introduction • Hardware Update • Software Status • Accomplishments • Future Activities

  3. AMSR-E SIPS Personnel • NASA MSFC: H. Michael Goodman, PI • UAHuntsville ITSC (Staff shared with GHRC DAAC): Management: Dr. Sara Graves, Director, ITSC Development: Helen Conover, Lead Bruce Beaumont Lamar Hawkins Mary Nair Matt Smith Engineering: Kathryn Regner Sandra Harper Data Management: Steve Jones Sherry Harrison Systems Administration: Will Ellett, Lead Michele Garrett

  4. NASAEDOS JAXA-EOC L1A Product Generation Ground Stations NSIDC DAAC Data Archive and Distribution AMSR-E Data Flow Level-0 GBAD (Pre Ephem) & PDS NASA Flt Dynamics GBAD (Def Ephem) Level-1 Level-1 PO.DAAC Level-1 SIPS-RSS TLSCF Level-2 and Level-3 L2A algorithm L2A Product Generation Science Software I&T L2 and L3 algorithms Product Delivery Record Server (PDRS) SIPS-GHCC L2B and L3 Algorithms Algorithm Teams L2B and L3 Product Generation (science, metadata, qa, ph, subsets, browse) Rain Snow Data Ocean Sea Ice Land

  5. Private Network (1 GB/sec) 2 GB/sec Fibre Channel Switch SIPS-GHCC HardwareOperational Configuration Sun Storage 7310 With J4400 Disk Array 8TB NAS Dell PowerEdge 2850 2 x 3.4 GHz Processors 4 GB RAM, RHEL 5 AMSR 1-4 8 TB Dell EMC CX300 Storage Area Network Array Forward Processing Restricted FTP Server Storage Buildout Completed July 2009 Reprocessing Near line storage of all Level-2A and most recent Level-2B & Level-3 Reprocessing Dev, Integration & Test Multiple processing environments across four machines results in much greater flexibility for processing and reprocessing.

  6. Private Network (1 GB/sec) Planned SIPS-GHCC HardwareConfiguration – Summer 2010 Sun Fire x4270 x64 2 x 2.93 GHz Sun Intel Xeon Processors 4 x 2GB DIMM , RHEL 5 AMSR 1-3 Sun Storage 7310 With J4400 Disk Array 10TB NAS Forward Processing Restricted FTP Server Reprocessing Near line storage of all Level-2A and most recent Level-2B and Level-3 Dev, Integration & Test Multiple processing environments across four machines results in much greater flexibility for processing and reprocessing.

  7. Software Architecture(Routine Processing ) Near Real Time Ingest from RSS Level-2A Brightness Temperatures Level-2A Brightness Temperatures (with Metadata and QA files) Product Generation Scheduling ------------- ~ 29 times per day L2B Ocean (1/2-orbit) L2B Rain (1/2-orbit) L2B Land (1/2-orbit) L3 Sea Ice Drift L3 Sea Ice (Daily, 3 Res) L3 Snow (Daily) L3 Land (Daily) Once per day L3 Ocean (Daily) L3 Snow (Pentad) Once every five days L3 Ocean (Weekly) Once per week L3 Ocean (Monthly) L3 Snow (Monthly) L3 Rain (Monthly) Once per month

  8. Algorithm Version Numbers Summary Algorithm Short Name Current Versions (as of May 31, 2010) L2A Tb L2B Land L2B Ocean L2B Rain L3 Land L3 Ocean L3 Rain L3 Sea Ice L3 Snow V10 V09 V06 V10 V06 V04 V06 V12 V09

  9. Accomplishments Systems: • Integration of Network Attached Storage (NAS) device (July 2009): • supports SIPS’ role as official offsite archive for the AMSR-E L2A brightness temperature data set. • facilitates reprocessing of higher level products • Worked with the vendor to upgrade firmware on the Sun Storage 7310 Storage Area Network (NAS) device. Operations team reported significant increases in speed when transferring files. (January 2010) • Selected hardware vendor for the FY10 technology refresh procurement (May 2010).

  10. Accomplishments (2) Processing: • Procedures Update (November 2009): per NSIDC request and in response to increased user community interest in preliminary (near real time) products, SIPS implemented a new production rule to regenerate the preliminary daily files whenever regenerated or delayed ½-orbit files are received.  • Integrated Version 12 Sea Ice Algorithm into SIPS processing system and began reprocessing (March 2010). • defines the sea ice season to begin on October 1st of each year and improves upon management of the sea ice mask ancillary files.

  11. Accomplishments (3) Processing (continued): • Integrated Version 4 of the Level-3 Ocean DAP into the SIPS processing system (April 2010) and began reprocessing. • utilizes the RFI filter for DirecTV that was implemented in the L2A algorithm last year. • reprocessing the L3 Ocean requires reprocessing the L2 Ocean as well, in order to make use of the new features 

  12. Accomplishments (4) Reprocessing: • Second Mission Dataset Reprocessing Complete (July 2009): • using Version 10 of the Level-2A products, which was enhanced to include RFI quality flags • each of the 13 higher level products are now at the same version number from the beginning of the mission until the present date. • Completed reprocessing Version 12 Sea Ice mission dataset (May 2010).

  13. Accomplishments (5) LANCE: • Attended the AMSR-E Mission Operations Working Group meeting, hosted by Angie Kelly, at GSFC. Learned about the Land Atmosphere Near Real Time Capability for EOS (LANCE). (October 2009) • Attended the LANCE Workshop held in College Park on December 8-9. Began preliminary analysis with ESDIS and the AMSR-E near-real time data providers (MODIS) to determine the optimal way to split up the near real time processing load and integrate algorithms into the LANCE system. • In February 2010, UAHuntsville submitted a proposal and budget to ESDIS requesting funds to implement the Land Atmosphere Near-real-time Capability for EOS processing at the AMSR-E SIPS.  • Contracted awarded in March; official start date April 1st.

  14. Near TermActivities • Integration of new (FY10) hardware into SIPS processing systems; software migration. • Integration of new and updated algorithms • Sea Ice Drift product and Level-3 Rain • Reprocessing those datasets • Evaluate reprocessing Level-2A based upon new Level-1A.

  15. Summary • Processing and reprocessing activities are running smoothly. • Integrating new algorithms as received from TLSCF • Preparing to install, integrate and test the third generation of hardware

More Related