slide1
Download
Skip this Video
Download Presentation
AMSR-E SIPS Processing Status

Loading in 2 Seconds...

play fullscreen
1 / 15

AMSR-E SIPS Processing Status - PowerPoint PPT Presentation


  • 81 Views
  • Uploaded on

AMSR-E SIPS Processing Status. Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville JAXA / AMSR-E Working Group Meeting June 2-3, 2010 Huntsville, AL

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' AMSR-E SIPS Processing Status' - mckile


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide1

AMSR-E SIPS Processing Status

Presented by Kathryn Regner

Information Technology and Systems Center

at the University of Alabama in Huntsville

JAXA / AMSR-E Working Group Meeting

June 2-3, 2010

Huntsville, AL

[email protected]://ghrc.msfc.nasa.gov 256.961.7791

outline
Outline
  • Introduction
  • Hardware Update
  • Software Status
  • Accomplishments
  • Future Activities
amsr e sips personnel
AMSR-E SIPS Personnel
  • NASA MSFC: H. Michael Goodman, PI
  • UAHuntsville ITSC (Staff shared with GHRC DAAC):

Management: Dr. Sara Graves, Director, ITSC

Development: Helen Conover, Lead

Bruce Beaumont

Lamar Hawkins

Mary Nair

Matt Smith

Engineering: Kathryn Regner

Sandra Harper

Data Management: Steve Jones

Sherry Harrison

Systems Administration: Will Ellett, Lead

Michele Garrett

amsr e data flow

NASAEDOS

JAXA-EOC

L1A Product Generation

Ground

Stations

NSIDC DAAC

Data Archive and Distribution

AMSR-E Data Flow

Level-0

GBAD (Pre Ephem) & PDS

NASA Flt Dynamics

GBAD

(Def Ephem)

Level-1

Level-1

PO.DAAC

Level-1

SIPS-RSS

TLSCF

Level-2 and Level-3

L2A algorithm

L2A Product Generation

Science

Software

I&T

L2 and L3

algorithms

Product Delivery

Record Server (PDRS)

SIPS-GHCC

L2B and L3 Algorithms

Algorithm

Teams

L2B and L3 Product Generation

(science, metadata, qa, ph, subsets, browse)

Rain

Snow

Data

Ocean

Sea Ice

Land

slide5

Private Network (1 GB/sec)

2 GB/sec Fibre Channel Switch

SIPS-GHCC HardwareOperational Configuration

Sun Storage 7310

With J4400 Disk Array

8TB NAS

Dell PowerEdge 2850

2 x 3.4 GHz Processors

4 GB RAM, RHEL 5

AMSR 1-4

8 TB Dell EMC CX300

Storage Area

Network Array

Forward Processing

Restricted FTP Server

Storage Buildout

Completed July 2009

Reprocessing

Near line storage of all Level-2A and most recent

Level-2B & Level-3

Reprocessing

Dev, Integration & Test

Multiple processing environments across four machines results in much greater flexibility for processing and reprocessing.

slide6

Private Network (1 GB/sec)

Planned SIPS-GHCC HardwareConfiguration – Summer 2010

Sun Fire x4270 x64

2 x 2.93 GHz Sun Intel Xeon Processors

4 x 2GB DIMM , RHEL 5

AMSR 1-3

Sun Storage 7310

With J4400 Disk Array

10TB NAS

Forward Processing

Restricted FTP Server

Reprocessing

Near line storage of all Level-2A and most recent

Level-2B and Level-3

Dev, Integration & Test

Multiple processing environments across four machines results in much greater flexibility for processing and reprocessing.

slide7

Software Architecture(Routine Processing )

Near Real Time

Ingest from RSS

Level-2A Brightness Temperatures

Level-2A Brightness Temperatures

(with Metadata and QA files)

Product

Generation

Scheduling

-------------

~ 29 times

per day

L2B Ocean

(1/2-orbit)

L2B Rain

(1/2-orbit)

L2B Land

(1/2-orbit)

L3 Sea Ice

Drift

L3 Sea Ice

(Daily, 3 Res)

L3 Snow

(Daily)

L3 Land

(Daily)

Once

per day

L3 Ocean

(Daily)

L3 Snow

(Pentad)

Once every

five days

L3 Ocean

(Weekly)

Once per

week

L3 Ocean

(Monthly)

L3 Snow

(Monthly)

L3 Rain

(Monthly)

Once per

month

algorithm version numbers summary
Algorithm Version Numbers Summary

Algorithm

Short Name

Current Versions

(as of May 31, 2010)

L2A Tb

L2B Land

L2B Ocean

L2B Rain

L3 Land

L3 Ocean

L3 Rain

L3 Sea Ice

L3 Snow

V10

V09

V06

V10

V06

V04

V06

V12

V09

accomplishments
Accomplishments

Systems:

  • Integration of Network Attached Storage (NAS) device (July 2009):
    • supports SIPS’ role as official offsite archive for the AMSR-E L2A brightness temperature data set.
    • facilitates reprocessing of higher level products
  • Worked with the vendor to upgrade firmware on the Sun Storage 7310 Storage Area Network (NAS) device. Operations team reported significant increases in speed when transferring files. (January 2010)
  • Selected hardware vendor for the FY10 technology refresh procurement (May 2010).
accomplishments 2
Accomplishments (2)

Processing:

  • Procedures Update (November 2009): per NSIDC request and in response to increased user community interest in preliminary (near real time) products, SIPS implemented a new production rule to regenerate the preliminary daily files whenever regenerated or delayed ½-orbit files are received. 
  • Integrated Version 12 Sea Ice Algorithm into SIPS processing system and began reprocessing (March 2010).
    • defines the sea ice season to begin on October 1st of each year and improves upon management of the sea ice mask ancillary files.
accomplishments 3
Accomplishments (3)

Processing (continued):

  • Integrated Version 4 of the Level-3 Ocean DAP into the SIPS processing system (April 2010) and began reprocessing.
    • utilizes the RFI filter for DirecTV that was implemented in the L2A algorithm last year.
    • reprocessing the L3 Ocean requires reprocessing the L2 Ocean as well, in order to make use of the new features 
accomplishments 4
Accomplishments (4)

Reprocessing:

  • Second Mission Dataset Reprocessing Complete (July 2009):
    • using Version 10 of the Level-2A products, which was enhanced to include RFI quality flags
    • each of the 13 higher level products are now at the same version number from the beginning of the mission until the present date.
  • Completed reprocessing Version 12 Sea Ice mission dataset (May 2010).
accomplishments 5
Accomplishments (5)

LANCE:

  • Attended the AMSR-E Mission Operations Working Group meeting, hosted by Angie Kelly, at GSFC. Learned about the Land Atmosphere Near Real Time Capability for EOS (LANCE). (October 2009)
  • Attended the LANCE Workshop held in College Park on December 8-9. Began preliminary analysis with ESDIS and the AMSR-E near-real time data providers (MODIS) to determine the optimal way to split up the near real time processing load and integrate algorithms into the LANCE system.
  • In February 2010, UAHuntsville submitted a proposal and budget to ESDIS requesting funds to implement the Land Atmosphere Near-real-time Capability for EOS processing at the AMSR-E SIPS. 
  • Contracted awarded in March; official start date April 1st.
near term activities
Near TermActivities
  • Integration of new (FY10) hardware into SIPS processing systems; software migration.
  • Integration of new and updated algorithms
    • Sea Ice Drift product and Level-3 Rain
    • Reprocessing those datasets
  • Evaluate reprocessing Level-2A based upon new Level-1A.
summary
Summary
  • Processing and reprocessing activities are running smoothly.
    • Integrating new algorithms as received from TLSCF
    • Preparing to install, integrate and test the third generation of hardware
ad