USGS/EDC
This presentation is the property of its rightful owner.
Sponsored Links
1 / 13

USGS/EDC Archive Preservation Status An Update Stuart Doescher, USGS (Cheryl Greenhagen) PowerPoint PPT Presentation


  • 48 Views
  • Uploaded on
  • Presentation posted in: General

USGS/EDC Archive Preservation Status An Update Stuart Doescher, USGS (Cheryl Greenhagen) W GISS-18 September 2004 Beijing, China. TM and MSS Archive Conversion System (TMACS). Operations: 1992 to 2002. Number of High Density Tapes (HDT) transcribed: 32,300 Landsat MSS, TM

Download Presentation

USGS/EDC Archive Preservation Status An Update Stuart Doescher, USGS (Cheryl Greenhagen)

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Usgs edc archive preservation status an update stuart doescher usgs cheryl greenhagen

USGS/EDC

Archive Preservation

Status

An Update

Stuart Doescher, USGS

(Cheryl Greenhagen)

WGISS-18

September 2004

Beijing, China


Tm and mss archive conversion system tmacs

TM and MSS Archive Conversion System (TMACS)

  • Operations: 1992 to 2002.

  • Number of High Density Tapes (HDT) transcribed: 32,300

    • Landsat MSS, TM

  • Number of DCRSi Cassette Tapes (DCT)s output: 3,200

  • Mostly in Telemetry stream format

    (Frame sync required to read)


Wbvt summary

WBVT summary

  • Operated: April 1999 - May 2002

  • Number of HDTs converted: 21,300

  • Number of Digital Linear Tape (DLT 7000) generated: 143 and an additional 143 as backup

  • Format: BSQ ( MSS-X)

  • "orphan" data (no DIAT / SLAT) : 172 HDTs

  • Bad input tapes: 476 (even with cleaning & baking).


Spot summary

SPOT summary

  • Operated: late April 2000 - February 2002

  • Number of HDTs converted: 6,100

  • Number of DLT 7000 tapes generated: 901

  • Format: MDA's FRED


Landsat archive conversion system lacs

Landsat Archive Conversion System (LACS)

  • Planned Operations: June 2004 – June 2006

  • Input: About 6000 HDTs, 3500 DCTs,

    plus current Landsat 5 data

  • Output: ~ 600 tapes of "formatted" data

    and ~ 700 tapes of "raw" data

    on 9940B. (200G/tape)

  • Format: BSQ


Landsat archive conversion system lacs1

Landsat Archive Conversion System (LACS)

  • Ingest from DCRSi Cassette Tapes (DCTs)

    • Multispectral Scanner Archive format (MSS-A) data

    • Multispectral Scanner Product format (MSS-P) data

    • Thematic Mapper Archive format (TM-A) data

    • Thematic Mapper raw (TM-R) data

  • Ingest TM-R data from High Density Tapes (HDTs)

  • Archive the data to a high-density computer-compatible digital tape: 9940B

  • Generate and archive browse imagery

  • Generate inventory information for the new archive.


Data to be converted

Data to be converted


Lacs context diagram

Digital

Archive

LTS

LDBS-I

LACS Transcription

System

LACS Database

System – Part I

Landsat

Production

Database

LDBS-II

LACS Database

System – Part II

Metadata Handler

LDB

LACS

Database

LTTAS

LACS Tape Tracking and Assessment

System

TLS

Tape Labeling

Software

LBGS

LDBS-III

LACS Browse

Generation System

LACS Database

System – Part III

Earth

Explorer

DORRAN

NLAPS

LACS Context Diagram

Scene Tables

HDTs, DCTs

Job Histories,

Metadata

LDS

LACS

Duplicator System

Interval Tables, Scene Tables, 9940B Tables

Updated Tables

Label

Information

Historic Scene Info

Master 9940B

Updated

Metadata

Metadata

Label

Information

Working

Copy

9940B

All LDB Info

Browse Metadata

Working Copy 9940B

Transcription Operators Assessment Operators Production Control

Updated Tables

Browse Tape

EE Browse Images

EE Browse

Images

Order Information

9940B Tapes


Landsat archive conversion system lacs2

Landsat Archive Conversion System (LACS)

  • Started Operations: June 2004

  • Progress to Date:

    • Current Landsat 5 Data: 252 Intervals (5807 scenes)

    • DCTs: 60 Tapes (508 Intervals, 9669 scenes)

    • HDTs: 5499 Tapes (534 Intervals, 10073 scenes)

  • This is 25,549 of 960,763 scenes in 2 ½ months

  • Extrapolates to 94 months or 7.8 years


Lacs status

LACS Status

  • Running 3 LTS strings: (LACS Transcription Subsystem)

    • LTS1: Current Landsat 5 data only

      (acquired at EDC, or received on DLT from Australia.)

    • LTS2: DCT Input.

      ( less than 1 shift a day - because LIS can't keep up)

    • LTS3: HDT Input. (1 to 2 shifts per day.)

      The HDTs are always cleaned before they are used.

      Many of the HDTs are baked.

      Some of the HDTs are tried many times before success.

      We try both drives;

      sometimes we have the tape cleaned again;

      sometimes we have the engineer adjust the HDTR.


Lacs status1

LACS Status

  • Running 1 LIS string: (LACS Integration Subsystem) on the same box as LTS1.

    • Performs the Automated Cloud Cover Assessment (ACCA) and Browse Generation for all 3 LTS strings.

    • The LIS is the bottleneck. (as expected)

    • LIS gives priority to current Landsat 5 data.

    • Plan to port the LIS to Linux and run on 3 Linux systems to relieve the bottleneck.

    • Hope to get the LIS port done late this calendar year

    • Hope approximately triple our throughput


Landsat archive conversion system lacs3

Landsat Archive Conversion System (LACS)

  • Issues / Problems:

    • Some tapes in very poor condition

    • Performance of ACCA and Browse Generation needs improvement

  • Plans:

    • Boost performance of ACCA, Browse Generation:

      • Port to Linux

      • Run on Multiple Linux Systems


  • Login