slide1
Download
Skip this Video
Download Presentation
C. Huc/CNES, D. Boucon/CNES-SILOGIC, D.M. Sawyer/NASA/GSFC, J.G. Garrett/NASA-Raytheon

Loading in 2 Seconds...

play fullscreen
1 / 33

Contents - PowerPoint PPT Presentation


  • 143 Views
  • Uploaded on

Producer-Archive Interface Methodology Abstract Standard PAIMAS. C. Huc/CNES, D. Boucon/CNES-SILOGIC, D.M. Sawyer/NASA/GSFC, J.G. Garrett/NASA-Raytheon. Contents. Why a new standard? Space data archiving Needs for standardization What standardization will bring Abstract standard status

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Contents' - Albert_Lan


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide1

Producer-Archive Interface MethodologyAbstract Standard

PAIMAS

C. Huc/CNES, D. Boucon/CNES-SILOGIC,D.M. Sawyer/NASA/GSFC, J.G. Garrett/NASA-Raytheon

contents
Contents
  • Why a new standard?
    • Space data archiving
    • Needs for standardization
    • What standardization will bring
    • Abstract standard status
  • Proposed methodology
    • Context - description
    • The 4 phases
  • Specialization
  • Aid Tool for the use of the Methodology
  • Towards an implementation standard
  • Conclusions

Producer-Archive Methodology

why a new standard space data archiving archive types

Mission control system

Telemetry

Operation control

Payload control

Mission

exploitation

Mission

archives

Scientific multi-mission

data centers: long-term archives

Why a new standard?Space data archiving: archive types

Producer-Archive Methodology

slide4

aProducer-Archive Project is a set of activities and the means used by the Information Producer as well as the Archive to ingest a given set of information into the Archive.

Why a new standard?Space data archiving: key roles and players

  • Data Producers:
      • the operating systems of each mission
      • the mission processing and archiving centres
      • the scientific teams in the laboratories
  • Archive
      • specialized independent organizations (CDS)
      • specialized services within the agencies (NSSDC)
      • services common to several organizations (CDPP)

Producer-Archive Methodology

slide5

Why a new standard?Needs for standardization: problems

  • The relations between archives and data Producers are rarely simple and easy:
    • nonconformity of received data
    • unclear and imprecise definition of the data to be delivered,
    • failure to meet delivery schedule,
    • late detection of errors in archived data,
    • non-management of modifications

==> Can be detrimental to archived information quality and the cost of the operation.

  • Ever increasing diversity of the producers
  • Data complexity
  • Each project develops its own methodology on the basis of a process that is roughly the same from one project to another

==> Work duplicated, no generality, excessively high costs, etc.

Producer-Archive Methodology

slide6

Why a new standard?Needs for standardization: multiple standards

PAIMAS

Generic abstract

standard

Approved by the CCSDS

PAIMAS

Implementation

standard

Community

abstract standard

Development in progress

Producer-Archive Methodology

slide7

Why a new standard?What standardization will bring

  • Ease some typical problems (as noted earlier)
  • Make it easier to follow schedules and commitments
  • Help with human resources turnover
  • Anticipate new problems
  • Address the legal aspects early
  • Increase data quality of archive holdings
  • Have weight and credibility for adoption
  • And finally, save time (and money)

Producer-Archive Methodology

slide8

Why a new standard?Abstract standard status

  • Today: CCSDS standard (blue book) and standardization with ISO in progress
  • Various communities have helped produce this document :
    • space agencies (CNES, NASA, ESA, …)
    • archivists (NARA, …) and
    • librarians (BNF -French National Library, RLG-Research Library Group).

Producer-Archive Methodology

contents9
Contents
  • Why a new standard?
    • Space data archiving
    • Needs for standardization
    • What standardization will bring
    • Abstract standard status
  • Proposed methodology
    • Context - description
    • The 4 phases
  • Specialization
  • Aid Tool for the use of the Methodology
  • Towards an implementation standard
  • Conclusion

Producer-Archive Methodology

slide10

MethodologyContext: OAIS environment

Producer-Archive Methodology

slide11

MethodologyContext: PAIMAS focus

AIP : Archival Information Package, SIP : Submission Information Package, DIP : Dissemination Information package

Producer-Archive Methodology

slide12

MethodologyContext: PAIMAS focus

Ingest

AIP : Archival Information Package, SIP : Submission Information Package, DIP : Dissemination Information package

Producer-Archive Methodology

slide13

MethodologyDescription

  • The archive project is broken down into 4 main phases:
    • Preliminary Phase,
    • Formal Definition Phase,
    • Transfer Phase,
    • Validation Phase.
  • Each phase has extensive action tables.
  • Specification for a community.

Producer-Archive Methodology

slide14

Validation

Phase

Transfer

Phase

MethodologyThe phases: relationships

  • Negotiate the Submission

Develop agreement (data to

be delivered, complementary

elements, schedule)

  • Identification and preliminary

agreement

Define the information

to be archived

  • resources estimation
  • Actual transfer of the data

Actual transfer of the

objects

Validate the transferred

objects

Phase objective

Transferred

object files

Preliminary

Phase

Formal Definition

Phase

Validation

agreement

Preliminary

Agreement

Dictionary

Formal model

Submission Agreement

Anomalies

Data ready to archive

Producer-Archive Methodology

slide15

Methodology Preliminary phase: context

Producer

Preliminary Phase

Preliminary Agreement

Archive

Producer-Archive Methodology

slide16

Action table

Description

MethodologyPreliminary phase: sub-phases

Producer-Archive Methodology

slide17

MethodologyFormal Definition Phase: context

Preliminary Agreement

Formal Definition Phase

Dictionary

Data Model

Submission Agreement

Producer-Archive Methodology

slide19

MethodologyTransfer Phase

Data

Model of object files to deliver

Schedule

Transfer Phase

  • Actual transfer of the objects:
  • carry out the transfer test
  • manage the transfer

Transferred object files

Producer-Archive Methodology

slide20

MethodologyValidation Phase

Transferred object files

Data ready to archive

Validation Phase

  • Validate the transferred objects:
  • carry out the validation test
  • manage the validation

Anomalies

Validation

acknowledgement

Producer

Producer-Archive Methodology

contents21
Contents
  • Why a new standard?
    • Space data archiving
    • Needs for standardization
    • What standardization will bring
    • Abstract standard status
  • Proposed methodology
    • Context - description
    • The 4 phases
  • Specialization
  • Aid Tool for the use of the Methodology
  • Towards an implementation standard
  • Conclusion

Producer-Archive Methodology

slide22

Specialization

  • Adapt the generic standard to a particular community (which can range from an international organization to a simple archive service)
  • Steps involved to define a community standard
    • terminology,
    • data dictionary and information model,
    • standards,
    • common tools.
  • Analyze each action of the generic standard (add actions if necessary)

Producer-Archive Methodology

slide23

Use the Data Description Language EAST

Specification defined by the CCSDS

for the syntactic data description

Specific Action (CDPP)

Use the CCSDS DEDSL-

Data Entity Dictionary Structure Language- —XML/DTD Syntax

for the semantic data description

Apply the ‘specification of products for delivery to the CDPP’ including

Use the CCSDS time code format for the date and time coding

Etc.

Specialization: Example

  • Example (CDPP -Plasma Physics Data Center- Archive)

Generic Action (Methodology)

F-4: Define the formats, coding rules, and standards

to be applied for the objects to be delivered

Producer-Archive Methodology

contents24
Contents
  • Why a new standard?
    • Space data archiving
    • Needs for standardization
    • What standardization will bring
    • Abstract standard status
  • Proposed methodology
    • Context - description
    • The 4 phases
  • Specialization
  • Aid Tool for the use of the Methodology
  • Towards an implementation standard
  • Conclusion

Producer-Archive Methodology

slide25

Aid Tool

A methodology application and archive project aid tool would be a real advantage for both the Producer and the Archive.

First mockups produced

Producer-Archive Methodology

slide26

Aid Tool

Producer-Archive Methodology

contents27
Contents
  • Why a new standard?
    • Space data archiving
    • Needs for standardization
    • What standardization will bring
    • Abstract standard status
  • Proposed methodology
    • Context - description
    • The 4 phases
  • Specialization
  • Aid Tool for the use of the Methodology
  • Towards an implementation standard
  • Conclusion

Producer-Archive Methodology

slide28

Community

standard

Towards an implementation standardContext

Methodology application aid

PAIMAS

Generic abstract

standard

Implementation

standard

Languages

Tools

Archive project

Producer-Archive Methodology

slide29

Towards an implementation standardApproach

  • generic data model
    • transfer data model (generic objects)
    • transfer data dictionary (generic descriptors)
    • community dictionary
  • diagram of data to transfer for the

archive project

  • transfer sequencing and chronology
  • transfer session

Implementation

standard

DEDSL

XML Schema

XML

Languages

Tools

UML

XMLScheme

DTD

XMLScheme

XFDU

Producer-Archive Methodology

slide30

Towards an implementation standardRelationships

CLUSTER

CIS

CODIF

HIA

CLUS-CIS-CODIF-EAST

CLUS-CIS-HIA-EAST

CLUS-CIS-HIA-Jn

CLUS-CIS-CODIF-Jm

Producer-Archive Methodology

slide31

Towards an implementation standardSchema

  • Delivery plan
    • all the elements to be delivered
    • easy to understand from the Producer side
    • expression of constraints

Producer-Archive Methodology

slide32

Conclusion

  • PAIMAS identifies:
    • the phases in the process of transferring information,
    • the objective of the phases,
    • the actions that must be carried out,
    • the expected results.
  • PAIMAS is a basis:
    • for the identification of standards and implementation guides,
    • for identification and development of a set of software tools.

Producer-Archive Methodology

slide33

End of presentation

Producer-Archive Methodology

ad