Producer-Archive Interface Methodology
Download
1 / 33

Contents - PowerPoint PPT Presentation


  • 143 Views
  • Updated On :

Producer-Archive Interface Methodology Abstract Standard PAIMAS. C. Huc/CNES, D. Boucon/CNES-SILOGIC, D.M. Sawyer/NASA/GSFC, J.G. Garrett/NASA-Raytheon. Contents. Why a new standard? Space data archiving Needs for standardization What standardization will bring Abstract standard status

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Contents' - Albert_Lan


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Slide1 l.jpg

Producer-Archive Interface MethodologyAbstract Standard

PAIMAS

C. Huc/CNES, D. Boucon/CNES-SILOGIC,D.M. Sawyer/NASA/GSFC, J.G. Garrett/NASA-Raytheon


Contents l.jpg
Contents

  • Why a new standard?

    • Space data archiving

    • Needs for standardization

    • What standardization will bring

    • Abstract standard status

  • Proposed methodology

    • Context - description

    • The 4 phases

  • Specialization

  • Aid Tool for the use of the Methodology

  • Towards an implementation standard

  • Conclusions

Producer-Archive Methodology


Why a new standard space data archiving archive types l.jpg

Mission control system

Telemetry

Operation control

Payload control

Mission

exploitation

Mission

archives

Scientific multi-mission

data centers: long-term archives

Why a new standard?Space data archiving: archive types

Producer-Archive Methodology


Slide4 l.jpg

aProducer-Archive Project is a set of activities and the means used by the Information Producer as well as the Archive to ingest a given set of information into the Archive.

Why a new standard?Space data archiving: key roles and players

  • Data Producers:

    • the operating systems of each mission

    • the mission processing and archiving centres

    • the scientific teams in the laboratories

  • Archive

    • specialized independent organizations (CDS)

    • specialized services within the agencies (NSSDC)

    • services common to several organizations (CDPP)

  • Producer-Archive Methodology


    Slide5 l.jpg

    Why a new standard?Needs for standardization: problems

    • The relations between archives and data Producers are rarely simple and easy:

      • nonconformity of received data

      • unclear and imprecise definition of the data to be delivered,

      • failure to meet delivery schedule,

      • late detection of errors in archived data,

      • non-management of modifications

        ==> Can be detrimental to archived information quality and the cost of the operation.

    • Ever increasing diversity of the producers

    • Data complexity

    • Each project develops its own methodology on the basis of a process that is roughly the same from one project to another

      ==> Work duplicated, no generality, excessively high costs, etc.

    Producer-Archive Methodology


    Slide6 l.jpg

    Why a new standard?Needs for standardization: multiple standards

    PAIMAS

    Generic abstract

    standard

    Approved by the CCSDS

    PAIMAS

    Implementation

    standard

    Community

    abstract standard

    Development in progress

    Producer-Archive Methodology


    Slide7 l.jpg

    Why a new standard?What standardization will bring

    • Ease some typical problems (as noted earlier)

    • Make it easier to follow schedules and commitments

    • Help with human resources turnover

    • Anticipate new problems

    • Address the legal aspects early

    • Increase data quality of archive holdings

    • Have weight and credibility for adoption

    • And finally, save time (and money)

    Producer-Archive Methodology


    Slide8 l.jpg

    Why a new standard?Abstract standard status

    • Today: CCSDS standard (blue book) and standardization with ISO in progress

    • Various communities have helped produce this document :

      • space agencies (CNES, NASA, ESA, …)

      • archivists (NARA, …) and

      • librarians (BNF -French National Library, RLG-Research Library Group).

    Producer-Archive Methodology


    Contents9 l.jpg
    Contents

    • Why a new standard?

      • Space data archiving

      • Needs for standardization

      • What standardization will bring

      • Abstract standard status

    • Proposed methodology

      • Context - description

      • The 4 phases

    • Specialization

    • Aid Tool for the use of the Methodology

    • Towards an implementation standard

    • Conclusion

    Producer-Archive Methodology


    Slide10 l.jpg

    MethodologyContext: OAIS environment

    Producer-Archive Methodology


    Slide11 l.jpg

    MethodologyContext: PAIMAS focus

    AIP : Archival Information Package, SIP : Submission Information Package, DIP : Dissemination Information package

    Producer-Archive Methodology


    Slide12 l.jpg

    MethodologyContext: PAIMAS focus

    Ingest

    AIP : Archival Information Package, SIP : Submission Information Package, DIP : Dissemination Information package

    Producer-Archive Methodology


    Slide13 l.jpg

    MethodologyDescription

    • The archive project is broken down into 4 main phases:

      • Preliminary Phase,

      • Formal Definition Phase,

      • Transfer Phase,

      • Validation Phase.

    • Each phase has extensive action tables.

    • Specification for a community.

    Producer-Archive Methodology


    Slide14 l.jpg

    Validation

    Phase

    Transfer

    Phase

    MethodologyThe phases: relationships

    • Negotiate the Submission

      Develop agreement (data to

      be delivered, complementary

      elements, schedule)

    • Identification and preliminary

      agreement

      Define the information

      to be archived

    • resources estimation

    • Actual transfer of the data

      Actual transfer of the

      objects

    Validate the transferred

    objects

    Phase objective

    Transferred

    object files

    Preliminary

    Phase

    Formal Definition

    Phase

    Validation

    agreement

    Preliminary

    Agreement

    Dictionary

    Formal model

    Submission Agreement

    Anomalies

    Data ready to archive

    Producer-Archive Methodology


    Slide15 l.jpg

    Methodology Preliminary phase: context

    Producer

    Preliminary Phase

    Preliminary Agreement

    Archive

    Producer-Archive Methodology


    Slide16 l.jpg

    Action table

    Description

    MethodologyPreliminary phase: sub-phases

    Producer-Archive Methodology


    Slide17 l.jpg

    MethodologyFormal Definition Phase: context

    Preliminary Agreement

    Formal Definition Phase

    Dictionary

    Data Model

    Submission Agreement

    Producer-Archive Methodology


    Slide18 l.jpg

    MethodologyFormal Definition Phase: sub-phases and action table

    Producer-Archive Methodology


    Slide19 l.jpg

    MethodologyTransfer Phase

    Data

    Model of object files to deliver

    Schedule

    Transfer Phase

    • Actual transfer of the objects:

    • carry out the transfer test

    • manage the transfer

    Transferred object files

    Producer-Archive Methodology


    Slide20 l.jpg

    MethodologyValidation Phase

    Transferred object files

    Data ready to archive

    Validation Phase

    • Validate the transferred objects:

    • carry out the validation test

    • manage the validation

    Anomalies

    Validation

    acknowledgement

    Producer

    Producer-Archive Methodology


    Contents21 l.jpg
    Contents

    • Why a new standard?

      • Space data archiving

      • Needs for standardization

      • What standardization will bring

      • Abstract standard status

    • Proposed methodology

      • Context - description

      • The 4 phases

    • Specialization

    • Aid Tool for the use of the Methodology

    • Towards an implementation standard

    • Conclusion

    Producer-Archive Methodology


    Slide22 l.jpg

    Specialization

    • Adapt the generic standard to a particular community (which can range from an international organization to a simple archive service)

    • Steps involved to define a community standard

      • terminology,

      • data dictionary and information model,

      • standards,

      • common tools.

    • Analyze each action of the generic standard (add actions if necessary)

    Producer-Archive Methodology


    Slide23 l.jpg

    Use the Data Description Language EAST

    Specification defined by the CCSDS

    for the syntactic data description

    Specific Action (CDPP)

    Use the CCSDS DEDSL-

    Data Entity Dictionary Structure Language- —XML/DTD Syntax

    for the semantic data description

    Apply the ‘specification of products for delivery to the CDPP’ including

    Use the CCSDS time code format for the date and time coding

    Etc.

    Specialization: Example

    • Example (CDPP -Plasma Physics Data Center- Archive)

    Generic Action (Methodology)

    F-4: Define the formats, coding rules, and standards

    to be applied for the objects to be delivered

    Producer-Archive Methodology


    Contents24 l.jpg
    Contents

    • Why a new standard?

      • Space data archiving

      • Needs for standardization

      • What standardization will bring

      • Abstract standard status

    • Proposed methodology

      • Context - description

      • The 4 phases

    • Specialization

    • Aid Tool for the use of the Methodology

    • Towards an implementation standard

    • Conclusion

    Producer-Archive Methodology


    Slide25 l.jpg

    Aid Tool

    A methodology application and archive project aid tool would be a real advantage for both the Producer and the Archive.

    First mockups produced

    Producer-Archive Methodology


    Slide26 l.jpg

    Aid Tool

    Producer-Archive Methodology


    Contents27 l.jpg
    Contents

    • Why a new standard?

      • Space data archiving

      • Needs for standardization

      • What standardization will bring

      • Abstract standard status

    • Proposed methodology

      • Context - description

      • The 4 phases

    • Specialization

    • Aid Tool for the use of the Methodology

    • Towards an implementation standard

    • Conclusion

    Producer-Archive Methodology


    Slide28 l.jpg

    Community

    standard

    Towards an implementation standardContext

    Methodology application aid

    PAIMAS

    Generic abstract

    standard

    Implementation

    standard

    Languages

    Tools

    Archive project

    Producer-Archive Methodology


    Slide29 l.jpg

    Towards an implementation standardApproach

    • generic data model

      • transfer data model (generic objects)

      • transfer data dictionary (generic descriptors)

      • community dictionary

    • diagram of data to transfer for the

      archive project

    • transfer sequencing and chronology

    • transfer session

    Implementation

    standard

    DEDSL

    XML Schema

    XML

    Languages

    Tools

    UML

    XMLScheme

    DTD

    XMLScheme

    XFDU

    Producer-Archive Methodology


    Slide30 l.jpg

    Towards an implementation standardRelationships

    CLUSTER

    CIS

    CODIF

    HIA

    CLUS-CIS-CODIF-EAST

    CLUS-CIS-HIA-EAST

    CLUS-CIS-HIA-Jn

    CLUS-CIS-CODIF-Jm

    Producer-Archive Methodology


    Slide31 l.jpg

    Towards an implementation standardSchema

    • Delivery plan

      • all the elements to be delivered

      • easy to understand from the Producer side

      • expression of constraints

    Producer-Archive Methodology


    Slide32 l.jpg

    Conclusion

    • PAIMAS identifies:

      • the phases in the process of transferring information,

      • the objective of the phases,

      • the actions that must be carried out,

      • the expected results.

    • PAIMAS is a basis:

      • for the identification of standards and implementation guides,

      • for identification and development of a set of software tools.

    Producer-Archive Methodology


    Slide33 l.jpg

    End of presentation

    Producer-Archive Methodology


    ad