Efw soc science data center sdc
This presentation is the property of its rightful owner.
Sponsored Links
1 / 32

EFW SOC Science Data Center (SDC) PowerPoint PPT Presentation


  • 64 Views
  • Uploaded on
  • Presentation posted in: General

EFW SOC Science Data Center (SDC). SOC-SDC Software Design Matt Born [email protected] SDC-RET: You Are Here. SDC-RET Data Retrieval Modules. Requirements: Retrieve data from external sources Deposit the data into an archive Log the transfer of data

Download Presentation

EFW SOC Science Data Center (SDC)

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Efw soc science data center sdc

EFW SOCScience Data Center (SDC)

SOC-SDC Software Design

Matt Born

[email protected]

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc ret you are here

SDC-RET: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SDC-RET Data Retrieval Modules

  • Requirements:

    • Retrieve data from external sources

    • Deposit the data into an archive

    • Log the transfer of data

    • Operate within fixed latency bounds

      Design principles:

    • Single “pull” interface per module

    • Single “push” interface per module, always to ARC-INT

      Implementation:

    • Python first draft

    • C optimizations where required

    • Most data transfers over SFTP per interface documents


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SDC Data Retrieval Modules

The recipe:


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SDC-RET Data Retrieval Modules


Sdc arc you are here

SDC-ARC: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SDC-ARC Data Storage Modules

  • Requirements:

    • Archive data from internal and external sources

    • Log the source and time of deposited data

    • Maintain previous versions of deposited data

      Design principles:

    • No direct producer-to-consumer data transfer

    • Separate archives for public data versus private data

      Implementation:

    • Python first draft

    • C optimizations where required

    • At least HTTP and SSH access to archives


Sdc pdp you are here

SDC-PDP: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SDC-PDP Data Processing Modules

  • Requirements:

    • Synthesize new data products from existing ones

    • Log the sources and methods used for data creation

    • Deposit the data into an archive

    • Operate within fixed latency bounds

      Design principles:

    • No direct producer-to-consumer data transfer

    • Fully automatic processes with no user intervention

      Implementation:

    • Python first draft

    • C optimizations where required

    • Scripted execution of the NRT module for plot generation


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SDC-PDP Data Processing Modules

The recipe:


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SDC-PDP Data Processing Modules


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SOC-PDP Data Products


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SOC-PDP Monitoring of Critical Telemetry


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SOC-SDC Trending of Critical Telemetry


Sdc met utc you are here

SDC-MET<->UTC: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SDC-MET<->UTC Time Conversion Utility

  • Requirements:

    • Convert between times expressed in MET or UTC

    • Validate conversions against canonical MOC conversions

      Design principles:

    • Conversion speed is essential

      Implementation:

    • Python first draft

    • C optimizations where required

    • At least HTTP access to service


Sdc met utc time conversion utility

SDC-MET<->UTC Time Conversion Utility

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc nrt you are here

SDC-NRT: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SDC-NRT Near Real Time Analysis Tool

  • Requirements:

    • Display waveforms and spectra

    • Display header-level information

      Design principles:

    • Leverage past project code base and IDL expertise

    • Provide an extensible and usable tool for future re-use

      Implementation:

    • IDL with Python extensions

    • Integration of legacy code

    • Scriptable operation


Sdc nrt near real time analysis tool instrument i t usage

SDC-NRT Near Real Time Analysis ToolInstrument I&T Usage

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc nrt near real time analysis tool spacecraft i t usage

SDC-NRT Near Real Time Analysis ToolSpacecraft I&T Usage

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc nrt near real time analysis tool flight usage

SDC-NRT Near Real Time Analysis ToolFlight Usage

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc bsel you are here

SDC-BSEL: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SDC-BSEL Burst Selection Utility

  • Requirements:

    • Allow selection of burst data by timestamp

    • Log the selection of data

    • Automatically select data if user declines to do so

      Implementation:

    • Python first draft

    • C optimizations where required

    • Interface with CTG module for command generation


Sdc bsel burst selection utility

SDC-BSEL: Burst Selection Utility

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc bsel burst selection utility1

SDC-BSEL: Burst Selection Utility

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc bsel burst selection utility2

SDC-BSEL: Burst Selection Utility

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc dval you are here

SDC-DVAL: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SDC-DVAL Data Validation and Release

  • Requirements:

    • Display data eligible for release along with data necessary to decide upon release

    • Publish data deemed releasable

    • Operate within fixed latency bounds

      Design principles:

    • Reuse of existing modules for plot display

    • Strictly controlled route between private and public archive

      Implementation:

    • Python first draft

    • C optimizations where required


Sdc dval data validation and release

SDC-DVAL Data Validation and Release

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc sdt you are here

SDC-SDT: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


Efw soc science data center sdc

RBSP-EFW SOC-CDR 26 Jan 2010

SDC-SDT Science Data Tools

  • Requirements:

    • Display and analyze waveforms and spectra

    • Access data from the public archive, ARC-PUB

      We have determined that there exist numerous tools which will be applicable for scientific analysis of the instrument data.


  • Login