Efw soc science data center sdc
Download
1 / 32

EFW SOC Science Data Center (SDC) - PowerPoint PPT Presentation


  • 103 Views
  • Uploaded on

EFW SOC Science Data Center (SDC). SOC-SDC Software Design Matt Born [email protected] SDC-RET: You Are Here. SDC-RET Data Retrieval Modules. Requirements: Retrieve data from external sources Deposit the data into an archive Log the transfer of data

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' EFW SOC Science Data Center (SDC)' - alexis-woodard


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Efw soc science data center sdc
EFW SOCScience Data Center (SDC)

SOC-SDC Software Design

Matt Born

[email protected]

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc ret you are here
SDC-RET: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


RBSP-EFW SOC-CDR 26 Jan 2010

SDC-RET Data Retrieval Modules

  • Requirements:

    • Retrieve data from external sources

    • Deposit the data into an archive

    • Log the transfer of data

    • Operate within fixed latency bounds

      Design principles:

    • Single “pull” interface per module

    • Single “push” interface per module, always to ARC-INT

      Implementation:

    • Python first draft

    • C optimizations where required

    • Most data transfers over SFTP per interface documents


RBSP-EFW SOC-CDR 26 Jan 2010

SDC Data Retrieval Modules

The recipe:


RBSP-EFW SOC-CDR 26 Jan 2010

SDC-RET Data Retrieval Modules


Sdc arc you are here
SDC-ARC: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


RBSP-EFW SOC-CDR 26 Jan 2010

SDC-ARC Data Storage Modules

  • Requirements:

    • Archive data from internal and external sources

    • Log the source and time of deposited data

    • Maintain previous versions of deposited data

      Design principles:

    • No direct producer-to-consumer data transfer

    • Separate archives for public data versus private data

      Implementation:

    • Python first draft

    • C optimizations where required

    • At least HTTP and SSH access to archives


Sdc pdp you are here
SDC-PDP: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


RBSP-EFW SOC-CDR 26 Jan 2010

SDC-PDP Data Processing Modules

  • Requirements:

    • Synthesize new data products from existing ones

    • Log the sources and methods used for data creation

    • Deposit the data into an archive

    • Operate within fixed latency bounds

      Design principles:

    • No direct producer-to-consumer data transfer

    • Fully automatic processes with no user intervention

      Implementation:

    • Python first draft

    • C optimizations where required

    • Scripted execution of the NRT module for plot generation


RBSP-EFW SOC-CDR 26 Jan 2010

SDC-PDP Data Processing Modules

The recipe:


RBSP-EFW SOC-CDR 26 Jan 2010

SDC-PDP Data Processing Modules


RBSP-EFW SOC-CDR 26 Jan 2010

SOC-PDP Data Products


RBSP-EFW SOC-CDR 26 Jan 2010

SOC-PDP Monitoring of Critical Telemetry


RBSP-EFW SOC-CDR 26 Jan 2010

SOC-SDC Trending of Critical Telemetry


Sdc met utc you are here
SDC-MET<->UTC: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


RBSP-EFW SOC-CDR 26 Jan 2010

SDC-MET<->UTC Time Conversion Utility

  • Requirements:

    • Convert between times expressed in MET or UTC

    • Validate conversions against canonical MOC conversions

      Design principles:

    • Conversion speed is essential

      Implementation:

    • Python first draft

    • C optimizations where required

    • At least HTTP access to service


Sdc met utc time conversion utility
SDC-MET<->UTC Time Conversion Utility

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc nrt you are here
SDC-NRT: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


RBSP-EFW SOC-CDR 26 Jan 2010

SDC-NRT Near Real Time Analysis Tool

  • Requirements:

    • Display waveforms and spectra

    • Display header-level information

      Design principles:

    • Leverage past project code base and IDL expertise

    • Provide an extensible and usable tool for future re-use

      Implementation:

    • IDL with Python extensions

    • Integration of legacy code

    • Scriptable operation


Sdc nrt near real time analysis tool instrument i t usage
SDC-NRT Near Real Time Analysis ToolInstrument I&T Usage

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc nrt near real time analysis tool spacecraft i t usage
SDC-NRT Near Real Time Analysis ToolSpacecraft I&T Usage

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc nrt near real time analysis tool flight usage
SDC-NRT Near Real Time Analysis ToolFlight Usage

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc bsel you are here
SDC-BSEL: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


RBSP-EFW SOC-CDR 26 Jan 2010

SDC-BSEL Burst Selection Utility

  • Requirements:

    • Allow selection of burst data by timestamp

    • Log the selection of data

    • Automatically select data if user declines to do so

      Implementation:

    • Python first draft

    • C optimizations where required

    • Interface with CTG module for command generation


Sdc bsel burst selection utility
SDC-BSEL: Burst Selection Utility

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc bsel burst selection utility1
SDC-BSEL: Burst Selection Utility

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc bsel burst selection utility2
SDC-BSEL: Burst Selection Utility

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc dval you are here
SDC-DVAL: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


RBSP-EFW SOC-CDR 26 Jan 2010

SDC-DVAL Data Validation and Release

  • Requirements:

    • Display data eligible for release along with data necessary to decide upon release

    • Publish data deemed releasable

    • Operate within fixed latency bounds

      Design principles:

    • Reuse of existing modules for plot display

    • Strictly controlled route between private and public archive

      Implementation:

    • Python first draft

    • C optimizations where required


Sdc dval data validation and release
SDC-DVAL Data Validation and Release

RBSP-EFW SOC-CDR 26 Jan 2010


Sdc sdt you are here
SDC-SDT: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010


RBSP-EFW SOC-CDR 26 Jan 2010

SDC-SDT Science Data Tools

  • Requirements:

    • Display and analyze waveforms and spectra

    • Access data from the public archive, ARC-PUB

      We have determined that there exist numerous tools which will be applicable for scientific analysis of the instrument data.


ad