efw soc science data center sdc
Download
Skip this Video
Download Presentation
EFW SOC Science Data Center (SDC)

Loading in 2 Seconds...

play fullscreen
1 / 32

EFW SOC Science Data Center (SDC) - PowerPoint PPT Presentation


  • 107 Views
  • Uploaded on

EFW SOC Science Data Center (SDC). SOC-SDC Software Design Matt Born [email protected] SDC-RET: You Are Here. SDC-RET Data Retrieval Modules. Requirements: Retrieve data from external sources Deposit the data into an archive Log the transfer of data

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' EFW SOC Science Data Center (SDC)' - alexis-woodard


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
efw soc science data center sdc
EFW SOCScience Data Center (SDC)

SOC-SDC Software Design

Matt Born

[email protected]

RBSP-EFW SOC-CDR 26 Jan 2010

sdc ret you are here
SDC-RET: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010

slide3
RBSP-EFW SOC-CDR 26 Jan 2010

SDC-RET Data Retrieval Modules

  • Requirements:
    • Retrieve data from external sources
    • Deposit the data into an archive
    • Log the transfer of data
    • Operate within fixed latency bounds

Design principles:

    • Single “pull” interface per module
    • Single “push” interface per module, always to ARC-INT

Implementation:

    • Python first draft
    • C optimizations where required
    • Most data transfers over SFTP per interface documents
slide4
RBSP-EFW SOC-CDR 26 Jan 2010

SDC Data Retrieval Modules

The recipe:

slide5
RBSP-EFW SOC-CDR 26 Jan 2010

SDC-RET Data Retrieval Modules

sdc arc you are here
SDC-ARC: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010

slide7
RBSP-EFW SOC-CDR 26 Jan 2010

SDC-ARC Data Storage Modules

  • Requirements:
    • Archive data from internal and external sources
    • Log the source and time of deposited data
    • Maintain previous versions of deposited data

Design principles:

    • No direct producer-to-consumer data transfer
    • Separate archives for public data versus private data

Implementation:

    • Python first draft
    • C optimizations where required
    • At least HTTP and SSH access to archives
sdc pdp you are here
SDC-PDP: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010

slide9
RBSP-EFW SOC-CDR 26 Jan 2010

SDC-PDP Data Processing Modules

  • Requirements:
    • Synthesize new data products from existing ones
    • Log the sources and methods used for data creation
    • Deposit the data into an archive
    • Operate within fixed latency bounds

Design principles:

    • No direct producer-to-consumer data transfer
    • Fully automatic processes with no user intervention

Implementation:

    • Python first draft
    • C optimizations where required
    • Scripted execution of the NRT module for plot generation
slide10
RBSP-EFW SOC-CDR 26 Jan 2010

SDC-PDP Data Processing Modules

The recipe:

slide11
RBSP-EFW SOC-CDR 26 Jan 2010

SDC-PDP Data Processing Modules

slide12
RBSP-EFW SOC-CDR 26 Jan 2010

SOC-PDP Data Products

slide13
RBSP-EFW SOC-CDR 26 Jan 2010

SOC-PDP Monitoring of Critical Telemetry

slide14
RBSP-EFW SOC-CDR 26 Jan 2010

SOC-SDC Trending of Critical Telemetry

sdc met utc you are here
SDC-MET<->UTC: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010

slide16
RBSP-EFW SOC-CDR 26 Jan 2010

SDC-MET<->UTC Time Conversion Utility

  • Requirements:
    • Convert between times expressed in MET or UTC
    • Validate conversions against canonical MOC conversions

Design principles:

    • Conversion speed is essential

Implementation:

    • Python first draft
    • C optimizations where required
    • At least HTTP access to service
sdc met utc time conversion utility
SDC-MET<->UTC Time Conversion Utility

RBSP-EFW SOC-CDR 26 Jan 2010

sdc nrt you are here
SDC-NRT: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010

slide19
RBSP-EFW SOC-CDR 26 Jan 2010

SDC-NRT Near Real Time Analysis Tool

  • Requirements:
    • Display waveforms and spectra
    • Display header-level information

Design principles:

    • Leverage past project code base and IDL expertise
    • Provide an extensible and usable tool for future re-use

Implementation:

    • IDL with Python extensions
    • Integration of legacy code
    • Scriptable operation
sdc bsel you are here
SDC-BSEL: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010

slide24
RBSP-EFW SOC-CDR 26 Jan 2010

SDC-BSEL Burst Selection Utility

  • Requirements:
    • Allow selection of burst data by timestamp
    • Log the selection of data
    • Automatically select data if user declines to do so

Implementation:

    • Python first draft
    • C optimizations where required
    • Interface with CTG module for command generation
sdc bsel burst selection utility
SDC-BSEL: Burst Selection Utility

RBSP-EFW SOC-CDR 26 Jan 2010

sdc bsel burst selection utility1
SDC-BSEL: Burst Selection Utility

RBSP-EFW SOC-CDR 26 Jan 2010

sdc bsel burst selection utility2
SDC-BSEL: Burst Selection Utility

RBSP-EFW SOC-CDR 26 Jan 2010

sdc dval you are here
SDC-DVAL: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010

slide29
RBSP-EFW SOC-CDR 26 Jan 2010

SDC-DVAL Data Validation and Release

  • Requirements:
    • Display data eligible for release along with data necessary to decide upon release
    • Publish data deemed releasable
    • Operate within fixed latency bounds

Design principles:

    • Reuse of existing modules for plot display
    • Strictly controlled route between private and public archive

Implementation:

    • Python first draft
    • C optimizations where required
sdc dval data validation and release
SDC-DVAL Data Validation and Release

RBSP-EFW SOC-CDR 26 Jan 2010

sdc sdt you are here
SDC-SDT: You Are Here

RBSP-EFW SOC-CDR 26 Jan 2010

slide32
RBSP-EFW SOC-CDR 26 Jan 2010

SDC-SDT Science Data Tools

  • Requirements:
    • Display and analyze waveforms and spectra
    • Access data from the public archive, ARC-PUB

We have determined that there exist numerous tools which will be applicable for scientific analysis of the instrument data.

ad