1 / 13

Ralph Seguin Ankur Somani Lockheed Martin Solar & Astrophysics Laboratory

Ralph Seguin Ankur Somani Lockheed Martin Solar & Astrophysics Laboratory. Data Processing and Display Challenges for Solar Dynamics Observatory Using the Heliophysics Event Knowledgebase.

laban
Download Presentation

Ralph Seguin Ankur Somani Lockheed Martin Solar & Astrophysics Laboratory

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Ralph Seguin Ankur Somani Lockheed Martin Solar & Astrophysics Laboratory Data Processing and Display Challenges for Solar DynamicsObservatory Using the Heliophysics Event Knowledgebase

  2. SDO GENERATES AS MUCH DATA IN A SINGLE DAY AS OUR PREVIOUS MISSION, TRACE, PRODUCED IN FIVE YEARS. • The Heliophysics Events Knowledgebase (HEK): • Helps researchers find data sets relevant for their topics of interest. • Serves as an open forum where solar/heliospheric features and events can be reported and annotated. • Facilitates discovery of statistical trends / relationships between different classes of features and events. • Lightens the load on SDO data system in terms of providing access to large subsets of data (too large to transmit over the Internet).

  3. HOW? • Data mining • Automated identification of interesting events in data • Event Detection System (EDS) to control and manage mining modules • Data markup • Recording and annotating events for later data recall, extracting sample images and movies • Capturing mission metadata associated with data, e.g. Planning logs, instrument settings... • Automated (via EDS) and manual entries using EVACS/Panorama software suite • Guided data searches • Web and Java clients

  4. LMSAL DATA MINING HARDWARE • 400+TB Apple Xsan • 5TB SAS for database • 100TB Cache • 300TB user/archive • 10Gb link to Stanford • 10Gb link to LM science network • Attached Apple and SGI servers • SGI Compute servers • 22 node SGI XE Cluster for EDS • SGI UV100 w/72 core, 750GB memory • HiPerspace Datawall: • Quad HD display (3840x2160 pixels) • 9-panel 30” display (7680x4800 pixels) • Seven-node CGLX cluster • MacPro science workstations

  5. HEK SYSTEM

  6. EVENT CLASSES

  7. EDS DATA MINING

  8. EDS MONITORING

  9. ANNOTATING NEW DATA

  10. EVACS/Panorama provides Search & display for events and features Interactive movie browsing Annotation/Markup tool Java/C for Mac OSX and Linux EVENT VALIDATION AND CONTROL SYSTEM & PANORAMA

  11. GUIDED DATA REQUESTS • Researchers identify regions, intervals, wavelengths from event descriptions • Automatic extraction of datasets from archive • Extracted regions shared with other researchers

  12. Data Mining efforts: Collaboration with SAO-led Feature Finding Team on development of modules for the LMSAL Event Detection System Validation by inter-comparison of methods and by comparison with results from visual inspection system, and by usage in scientific investigations. Supporting, and coordinating with, e.g., the ISSI workshop series on AIA data mining. HEK: FEATURES AND EVENTS; VALIDATION AND COORDINATION • Access to feature/events/coverage: • Internet: iSolSearch: functional in FireFox and Mozilla (not yet in Explorer), being tested and expanded • IDL: SolarSoft: functional (Mozilla, FireFox), being tested and expanded • Interface compatibility: web URL can be copied into SSWIDL routine, and vice versa.

  13. For details: http://lmsal.com/sungate For results: http://sdowww.lmsal.com Ralph Seguin seguin@lmsal.com Ankur Somani ankur@lmsal.com

More Related