1 / 7

FASR-A 6 Gb/s x 2 x 100 0.1 GB/s 400 GB/day 50 GB/day ~1 GB/day

Simplified Data Pipeline. X xxx. FASR-A 6 Gb/s x 2 x 100 0.1 GB/s 400 GB/day 50 GB/day ~1 GB/day. FASR Data Analysis Plan 22-May-2005. Simplified Data Pipeline. Digital Data Processing Real-time conversion of broadband RF from 100 antennas to 10000 semi-calibrated visibilities

lalo
Download Presentation

FASR-A 6 Gb/s x 2 x 100 0.1 GB/s 400 GB/day 50 GB/day ~1 GB/day

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Simplified Data Pipeline X xxx FASR-A 6 Gb/s x 2 x 100 0.1 GB/s 400 GB/day 50 GB/day ~1 GB/day FASR Data Analysis Plan 22-May-2005

  2. Simplified Data Pipeline • Digital Data Processing • Real-time conversion of broadband RF from 100 antennas to 10000 semi-calibrated visibilities • Implemented with DSPs • No scientific compromise in time- or frequency-resolution • Output data rate is 0.1 Gbytes/sec X xxx FASR-A 6 Gb/s x 2 x 100 0.1 GB/s 400 GB/day 50 GB/day ~1 GB/day

  3. Interim Database • Semi-calibrated visibilities, housekeeping data, etc • Time and frequency resolution are scientifically uncompromised • 400 Gbytes / day • Transient – designed to be overwritten every 24 - 48 hrs. • TBD -- offline archiving ? Simplified Data Pipeline X xxx FASR-A 6 Gb/s x 2 x 100 0.1 GB/s 400 GB/day 50 GB/day ~1 GB/day

  4. Simplified Data Pipeline X xxx FASR-A 6 Gb/s x 2 x 100 0.1 GB/s 400 GB/day 50 GB/day ~1 GB/day Interim  Application Databases FREQUENCY TIME Magnetography bursts general purpose etc

  5. Simplified Data Pipeline X xxx FASR-A 6 Gb/s x 2 x 100 0.1 GB/s 400 GB/day 50 GB/day ~1 GB/day • Application Databases • Set of parallel databases for magnetography, bursts, etc • Time and frequency resolution tailored to specific applications • Fully calibrated • Starting point for generation of high level data products • ~50 Gbytes / day

  6. Simplified Data Pipeline X xxx FASR-A 6 Gb/s x 2 x 100 0.1 GB/s 400 GB/day 50 GB/day ~1 GB/day • High Level Data Products • Includes images, light curves, dynamic spectra, etc • Also includes parametric maps (eg coronal magnetograms, temperature maps, etc derived from imaging spectroscopy) • Common set of software tools for: • Quick look (latency of minutes) • Summary data products with automatically-determined parameters (at end of day) • Custom products In response to user-specified parameters • OR analysis at user’s site

  7. Simplified Data Pipeline X xxx • User Interface • Details TBD • Will support: • Browsing of high level data products • Automated and interactive downloading of high level data products • Generation of user-specified high level data products • Downloading of user-selected subsets of application databases • No user software requirements (except when user chooses to create custom high level data products offsite) FASR-A 6 Gb/s x 2 x 100 0.1 GB/s 400 GB/day 50 GB/day ~1 GB/day

More Related