swift data archive
Skip this Video
Download Presentation
Swift data archive

Loading in 2 Seconds...

play fullscreen
1 / 12

Swift data archive - PowerPoint PPT Presentation

  • Uploaded on

Swift data archive. Lorella Angelini HEASARC. Swift. Collaboration USA/Italy/UK. Multi-wavelength observatory Burst Alert Telescope (BAT): 10-150 keV onboard computation of positions arc-minute positional accuracy X-rays, UV, and optical afterglow follow up:

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about ' Swift data archive ' - jaxon

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
swift data archive

Swift data archive

Lorella Angelini



Collaboration USA/Italy/UK

Multi-wavelength observatory

  • Burst Alert Telescope (BAT): 10-150 keV
    • onboard computation of positions
    • arc-minute positional accuracy
  • X-rays, UV, and optical afterglow follow up:
    • 0.3-10 keV X-ray Telescope (XRT)
    • 170-650 nm UV/Optical Telescope (UVOT)

Launch 20 Nov 2004

    • Rapid response satellite
    • Rapid data dissemination made public immediately
    • 2 AO cycles (analysis of Swift data, follow-up observation, theoretical investigation)
  • Science highlights :
    • Discovered and/or follow-up 151 GRBs (23 from different satellite)
    • Arcsec localization for short bursts ; Detected high redshift bursts
    • Detection of GRB concident with a SN2006aj
    • Discovered new phenomenology in the early afterglow lightcurves
    • Build up the first hard X-ray survey
  • Swift in senior review in 2006
heasarc responsibilities
HEASARC responsibilities
  • Populate and maintain the Swift science and calibration data archive
  • Provide the following services
    • Public access to the Swift archive
    • Science data analysis software environment
    • Web server for the Swift Science Support Center
    • Database system for the Swift tables
    • Long-term archive
  • Generate GRB summary products
  • These responsibilities are documented in the Swift-HEASARC MOU
    • Technical agreement via ICD in place with the SDC, ISAC, BAT Team for the catalog delivery
archive general
Archive general
  • Swift archive contains
    • Science and HK data
    • High level Calibration file pre-post launch
    • Software for data analysis
    • Documentation (archive, software, calibration)
  • Data are in FITS format OGIP standards
    • GIF and HTML used for products preview or to record processing
  • No proprietary period for data
    • But check-out (~45 days) & verification mission phase (3 months) data were available only to the Swift team
  • Archive co-located at HEASARC
    • Copy of the Science and HK data are sent to the Italian and UK data center
archive standards
Archive Standards
  • HEASARC infrastructure used to ingest and distribute
    • Science & HK data & databases
      • Data access via the multi-mission Web Browse and FTP
      • Special Swift Web interface to facilitate searches by GRB name and sources within the BAT FOV
      • Data are in OGIP FITS standard
    • Software part of the HEAsoft package (knows as FTOOLS)
      • 7 releases since launch (1 every ~2 months)
      • Same software is used by the SDC pipeline processing
    • Calibration data in the HEASARC multi-mission Calibration database (CALDB)
      • Updates since launch : 7 BAT, 10 XRT, 8 UVOT
swift rapid data dissemination plan
Swift rapid data dissemination plan
  • Data are downloaded via :
    • TDRSS. Series of messages after a trigger is detected on board.
      • broadcast via the GCN (minutes)
      • later archived as part of the final Swift archive (< a week)
    • Malindi. All the telemetry. About 6 -7 download per day
  • Two processing types of the Malindi data (same pipeline software)
    • Quick look (output data is not part of the final archive):
      • Data processed every Malindi dump, e.g. the same observation is re-processed when new data arrive.
      • Data public in 3-6 hours after each dump (from FTP SDC).
    • Permanent archive:
      • Final processing after an observation (~ 1 day of data )
      • Archived after all telemetry for observation is available ( < a week)
data delivery archive population
Data delivery & Archive population
  • Archive populated from the start of the mission
  • Since 1st April data are public (end of the verification phase)
  • Physical archive and database system updated daily
  • Archive uses automated transfer and ingest protocols
    • Transfer data & DBs from the processing site
    • Ingest data into the physical archive and database system

= > ensure small dead time

  • Transfer & ingest protocols used by the European Data centers
  • Backup done at the ingest time
content of the physical archive
Content of the Physical Archive

Archive size

Observing Time percentage

(April 1 2005 Dec 31 2005)

GRB 63%

ToO 9%

Fill-in Targets 20 %

Calibration 8%

  • Total volume 1146 GB
  • Average ingest 2.5 GB x day

* 1 Jan 2005- 31 Mar 2006

  • Production data :
    • TDRSS messages (SDC) - by trigger number
    • Level 1,2,3 production data (SDC) - by observation
    • Monitoring & Calibration data (SDC/SSC) - by type & CALDB
recent reprocessing
Recent reprocessing
  • Data reprocessing :
    • All data taken so far will be reprocessed by the SDC
    • Latest Pipeline includes improvement implemented in the last year
    • New databases logging the 3 instrument configurations at the exposure or snapshot level are generated with the reprocessing
  • Current status :
    • First 3 months in 2005 used to test the reprocessing
      • SDC processing delivery at HEASARC for checking
    • Final version for these 3 months are ready
    • Instrument tables not quite ready
    • Other data centers currently copying the data
    • Plan is to reprocess 1 month at the time
data downloads
Data downloads
  • SDC higher download during first trimester compared to normal operation since first trimester was holding more than a week of data
  • Overall HEASARC download increase with time
  • Last trimester : 20% of the total HEASARC holdings (24 missions / 7 active)
  • Swift is among the top 3 popular missions
downloads demography
Downloads Demography








  • HEASARC will maintain the current level of activities and the current data ingest
    • Additional creation of the high level data products for GRB
  • New high level data & databases are expected from Swift
    • Swift GRB catalog
    • Serendipitous survey from the BAT, XRT and UVOT
  • The Swift catalog used for the HEASARC GRB name resolver