1 / 15

Updates from INTEGRAL User’s Committee Meeting - July 15, 2005: Data Archive Milestones

This document summarizes the key updates from the INTEGRAL User’s Committee Meeting held on July 15, 2005. It highlights important milestones in the public data archive, including the transition to revision 2 format, which features a simplified directory structure, corrected event time stamps, and new data releases accessible within days. The meeting emphasized the availability and accessibility of public data through the HEASARC, along with the expected release schedules and methods for downloading data.

salali
Download Presentation

Updates from INTEGRAL User’s Committee Meeting - July 15, 2005: Data Archive Milestones

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The US INTEGRAL Public Data Archive INTEGRAL User’s Committee Meeting 7-15-05

  2. INTEGRAL Archive Milestones July 2004: The ISDC INTEGRAL Public Data Archive opened with data up to revolution 66 (5-1-03). September 2004: The US INTEGRAL Public Data Archive at the HEASARC opened. January 2005: All public data was reprocessed into revision 2 format. January 2005: New GO and CP data released in revision 2. February 2005: The US INTEGRAL Public Data Archive at the HEASARC switches over to revision 2 format data. March 2005: All data available from ISDC in revision 2 format. INTEGRAL User’s Committee Meeting 7-15-05

  3. Revision 2 Changes The main differences between revision 1 and 2 are: • a simplified directory and file structure • the availability of event time stamps in Julian Dates (JD), with corrected energies, standard good time intervals (GTIs) and deadtime in the science window datasets • the event files are now in the standard OGIP format as adopted for other high-energy missions • all JD time stamps are now corrected for the various offsets described in Table 2 and 3 of Walter et al, 2003, A&A 411, L25. • some optimization of the attitude handling have now been implemented • some statistical products created for the purpose of the instrument monitoring have been removed INTEGRAL User’s Committee Meeting 7-15-05

  4. Current Public Data Archive Status • New public data is available to the community within a few days of its release from the ISDC. The limiting factor is the low data transfer rate from the ISDC (only a factor of a few better than real time). • All public data through the latest release (6-17) is currently available from the HEASARC archive. • Public data releases occur ~monthly with the next releases scheduled for 7-22 and 8-8. INTEGRAL User’s Committee Meeting 7-15-05

  5. INTEGRAL User’s Committee Meeting 7-15-05

  6. Accessing the US INTEGRAL Public Data Archive • The US INTEGRAL Public Data Archive is accessible from the HEASARC via Browse or FTP. • Accessing the data via Browse is complicated by the large size of the typical observation, 3 days of data = 7-8 GB. • The HEASARC limit for a tar file is ~3.5 GB ==> the preferred download method is via a wget script created by Browse. • A detailed description of all the INTEGRAL catalogs available through Browse as well as a detailed cookbook describing the downloading of data and the setting up of a local data repository are available on the GOF website: http://heasarc.gsfc.nasa.gov/docs/integral/inthp_archive.html INTEGRAL User’s Committee Meeting 7-15-05

  7. INTEGRAL User’s Committee Meeting 7-15-05

  8. INTEGRAL User’s Committee Meeting 7-15-05

  9. INTEGRAL User’s Committee Meeting 7-15-05

  10. INTEGRAL User’s Committee Meeting 7-15-05

  11. INTEGRAL User’s Committee Meeting 7-15-05

  12. INTEGRAL User’s Committee Meeting 7-15-05

  13. INTEGRAL User’s Committee Meeting 7-15-05

  14. INTEGRAL User’s Committee Meeting 7-15-05

  15. Archive Usage Statistics March: 60.0 GB April: 23.5 GB May: 9.8 GB June: 36.0 GB ------------------------------------------------- Average: 32.3 GB INTEGRAL User’s Committee Meeting 7-15-05

More Related