1 / 12

The WFC3 Quicklook Project

The WFC3 Quicklook Project. 17 January 2013. What is Quicklook?. The WFC3 Quicklook project is a complete archive of all ~90k in-flight WFC3 images. It's includes a file system of FITS files and JPEG preview images all mapped to a database. QL is maintained by a pure-Python code base. .

adonica
Download Presentation

The WFC3 Quicklook Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The WFC3 Quicklook Project 17 January 2013

  2. What is Quicklook? The WFC3 Quicklook project is a complete archive of all ~90k in-flight WFC3 images. It's includes a file system of FITS files and JPEG preview images all mapped to a database. QL is maintained by a pure-Python code base.

  3. What Does QL Give WFC3? Daily human inspection of all new WFC3 data. Immediate access to the entire WFC3 in-flight dataset. An interface to build highly customized datasets. Tools and data for exciting new projects.

  4. How do we use Quicklook? Large datasets: Build the persistence correction products (Knox Long) Monitor the WFC3 “blobs” (Nor Pirzkal) IR flat fields (Nor Pirzkal) UVIS backgrounds (Sylvia Baggett, Jay Anderson)

  5. How do we use Quicklook? Immediate Accessibility: Every WFC3 image is inspected by a human. Automation: The QL project is always getting the latest data.

  6. The File System Every FITS extension including engineering and drizzled products.GO data is protected by group permissions. Updated daily with new observations. Contains a JPEG preview of each flt FITS image. >15TB of data on STScI central storage.

  7. The Database The database information is stored in a SQLite relational database on STScI central store. Contains all the header keywords for all extensions of the FLT files. Contains information on creation date, file location, etc.

  8. The Code Base ~4k lines of pure-Python code. File system operations, database operations, plotting, downloading. Maintained with software tools: SVN version control, Trac project management, nosetest, pylint, SQLAlchemy, Sphinx documentation.

  9. QL Development QL has evolved to meet the needs of the team. Version 0: scripts + 6 page word document Version 1: Automated basic daily inspection tasks Version 2: Focused on file system completeness and database indexing

  10. Future Work Move the QL project to a Linux Red Hatvirtual machine. Automate many of the WFC3 monitoringtasks by using QL and using the lessonslearned from building QL.

  11. Contributors Supported and developed by Abhijith Rajan, Alex Viana, Matt Bourque, Michael Dulude, and Heather Gunning. Based on SyBase interface Python modules by Bryan York and Sami Nemi. The entire WFC3 team provides essential feedback for the QL project.

  12. Thank You! Questions?

More Related