The COMPASS (Catalogs of Objects and Measure Parameters for All Sky Surveys) Database Overview

1. The COMPASS (Catalogs of Objects and Measure Parameters for All Sky Surveys) Database Overview Gretchen Greene, Brian McLean, David Wolfe, and Charles Loomis Space Telescope Science Institute Antonio Volpicelli, Roberto Morbidelli and Allesandro Spagna Osservatorio Astronomico di Torino October 22, 2001

2. Introduction: Database Functionality Hierarchical Triangulated Mesh Level 3 • Key Component in the GSC-2 catalog production • Online access to processed plate data • Identification of unique sources • Cross-indexing of multiple observations • Overlapping photographic plates • Multiple epochs • Global recalibration capability • GSC 2 is “exported” from COMPASS • Successful demonstation of Object-Oriented technology and the selection of commercial software, Objectivity/DB • One of the first large-scale astronomical archives • Estimated 2 billion objects, 10 billion sources/observations • 4 TB catalog derived from 8 TB image archive! • Collaborative project with OATo and SDSS JHU Science Archive • OATo assisted with schema development, QA (CIQA), plate- matching and much more! • SDSS/STScI joint development of the HTM Indexing Leafnode S213

3. PlateInfoContainer GSH SourceIndex Plate Source Objects Infrastructure: How is the Database designed? • Object model or design is based on hierarchical systems for efficiency • Federation of Databases and Containers • Plate data information stored in 2 forms for access • MetaData and Observations within each HTM region Plate Database for each of 32768 regions HTM Region Database for each plate RegionInfoContainer RegionCatalogContainers for each plate section within region Page = Federated Database Section of reference catalog within region = Database GSPC2 = Container = Class/Basic Object Tycho2 [ COMPASS Federated Database ]

4. Highlights: What happened in 2001 • Completion of Loading and Cross-Matching Observations: All-Sky, 2 bands • Reference catalogs: Successfully loaded GSPC2 and Tycho2 into COMPASS, utilize real-time object-matching based on GSC1 • Fully Online RAID System: Has been upgraded to 4TB using NT client/server configuration. • Export of GSC 2.2 Public Release: The export of ~1 billion objects from the database with best observation position selection, magnitude and classification filtering for accuracy. • Steady State Production Operations: Catalog production pipeline, recalibration, and administration of multi-Terabyte data volume • HST Bright Object Protection (BOP): GSC-2.2 incorporation into Observation Planning Tools and target acquisition development (APT) – special release • ShowSky JAVA Visualization Tool Public Release • Multiple Catalog viewing, including SDSS, 2MASS, Tycho, DSS, GSC…. • Parameter Filtering • HTM grid field view with level

5. GSC2.2 Export Catalog Fields: what will change with 2.3? • Define new requirements and evaluate current parameters early enough to avoid schedule slips • need time to develop modifications to export task • Coordination of DB administation with science goals • How do we want to query the catalog? • move toward mining.

6. Export Catalog: Current configuration and moving toward GSC 2.3 • Source identification • names from GSC2.2 release should be preserved now that the catalog has been incorporated into telescope operations, is this always possible? • Catalog column parameters, new ones? Changes to existing? • Position currently is based on observation closest to plate center for the same bandpass • Astrometric residuals were verified to be a factor of 2 improved. • Reclassification: further definition of non-star into galaxy, blend, etc. • Plate identification • epoch is non-unique distinction of plate source • Multi-plate calibrated parameters, proper motion: • API development will benefit from experience of previous catalog pipeline tasks, e.g. Plate loading and object/source cross matching. • Minimize the large scale transaction time, perform dynamically if possible. • Will this parameter be changing

8. Multi-Archive at STScI: CASB coordination with MAST • MAST develops and maintains the public data release WWW user interface for SDSS and the STScI WWW pages for GSC-2 • individual development sites provide more project specific information • CASB • FNAL • JHU • Unified view of STScI archives • Growth in the large scale catalog archives • Cross correlation of mission data now possible, development of large scale correlations between ground and space missions in progress.

9. Moving toward Multi-catalog archive: SDSS and GSC-2 joint operation at STScI • Data Archive Server is mirrored parallel to GSC-2 on hybrid LINUX/NT dual server. • New Develop of MAST/GALEX archive based on GSC-2/SDSS archive interoperation • SDSS population into COMPASS for high speed cross-matching utilizing HTM • no spatial remapping • New Database Engine?? There is a possibility that SDSS will migrate from Objectivity to another commerical system, e.g. SQL server.

10. Future Developments: GSC-2 enhancements to support access for science and operations • 2MASS population into COMPASS • GSC-2 + 2-MASS will be input catalog of NGST guidance system • 2MASS also utilizes HTM for their file system • SDSS population into COMPASS • Direct public access to COMPASS observations extended for higher speed access • HTMIndex container using sorted level10 source indexing as in export catalog similar to the export catalog infrastructure • Correct Internal database page file limitations • GSC2Query Enhancements • GSC-2, SDSS, GALEX, 2MASS =>>>> NVO (National Virtual Observatory) • Still very early in conceptual stage, but nevertheless it is real, 10M NSF grant is currently issued for collaboration between STScI, Caltech, JHU + others.