The montage image mosaic service custom mosaics on demand
This presentation is the property of its rightful owner.
Sponsored Links
1 / 10

The Montage Image Mosaic Service: Custom Mosaics on Demand PowerPoint PPT Presentation


  • 95 Views
  • Uploaded on
  • Presentation posted in: General

CT PROJECT. ESTO. The Montage Image Mosaic Service: Custom Mosaics on Demand. John Good, Bruce Berriman Mihseh Kong and Anastasia Laity IPAC, Caltech. M51 2MASS J-band, 0.2 x 0.2 deg. Wall clock time 26s. http://hachi.ipac.caltech.edu:8080/montage. What Is Montage?.

Download Presentation

The Montage Image Mosaic Service: Custom Mosaics on Demand

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


The montage image mosaic service custom mosaics on demand

CT PROJECT

ESTO

The Montage Image Mosaic Service: Custom Mosaics on Demand

John Good, Bruce Berriman

Mihseh Kong and

Anastasia Laity

IPAC, Caltech

M51 2MASS J-band, 0.2 x 0.2 deg.

Wall clock time 26s

http://hachi.ipac.caltech.edu:8080/montage


What is montage

What Is Montage?

  • Montage is a portable, scaleable toolkit for producing science-grade image mosaics from input FITS images

    • Preserves astrometry and flux of input images

    • Delivers mosaic according to users specifications

    • Rectifies background radiation to a common level

    • Utilities for, e.g., creating 3-color images & tiling images

  • Code available for download at http://montage.ipac.caltech.edu

    • Over 300 downloads by astronomers

    • In active use in supporting processing pipelines & data product generation, E/PO, quality assurance and science analysis

  • Design: see Berriman et al. 2004, ASP Conf 314, ADASS XIII, 593; Berriman et al. 2003, ASP Conf 295, ADASS XII, 343

Ogle et al 2007, Ap J. 3-color IRAC mosaic of 3C 326

Ubeda and Pellerin 2007, Ap J Lett. 3-color IRAC images of GRSMC 45.453+0.060


Mosaic service front end

Mosaic Service Front End

Account set-up

Monitoring Options

Data sets supported

  • 2MASS All Sky (IRSA)

  • SDSS DR6 (FermiLab)

  • DSS (Space Telescope)

Usage Restrictions for First Release

  • 1 deg on a side max

  • 10 simultaneous jobs

  • Results kept for 72 hours

Wall clock time 184 s

http://hachi.ipac.caltech.edu:8080/montage


Job control monitoring

Job Control & Monitoring

Jobs Running.

Status

refreshed every15s

Completed Jobs

Bookmark and return later . . .

. . . and/or e-mail notification


Sample results page

Sample Results Page


Design drivers for mosaic service

Design Drivers for Mosaic Service

  • Cluster housed at IRSA/IPAC

    • Rapid response and high throughput

    • Pathfinder for projects such as LSST

  • Design Goals

    • Inexpensive, commodity hardware

    • Highly fault-tolerant

    • Scaleable, extensible and distributable

    • Portable, open source software

    • Modular software for maintainability & extensibility to other applications

  • Hardware Choices

    • 15 Xeon 3.2-GHz dual-processor dual-core (60 threads) Dell 2650 Power Edge servers

    • Aberdeen Technologies 6-TB RAID-5 disk farm for staging files

    • Total Cost US$ 60K


Throughput specifications

Throughput Specifications

  • 15 Dual-processor dual-core compute nodes 60 simultaneous independent jobs. Throughput:

    • 15 square degrees of 2MASS mosaics a minute or

    • 21,000 square degrees a day (arcsecond resolution) or

    • Almost 2 TB of image data/day

  • Data transfer is ultimate performance limitation

    • Distributed processing overcomes this problem


System architecture

System Architecture

Request Object Management Environment - Kong, Good and Berriman,

ASP Conf Ser, 347, ADASS XIV, 213


Program interface

Program Interface

  • Underlying ROME functionality is program-friendly by design; release wraps this with forms and HTML output for typical users. Prototype evaluated by Astrogrid. Functionality includes

    • Request authentication) and password, easily extended to use certificates, etc.

    • Polling, email notification, and asynchronous (socket) messages.

    • Requests / responses in HTML or XML; includes status information (such as job status filtering).

    • Asynchronous aborts. ROME Processors can allow for control input via socket (via requests through ROME server).

    • Distributed, heterogenous operations.

    • Dedicated processing. Processors can limit the jobs to a specific applications or users


Future plans

Future Plans

  • Upload table of sources

    • Building cutout/mosaics for multiple sources.

  • User-defined WCS.

    • The service already supports arbitrary (user-supplied) FITS headers but not deployed

  • Three-color images.

  • User data.

    • By uploading a image list (URLs), the user can mosaic their own data or data lists from IVO SIA services.

  • Standard plates.

    • Cutout from large (~5 degree) pre-built plates. A second cluster is currently being set up to handle such "production” runs.

      These upgrades require only wrappers around the “core” service


  • Login