the montage image mosaic service custom mosaics on demand n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
The Montage Image Mosaic Service: Custom Mosaics on Demand PowerPoint Presentation
Download Presentation
The Montage Image Mosaic Service: Custom Mosaics on Demand

Loading in 2 Seconds...

play fullscreen
1 / 10

The Montage Image Mosaic Service: Custom Mosaics on Demand - PowerPoint PPT Presentation


  • 127 Views
  • Uploaded on

CT PROJECT. ESTO. The Montage Image Mosaic Service: Custom Mosaics on Demand. John Good, Bruce Berriman Mihseh Kong and Anastasia Laity IPAC, Caltech. M51 2MASS J-band, 0.2 x 0.2 deg. Wall clock time 26s. http://hachi.ipac.caltech.edu:8080/montage. What Is Montage?.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'The Montage Image Mosaic Service: Custom Mosaics on Demand' - damian-ortega


Download Now An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
the montage image mosaic service custom mosaics on demand

CT PROJECT

ESTO

The Montage Image Mosaic Service: Custom Mosaics on Demand

John Good, Bruce Berriman

Mihseh Kong and

Anastasia Laity

IPAC, Caltech

M51 2MASS J-band, 0.2 x 0.2 deg.

Wall clock time 26s

http://hachi.ipac.caltech.edu:8080/montage

what is montage
What Is Montage?
  • Montage is a portable, scaleable toolkit for producing science-grade image mosaics from input FITS images
    • Preserves astrometry and flux of input images
    • Delivers mosaic according to users specifications
    • Rectifies background radiation to a common level
    • Utilities for, e.g., creating 3-color images & tiling images
  • Code available for download at http://montage.ipac.caltech.edu
    • Over 300 downloads by astronomers
    • In active use in supporting processing pipelines & data product generation, E/PO, quality assurance and science analysis
  • Design: see Berriman et al. 2004, ASP Conf 314, ADASS XIII, 593; Berriman et al. 2003, ASP Conf 295, ADASS XII, 343

Ogle et al 2007, Ap J. 3-color IRAC mosaic of 3C 326

Ubeda and Pellerin 2007, Ap J Lett. 3-color IRAC images of GRSMC 45.453+0.060

mosaic service front end
Mosaic Service Front End

Account set-up

Monitoring Options

Data sets supported

  • 2MASS All Sky (IRSA)
  • SDSS DR6 (FermiLab)
  • DSS (Space Telescope)

Usage Restrictions for First Release

  • 1 deg on a side max
  • 10 simultaneous jobs
  • Results kept for 72 hours

Wall clock time 184 s

http://hachi.ipac.caltech.edu:8080/montage

job control monitoring
Job Control & Monitoring

Jobs Running.

Status

refreshed every15s

Completed Jobs

Bookmark and return later . . .

. . . and/or e-mail notification

design drivers for mosaic service
Design Drivers for Mosaic Service
  • Cluster housed at IRSA/IPAC
    • Rapid response and high throughput
    • Pathfinder for projects such as LSST
  • Design Goals
    • Inexpensive, commodity hardware
    • Highly fault-tolerant
    • Scaleable, extensible and distributable
    • Portable, open source software
    • Modular software for maintainability & extensibility to other applications
  • Hardware Choices
    • 15 Xeon 3.2-GHz dual-processor dual-core (60 threads) Dell 2650 Power Edge servers
    • Aberdeen Technologies 6-TB RAID-5 disk farm for staging files
    • Total Cost US$ 60K
throughput specifications
Throughput Specifications
  • 15 Dual-processor dual-core compute nodes 60 simultaneous independent jobs. Throughput:
    • 15 square degrees of 2MASS mosaics a minute or
    • 21,000 square degrees a day (arcsecond resolution) or
    • Almost 2 TB of image data/day
  • Data transfer is ultimate performance limitation
    • Distributed processing overcomes this problem
system architecture
System Architecture

Request Object Management Environment - Kong, Good and Berriman,

ASP Conf Ser, 347, ADASS XIV, 213

program interface
Program Interface
  • Underlying ROME functionality is program-friendly by design; release wraps this with forms and HTML output for typical users. Prototype evaluated by Astrogrid. Functionality includes
    • Request authentication) and password, easily extended to use certificates, etc.
    • Polling, email notification, and asynchronous (socket) messages.
    • Requests / responses in HTML or XML; includes status information (such as job status filtering).
    • Asynchronous aborts. ROME Processors can allow for control input via socket (via requests through ROME server).
    • Distributed, heterogenous operations.
    • Dedicated processing. Processors can limit the jobs to a specific applications or users

future plans
Future Plans
  • Upload table of sources
    • Building cutout/mosaics for multiple sources.
  • User-defined WCS.
    • The service already supports arbitrary (user-supplied) FITS headers but not deployed
  • Three-color images.
  • User data.
    • By uploading a image list (URLs), the user can mosaic their own data or data lists from IVO SIA services.
  • Standard plates.
    • Cutout from large (~5 degree) pre-built plates. A second cluster is currently being set up to handle such "production” runs.

These upgrades require only wrappers around the “core” service