Hanisch
This presentation is the property of its rightful owner.
Sponsored Links
1 / 30

Hanisch PowerPoint PPT Presentation


  • 96 Views
  • Uploaded on
  • Presentation posted in: General

Hanisch. ADASS 1999. Distributed Data Systems and Services for Astronomy and the Space Sciences. Robert J. Hanisch Space Telescope Science Institute Baltimore, MD. ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999. What does it mean for a service to be “distributed”?.

Download Presentation

Hanisch

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Hanisch

Hanisch

ADASS 1999


Distributed data systems and services for astronomy and the space sciences

Distributed Data Systems and Services for Astronomy and the Space Sciences

Robert J. Hanisch

Space Telescope Science Institute

Baltimore, MD

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


What does it mean for a service to be distributed

What does it mean for a service to be “distributed”?

  • Databases/archives need not be located at the same physical site

  • User’s query is passed to, and responses are returned from, multiple services via a common protocol

  • Responses/results presented to the user in an integrated fashion, as if resources were local and of similar structure

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


What does it mean for a service to be distributed1

Ground-Based Data

Space Mission Data

Catalogs

What does it mean for a service to be “distributed”?

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


We need distributed information services because

We need distributed information services because...

  • No one site can hold all information

  • Information is dynamic; static catalogs and indexes quickly become obsolete

  • Astronomers use multiple types of data — images, spectra, time series; catalogs, journal tables; journal articles — all should be easily located and accessed with query terms and syntax natural to the discipline

  • Common entry point for multiple resources simplifies life for users

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Distributed information services in astronomy provide

Distributed information services in astronomy provide...

  • Information discovery: Search across distributed resources and services

    • ASDS, Astrobrowse

  • Information retrieval: Catalog services and on-line archives

    • VizieR, MAST, HEASARC, IRSA, …

  • Information integration: Catalog cross-correlation, image and graphical overlays, intelligent query/response management

    • IMPReSS, AMASE, SkyView, SkyCat, Aladin, Jsky

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Astrobrowse

Astrobrowse

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Astrobrowse1

Astrobrowse

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Impress

IMPReSS


Amase

AMASE

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Skyview

SkyView

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Skyview1

SkyView

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Skycat

SkyCat

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Aladin

Aladin

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Hanisch

ASDS


Next step distributed information services for space science

Next Step: Distributed Information Services for Space Science

  • Maximize scientific return from space science missions

  • Enable cross-cutting research utilizing what have traditionally been disconnected data resources

  • Provide access to and awareness of enabling tools and technologies

    • Software libraries

    • Computational resources

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Hanisch

Space Science Data Systems

Planetary

Data System

SEC Data System

Astrophysics

  • PDS Management Council

  • PDS Central Node (JPL)

  • Discipline Nodes

    • Atmospheres

    • Geosciences

    • Imaging

    • Navigation & Ancillary Info

    • Planetary Plasma Interactions

    • Rings

    • Small Bodies

  • Astrophysics Data Centers Coordinating Council

  • Datatype-Based Data Centers

    • IRSA (IPAC)

      • Infrared, Interferometry

    • MAST (STScI)

      • EUV, UV, Opt, Near-IR

    • HEASARC (GSFC)

      • EUV, X-ray, Gamma-ray

    • ADC (GSFC)

      • Catalogs

    • ADS (SAO)

      • Abstracts

    • Chandra (SAO)

  • SECDS Coordinating Council

  • Management Office

  • Service Groups

    • Solar Physics

    • Terrestrial Environment Imagery

    • In Situ Space Physics

  • Data Providers

Planetary

Exploration

Search for

Origins

Structure and

Evolution of

the Universe

Sun-Earth

Connection

Science Themes


Models for a space science information system

Models for a Space Science Information System

  • “Good” - user can access many resources (current WWW; AstroWeb, SPDS)

  • “Better” - web-based client directs user queries to appropriate services (current AstroBrowse system)

  • “Best” - web-based client locates services relevant to user, sends queries, and collates responses (goal of ISAIA)

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Space science data services

Query/

Response

Agent

Query

Agent

User

User

User

“good”

“better”

“best”

Space Science Data Services

Astro-browse

The Web

ISAIA


Building a distributed data system for space science

Building a Distributed Data System for Space Science

  • Standardize query protocols through use of profiles

    • Profiles map generic terms onto discipline or site-specific metadata and define the allowed logical operators (=, >, x .. y)

  • Keep infrastructure light-weight

    • Potential barrier for participation must be kept as low as possible

    • Data providers must not have to modify internal data services/structures

  • Automate maintenance and distribution of profiles, e.g., using GLU

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Astrobrowse2

AstroBrowse

AstroBrowse is a first generation effort to implement the query agent

  • Concept by R. Hanisch and S. Murray (SAO), implementations by T. McGlynn/C. Heikkila (HEASARC) and T. Kimball (STScI), GLU support from P. Fernique and M. Wenger (CDS) as well as CDS implementation AstroGLU

  • ~1000 resources (observation logs, catalogs)

  • Preselection of which resources to query by data type, bandpass, data location, etc.

  • Searches done using object coordinates (obtained from SIMBAD or NED name resolvers)

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Isaia

ISAIA

ISAIA (Integrated System for Archival Information Access) is the next step in implementation of the query/response agent

  • Intended to span all space science disciplines

  • Will layer upon and interface to existing systems (e.g., Planetary Data System DIS, Distributed Inventory System, and emerging SECDS)

  • Profiles map high-level standard terms to resource-specific qualifiers

  • Profile maintenance is distributed among participating sites and services via GLU

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Isaia development

ISAIA Development

Requirements

  • “Light weight”: minimal to zero costs to data providers for participation, no constraints on how an organization manages its data internally

  • Preserve identity of participating services yet make their data available as seamlessly as possible

    Development Plan

  • Define profiles (work in progress)

  • Implement query agent based on profiles (next step in evolution of AstroBrowse)

  • Develop integrator

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Isaia profiles

ISAIA Profiles

  • Three components:

    • Resource profile characterizes data holdings and allows query agent to determine which sites and services to send queries to

    • Query profile provides map of generic query terms to site/service specific terms (e.g., bandpass  filter name)

    • Returned information profile labels returned metadata to facilitate integration of results from different services

  • Profile implementation likely to utilize XML

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Isaia resource profile

ISAIA Resource Profile

Queryable Fields

FACILITYname of observatory, mission, program, etc.

DISCIPLINEastronomy, space physics, planetary science, solar physics

INSTRUMENT HOSTname of telescope (HST, IUE, COBE, …)

INSTRUMENT NAMEname of instrument (WFPC, NICMOS, FIRAS, …)

INSTRUMENT TYPEmagnetometer, spectrometer, imager, photometer, ...

OBSERVED PHYSICALphoton, electron, proton, ion, atom, molecule, magnetic

QUANTITYfield, electric field, pressure, temperature, ...

SAMPLING MODEtime series, image, aperture, spectrum, visibility, scan, ...

DATA CLASSpointed observation, survey observation, derived (catalog),

simulation, model fit, ephemeris, software, literature

DATA FORMATFITS, CDF, PDF, HDF, ASCII, …

TIME SPANrange of times covered by resource

PRIN. INVESTIGATORname of PI for INSTRUMENT NAME

OBJECT NAMEastronomical object name, planet name, region of space

OBJECT TYPEasteroid, planet, star, quasar, solar wind, aurora

BANDPASSoptical, UV, IR, 2-10keV, ...

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Isaia integrator

ISAIA Integrator

Following development of profiles, proto-typing will also be done on an integrator

  • An integrator is an application which receives query responses, labeled using the terms of the response profile, and presents response information in a uniform format

  • Functions include

    • conversion of units and coordinates into common system (, , , , l, b, t)

    • sorting of tabular data

    • maintaining intermediate results

    • cross-correlation

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Isaia team

ISAIA Team

A. Rots (SAO)

S. Hughes (PDS/JPL)

S. McMahon (PDS/JPL)

M. A’Hearn (UMd)

R. Beebe (NMSU)

F. Genova, F. Ochsenbein,

P. Fernique, M. Wenger,

F. Bonnarel (CDS)

P. Giommi (BSDC)

R. Hanisch (STScI), PI

T. McGlynn, N. White

(GSFC/HEASARC)

J. King (GSFC/NSSDC)

C. Cheung, E. Shaya

(GSFC/ADC)

R. Plante, R. McGrath,

D. Guillaume (NCSA/UIUC)

J. Mazzarella (IPAC/Caltech)

  • Interested in collaborations with other groups!

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


Hanisch

URLs

  • Space Science Data System

    • http://ssds.nasa.gov/

    • http://spds.gsfc.nasa.gov/

    • http://pds.jpl.nasa.gov/

  • AstroBrowse

    • http://heasarc.gsfc.nasa.gov/ab/

    • http://archive.stsci.edu/starcast/

    • http://simbad.u-strasbg.fr/glu/cgi-bin/ astroglu.pl

  • ISAIA

    • http://heasarc.gsfc.nasa.gov/isaia/

  • GLU

    • http://simbad.u-strasbg.fr/glu/glu.html

ADASS ‘99, Kohala Coast, Hawaii, 3-6 October 1999


  • Login