japanese virtual observatory and naregi n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Japanese Virtual Observatory and NaReGi PowerPoint Presentation
Download Presentation
Japanese Virtual Observatory and NaReGi

Loading in 2 Seconds...

play fullscreen
1 / 18

Japanese Virtual Observatory and NaReGi - PowerPoint PPT Presentation


  • 81 Views
  • Uploaded on

Japanese Virtual Observatory and NaReGi. Masatoshi Ohishi / NAOJ, Sokendai & NII 大石雅寿 /   国立天文台 , 総合研究大学院大学 & 国立情報学研究所 masatoshi.ohishi@nao.ac.jp. Supported by. JSPS, Core to Core Program MEXT, Kakenhi NII, CSI project NAOJ. Too hard to collect and analyze whole data.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Japanese Virtual Observatory and NaReGi' - hanh


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
japanese virtual observatory and naregi

Japanese Virtual Observatory and NaReGi

Masatoshi Ohishi / NAOJ, Sokendai & NII

大石雅寿 /   国立天文台, 総合研究大学院大学 &国立情報学研究所

masatoshi.ohishi@nao.ac.jp

Astro-RG, OGF20

supported by
Supported by
  • JSPS, Core to Core Program
  • MEXT, Kakenhi
  • NII, CSI project
  • NAOJ

Astro-RG, OGF20

slide3

Too hard to collect and analyze whole data.

Need Cat’s help

Data Rate

Nobeyam Radio Obs.

~ 1 TB/yr

SUBARU telescope

~ 20 TB/yr

ALMA

~ 1 PB/yr

Even for educational use

Accelerate astronomical research, and sufficient time for research itself !!

Virtual Observatory

Accessible from anywhere

at any time

Astro-RG, OGF20

slide4

Overview of the JVO Portal Service

LDAP

解析

解析

解析

Analysis

Servers

Auth.

Grid System

User Request

SDSS

QSO

JVO

SkyNode

1.0

Invoke

Subaru

Invoke

MDS

Portal

2MASS

Service Discovery

User

Storage

Data Service

Web Service

Invoke

HTTPGet

S. Reg.

FTP

SIAP/SSAP

LDAP

Other VOs

P. Reg.

Metadata Harvesting

P. Reg.

SkyNode

0.7.4

Registry

Astro-RG, OGF20

slide5

Log(F_IR)

MAG_B

Astro-RG, OGF20

spectral data from subaru
Spectral Data from Subaru
  • queries
  • display
  • Baseline estimate
  • Line detection
  • VOSpec

High Dispersion Spectrometer

Astro-RG, OGF20

interconnected vo data services in the world
Interconnected VO Data services in the World

Canada VO

More than 600 data resources are available

Astro-RG, OGF20

improvement of work flow system
Improvement of Work Flow system

Items in FY2006

  • Improvement of WFDL
    • Shorten the volume of DL
    • Array definition
    • Awk-like description (loop description in a single line)
    • and so on
  • Built-in functions
    • Available to register and use built-in functions
  • Status and Log system

WF Editor

Execution monitor

Astro-RG, OGF20

slide9

Overview of the JVO Portal Service

LDAP

解析

解析

解析

Analysis

Servers

Auth.

Grid System

User Request

SDSS

QSO

JVO

SkyNode

1.0

Invoke

Subaru

Invoke

MDS

Portal

2MASS

Service Discovery

User

Storage

Data Service

Web Service

Invoke

HTTPGet

S. Reg.

FTP

SIAP/SSAP

LDAP

Other VOs

P. Reg.

Metadata Harvesting

P. Reg.

SkyNode

0.7.4

Registry

Astro-RG, OGF20

subaru grid pipeline arch

Data Storage

Service

Data Search

Service

MDS Server

Data Analysis Service

Subaru Grid Pipeline Arch.

1. search an available server

Client

query status

5. result URL

3. query a location of data

report status

2. submit a job

6. Submit data transfer job

7. retrieve the result

4. get data

Astro-RG, OGF20

grid service on vo
Grid Service on VO
  • Subaru data reduction pipeline system
    • Web service based GRID
    • Generates calibration data (Super-Flat) for all the SuprimeCam data in a week
    • On-the-fly data reduction with the pre-prepared Super-Flat
    • Users can access to the data reduced with the most recent algorithm
    • Also support the older version of pipeline
  • Backend computing system of the JVO
    • catalog generation
    • photo-z calculation
    • Image arithmetic

Astro-RG, OGF20

slide12

Reduction 10s(Bias+Flat+Distortion+ Astrometory)

  • Transfer 30s

Data Reduction:

~24 hours  ~1 hour

Astro-RG, OGF20

slide13

Study on Environment around QSOs

HighConcentrationLow

PresentPast

Astro-RG, OGF20

cyber science infrastructure toward petascale computing planned 2006 2011

NAREGI Site

Middleware

CA

Research

ナノ分野

実証・評価

分子研

Dev.(  )

ナノ分野

実証・評価

分子研

βver.

V1.0

V2.0

Nano

Proof of al.Concept

Eval.

IMS

  • International
  • Collaboration
  • - EGEE
  • - UNIGRIDS
  • Teragrid
  • GGF etc.

Operaontional Collaborati

NII

Collaborative Operation Center

R&D Collaboration

Cyber-Science Infrastructure(CSI)

(IT Infra. for Academic Research and Education)

Nano

Proof, Eval.

IMS

Cyber Science Infrastructure toward Petascale Computing (planned 2006-2011)

Joint Project

(Bio)

Osaka-U

R&D Collaboration

Joint Project

AIST

Feedback

R&D Collaboration

Delivery

Delivery

Operation/

Maintenance

(UPKI,CA)

Contents

Operation/

Maintenance

(Middleware)

Networking

Delivery

Feedback

Delivyer

Peta-scale

System

VO

Feedback

Core Site

Project-oriented

VO

Project-

Oriented

VO

Customization

Operation/Maintenance

Industrial

Projects

Univ./National

Supercomputing

VO

Domain Specific

VOs

Domain Specific

VOs

IMS,AIST,KEK,NAO,etc.

Networking Infrastructure (Super-SINET/SINET3)

Astro-RG, OGF20

Note: names of VO are tentative)

introduction of the naregi middleware into jvo
Introduction of the NaReGi middleware into JVO
  • NaReGi middleware version b1.0.2
  • Trial introduction into the Subaru Grid pipeline
    • A part of middleware deployment program by the NII
  • To evaluate how easy it is to use the middleware
  • To find which components may be used for Virtual Observatories
    • SSO, Apps interface, and so on

Astro-RG, OGF20

naregi grid environment

・Registration of UserApplications

・Generation of WF

・Issue CAs

・Keep proxy certif.

・Find Computation Resources

・Job Scheduling

・Monitor Job Execution・Display Information

・Computation Node

・Job monitor at each site

・Job monitor at each node

Data Flow

NAREGI Grid environment

Astro-RG, OGF20

requests to improve
Requests to Improve
  • Items to be improved toward version 1.0
    • Make it easier to install
    • Make it much faster to install
    • Need to support OSs other than RHEL
    • and so on
  • These requests were reflected to the modified road map of NaReGi.

Astro-RG, OGF20

good findings
Good Findings
  • Good Graphical WF builder
    • Plan to import to the JVO system
    • Maybe referred to by the IVOA

Astro-RG, OGF20