geon software stack l.
Download
Skip this Video
Download Presentation
GEON Software Stack

Loading in 2 Seconds...

play fullscreen
1 / 35

GEON Software Stack - PowerPoint PPT Presentation


  • 604 Views
  • Uploaded on

GEON Software Stack. Sandeep Chandra, SDSC The Geosciences Network (GEON) Cyberinfrastructure Workshop University of Auckland, New Zealand. 26-28 November 2007. Common environment to develop and deploy Grid/Web Service based Applications Portal Applications Database Applications

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'GEON Software Stack' - elina


Download Now An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
geon software stack

GEON Software Stack

SandeepChandra, SDSC

The Geosciences Network (GEON) Cyberinfrastructure Workshop

University of Auckland, New Zealand.

26-28 November 2007

www.geongrid.org

purpose
Common environment to develop and deploy

Grid/Web Service based Applications

Portal Applications

Database Applications

HPC Applications

Purpose

www.geongrid.org

purpose3
For system developers

Monitor resources

Consistency of software across sites

Perform system and network tests and measurements

Administer and track the basic system setup

Purpose

www.geongrid.org

geon software stack4
Base OS

Rocks: highly programmatic software configuration management

Development

Globus 4.0.2 (GSI, GridFTP, etc)

Web Services (Jakarta-tomcat-5.0.28, axis-1.2, ant-1.6, jdk1.4.2, etc)

GridSphere 2.0.2 Portal Framework

Database

IBM DB2

Postgres 8.0.3

PostGIS 1.2 (Geos, Proj)

Security

Tripwire, chkrootkit

System Monitoring

INCA Testing and Monitoring framework (Teragrid)

With GRASP benchmarks

Network Weather Service (NWS)

Ganglia

Job Submission and Monitoring

Condor, PBS

GRASS (GDAL, NetCDF, Tiff)

GMT

PBS

Condor

NWS

INCA/GRASP

Globus

OGSA-DAI

Pre-Web

Axis

Tomcat

Postgres

PostGIS Geos Proj

Ant

Samba

JDK

Tripwire

Rocks 4.2.1 based on

RedHat Enterprise Linux

GEON Software Stack

GEONGrid Software Stack

GridSphere Portal

www.geongrid.org

rocks cluster software
Enable domain specific scientists to have their own supercomputer

Open-source Linux cluster distribution that enables end users to easily build grid endpoints

Full Red Hat Linux distribution release, De-facto standard cluster packages, Rocks packages and Rocks community packages

Easy to deploy and maintain both small and large clusters

Facilitates software customization, configure services in packages

Rocks Cluster Software

www.geongrid.org

building a rocks node
Hardware

20GB Disk, 1GB RAM, Dual NIC’s

CD Media

WAN Kickstart

Static IP address

Monitor, Keyboard

Building a Rocks Node

www.geongrid.org

building a rocks node7
Building a Rocks Node

www.geongrid.org

building a rocks node8
Building a Rocks Node

www.geongrid.org

building a rocks node9
Building a Rocks Node

www.geongrid.org

building a rocks node10
Building a Rocks Node

www.geongrid.org

building a rocks node11
Building a Rocks Node

www.geongrid.org

building a rocks node12
Building a Rocks Node

www.geongrid.org

building a rocks node13
Building a Rocks Node

www.geongrid.org

building a rocks node14
Building a Rocks Node

www.geongrid.org

building a rocks node15
Building a Rocks Node

www.geongrid.org

building a rocks node16
Building a Rocks Node

www.geongrid.org

building a rocks node17
Building a Rocks Node

www.geongrid.org

building a rocks node18
Building a Rocks Node

www.geongrid.org

building a rocks node19
Building a Rocks Node

www.geongrid.org

building a rocks node20
Building a Rocks Node

www.geongrid.org

system configuration
Software first compiled then packaged

Source files are installed as well

Post-installation setup at first boot

e.g moving files, running scripts, creating DB’s

Software installed in /opt/ (optional)

e.g Axis installed in /opt/axis

Environment Variables setup at install time

e.g GLOBUS_LOCATION, JAVA_HOME, etc

System Configuration

www.geongrid.org

system configuration23
GEON users created

geon (axis, globus, gridsphere)

nws (nws)

inca (inca)

postgres (pgsql, postgis, proj, geos)

Rocks rolls installed in default locations

Tripwire, java, etc

User space in /export/home/<user>

Remote updates and re-installs will not affect /export/home

Required services start at system boot

e.g tomcat, postgres, inca, nws

System Configuration

www.geongrid.org

base system software
Java

Java development toolkit version 1.4.2_04

Using Rocks Java Roll

Ant

Apache Ant version 1.6.2

Provides a java based build tool

Jakarta-tomcat

A servlet container to host services

Hosting Axis, Globus

Version 5.0.28

Base System Software

www.geongrid.org

web grid service software
Axis

Java based web service development and deployment environment

Version 1.2

Globus

Java based grid service development and deployment environment

Version 4.0.2

Web/Grid Service Software

www.geongrid.org

web grid service software26
Pre-Web Globus

Pre-Web Services (GridFTP, GRIS, GRAM)

Services can be started after generating host certificates using GEON CA

OGSA-DAI (part of Globus)

Grid service based database access services

Version 4.0

Web/Grid Service Software

www.geongrid.org

database software
Postgres

Relational Database

Hosts Gridsphere portal database

Version 8.0.3

PostGIS

GIS extensions for Postgres

Version 1.0.2

Geos & Proj

Dependencies for PostGIS

Database Software

www.geongrid.org

portal software
Portal Software
  • GridSphere
    • Set of standard GEON services
    • Framework to develop and deploy standard portlet applications
    • Get familiar with portal development
    • Configured to use Postgres
    • Includes GAMA portlets, configured to talk to GEON GAMA server
    • Version 2.0.2

www.geongrid.org

monitoring software
INCA

Test harness and reporting framework

SDSC PoP runs INCA Depot

All GEON partner site PoP’s run reporters

Monitoring Software

www.geongrid.org

monitoring software30
Network Weather Service (NWS)

Monitor and forecast performance of network and computational resources

Name server and Memory server runs on SDSC PoP

Version 2.10.1

Monitoring Software

www.geongrid.org

system software
Tripwire

Utilities to analyze the integrity of files and the kernel.

Mail daily/weekly reports to tripwire@geongrid.org

Use Rocks Tripwire Roll

Samba

Allows access & sharing services between Linux/Unix server and windows clients

System Software

www.geongrid.org

hpc software
Develop and deploy mechanisms and policies that support HPC on grid computing resources.

Using Rocks Condor, PBS roll

Used for compute clusters

HPC Software

www.geongrid.org

next steps
Package GEON portal and release a basic edition, standard edition, professional edition, etc.Next Steps

www.geongrid.org

acknowledgements
GEON Team

Grid-Devel Group

Rocks Group

University of Auckland

BeSTGRID

Acknowledgements

www.geongrid.org