Geon software stack
Download
1 / 35

GEON Software Stack - PowerPoint PPT Presentation


GEON Software Stack. Sandeep Chandra, SDSC The Geosciences Network (GEON) Cyberinfrastructure Workshop University of Auckland, New Zealand. 26-28 November 2007. Common environment to develop and deploy Grid/Web Service based Applications Portal Applications Database Applications

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha

Download Presentation

GEON Software Stack

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Geon software stack l.jpg
GEON Software Stack

SandeepChandra, SDSC

The Geosciences Network (GEON) Cyberinfrastructure Workshop

University of Auckland, New Zealand.

26-28 November 2007

www.geongrid.org


Purpose l.jpg

Common environment to develop and deploy

Grid/Web Service based Applications

Portal Applications

Database Applications

HPC Applications

Purpose

www.geongrid.org


Purpose3 l.jpg

For system developers

Monitor resources

Consistency of software across sites

Perform system and network tests and measurements

Administer and track the basic system setup

Purpose

www.geongrid.org


Geon software stack4 l.jpg

Base OS

Rocks: highly programmatic software configuration management

Development

Globus 4.0.2 (GSI, GridFTP, etc)

Web Services (Jakarta-tomcat-5.0.28, axis-1.2, ant-1.6, jdk1.4.2, etc)

GridSphere 2.0.2 Portal Framework

Database

IBM DB2

Postgres 8.0.3

PostGIS 1.2 (Geos, Proj)

Security

Tripwire, chkrootkit

System Monitoring

INCA Testing and Monitoring framework (Teragrid)

With GRASP benchmarks

Network Weather Service (NWS)

Ganglia

Job Submission and Monitoring

Condor, PBS

GRASS (GDAL, NetCDF, Tiff)

GMT

PBS

Condor

NWS

INCA/GRASP

Globus

OGSA-DAI

Pre-Web

Axis

Tomcat

Postgres

PostGIS Geos Proj

Ant

Samba

JDK

Tripwire

Rocks 4.2.1 based on

RedHat Enterprise Linux

GEON Software Stack

GEONGrid Software Stack

GridSphere Portal

www.geongrid.org


Rocks cluster software l.jpg

Enable domain specific scientists to have their own supercomputer

Open-source Linux cluster distribution that enables end users to easily build grid endpoints

Full Red Hat Linux distribution release, De-facto standard cluster packages, Rocks packages and Rocks community packages

Easy to deploy and maintain both small and large clusters

Facilitates software customization, configure services in packages

Rocks Cluster Software

www.geongrid.org


Building a rocks node l.jpg

Hardware supercomputer

20GB Disk, 1GB RAM, Dual NIC’s

CD Media

WAN Kickstart

Static IP address

Monitor, Keyboard

Building a Rocks Node

www.geongrid.org


Building a rocks node7 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node8 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node9 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node10 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node11 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node12 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node13 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node14 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node15 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node16 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node17 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node18 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node19 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Building a rocks node20 l.jpg
Building a Rocks Node supercomputer

www.geongrid.org


Slide21 l.jpg

www.geongrid.org supercomputer


System configuration l.jpg

Software first compiled then packaged supercomputer

Source files are installed as well

Post-installation setup at first boot

e.g moving files, running scripts, creating DB’s

Software installed in /opt/ (optional)

e.g Axis installed in /opt/axis

Environment Variables setup at install time

e.g GLOBUS_LOCATION, JAVA_HOME, etc

System Configuration

www.geongrid.org


System configuration23 l.jpg

GEON users created supercomputer

geon (axis, globus, gridsphere)

nws (nws)

inca (inca)

postgres (pgsql, postgis, proj, geos)

Rocks rolls installed in default locations

Tripwire, java, etc

User space in /export/home/<user>

Remote updates and re-installs will not affect /export/home

Required services start at system boot

e.g tomcat, postgres, inca, nws

System Configuration

www.geongrid.org


Base system software l.jpg

Java supercomputer

Java development toolkit version 1.4.2_04

Using Rocks Java Roll

Ant

Apache Ant version 1.6.2

Provides a java based build tool

Jakarta-tomcat

A servlet container to host services

Hosting Axis, Globus

Version 5.0.28

Base System Software

www.geongrid.org


Web grid service software l.jpg

Axis supercomputer

Java based web service development and deployment environment

Version 1.2

Globus

Java based grid service development and deployment environment

Version 4.0.2

Web/Grid Service Software

www.geongrid.org


Web grid service software26 l.jpg

Pre-Web Globus supercomputer

Pre-Web Services (GridFTP, GRIS, GRAM)

Services can be started after generating host certificates using GEON CA

OGSA-DAI (part of Globus)

Grid service based database access services

Version 4.0

Web/Grid Service Software

www.geongrid.org


Database software l.jpg

Postgres supercomputer

Relational Database

Hosts Gridsphere portal database

Version 8.0.3

PostGIS

GIS extensions for Postgres

Version 1.0.2

Geos & Proj

Dependencies for PostGIS

Database Software

www.geongrid.org


Portal software l.jpg
Portal Software supercomputer

  • GridSphere

    • Set of standard GEON services

    • Framework to develop and deploy standard portlet applications

    • Get familiar with portal development

    • Configured to use Postgres

    • Includes GAMA portlets, configured to talk to GEON GAMA server

    • Version 2.0.2

www.geongrid.org


Monitoring software l.jpg

INCA supercomputer

Test harness and reporting framework

SDSC PoP runs INCA Depot

All GEON partner site PoP’s run reporters

Monitoring Software

www.geongrid.org


Monitoring software30 l.jpg

Network Weather Service (NWS) supercomputer

Monitor and forecast performance of network and computational resources

Name server and Memory server runs on SDSC PoP

Version 2.10.1

Monitoring Software

www.geongrid.org


System software l.jpg

Tripwire supercomputer

Utilities to analyze the integrity of files and the kernel.

Mail daily/weekly reports to tripwire@geongrid.org

Use Rocks Tripwire Roll

Samba

Allows access & sharing services between Linux/Unix server and windows clients

System Software

www.geongrid.org


Hpc software l.jpg

Develop and deploy mechanisms and policies that support HPC on grid computing resources.

Using Rocks Condor, PBS roll

Used for compute clusters

HPC Software

www.geongrid.org


Next steps l.jpg

Package GEON portal and release a basic edition, standard edition, professional edition, etc.

Next Steps

www.geongrid.org


Acknowledgements l.jpg

GEON Team edition, professional edition, etc.

Grid-Devel Group

Rocks Group

University of Auckland

BeSTGRID

Acknowledgements

www.geongrid.org


Questions or feedback l.jpg

Mail: edition, professional edition, etc.systems@geongrid.org

Questions or Feedback?

www.geongrid.org


ad
  • Login