Futuregrid
Download
1 / 17

FutureGrid - PowerPoint PPT Presentation


  • 111 Views
  • Uploaded on

FutureGrid. Cyberinfrastructure for Computational Research. FutureGrid Goals. An environment that can be used for middleware developers to develop and test middleware

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' FutureGrid' - fell


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Futuregrid
FutureGrid

Cyberinfrastructure for Computational Research


Futuregrid goals
FutureGrid Goals

An environment that can be used for middleware developers to develop and test middleware

An environment that can instantiate a wide variety of computing environments (ranging from current TeraGrid software, VMs, cloud, grid systems other than TG) for development and testing of applications on experimental basis in a test bed, in replicable ways

Education related to all of the above

US Industry research related to the above


Futuregrid components
FutureGrid Components

Compute – flexible deployment of images, VM's, clouds

Storage – local storage sufficient to facilitate projects, Lustre for larger projects

Network – Dedicated networks between FutureGrid sites, Impairment Device



Storage Hardware

  • FutureGrid has a dedicated network (except to TACC) and a network fault and delay generator

  • Experiments can be isolated by request

  • Additional partner machines may run FutureGrid software and be supported (but allocated in specialized ways)



Network Impairments Device

  • Spirent XGEM Network Impairments Simulator for jitter, errors, delay, etc

  • Full Bidirectional 10G w/64 byte packets

  • up to 15 seconds introduced delay (in 16ns increments)

  • 0-100% introduced packet loss in .0001% increments

  • Packet manipulation in first 2000 bytes

  • up to 16k frame size

  • TCL for scripting, HTML for manual configuration



FutureGrid Architecture

  • Open Architecture allows to configure resources based on images

  • Managed images allows to create similar experiment environments

  • Experiment management allows reproducible activities

  • Through our modular design we allow different clouds and images to be “rained” upon hardware.

  • Will support deployment of preconfigured middleware including TeraGrid stack, Condor, BOINC, gLite, Unicore, Genesis II


Software Goals

  • Open-source, integrated suite of software to

    • instantiate and execute grid and cloud experiments.

    • perform an experiment

    • collect the results

    • tools for instantiating a test environment

      • TORQUE, Moab, xCAT, bcfg, and Pegasus, Inca, ViNE, a number of other tools from our partners and the open source community

      • Portal for interacting with tools

    • Benchmarking

08/25/10

http://futuregrid.org

10


Draft GUI for FutureGrid Dynamic Provisioning


Command line

  • fg-deploy-image

    • host name

    • image name

    • start time

    • end time

    • label name

  • fg-add

    • label name

    • framework hadoop

    • version 1.0

  • Deploys an image on a host

  • Adds a feature to a deployed image

08/25/10

http://futuregrid.org

12


FG Stratosphere

  • Objective

    • Higher than a particular cloud

    • Provides all mechanisms to provision a cloud on a given FG hardware

    • Allows the management of reproducible experiments

    • Allows monitoring of the environment and the results

  • Risks

    • Lots of software

    • Possible multiple path to do the same thing

  • Good news

    • We worked in a team, know about different solutions and have identified a very good plan

    • We can componentize Stratosphere

08/25/10

http://futuregrid.org

13


Dynamic Provisioning

  • Change underlying system to support current user demands

  • Linux, Windows, Xen/KVM, Nimbus, Eucalyptus

  • Stateless images

    • Shorter boot times

    • Easier to maintain

  • Stateful installs

    • Windows

  • Use Moab to trigger changes and xCAT to manage installs

08/25/10

http://futuregrid.org

14


Experiment Manager

  • Objective

    • Manage the provisioning for reproducible experiments

    • Coordinate workflow of experiments

    • Share workflow and experiment images

    • Minimize space through reuse

08/25/10

http://futuregrid.org

15


Getting started with futuregrid
Getting started with FutureGrid

www.futuregrid.org

Account/Project request

Nimbus/Eucalyptus account for those systems, if needed

Getting started information at www.futuregrid.org/tutorials

Mail [email protected] for any issues


Acknowledgements

  • FutureGrid - http://www.futuregrid.org/

  • NSF Award OCI-0910812

  • NSF Solicitation 08-573

    • http://www.nsf.gov/pubs/2008/nsf08573/nsf08573.htm

  • ViNe - http://vine.acis.ufl.edu/

  • Nimbus - http://www.nimbusproject.org/

  • Eucalyptus - http://www.eucalyptus.com/

  • VAMPIR - http://www.vampir.eu/

  • Pegasus - http://pegasus.isi.edu/


ad