High performance cyberinfrastructure discovery tools for data intensive research
Download
1 / 18

High Performance Cyberinfrastructure Discovery Tools for Data Intensive Research - PowerPoint PPT Presentation


  • 113 Views
  • Uploaded on

High Performance Cyberinfrastructure Discovery Tools for Data Intensive Research. Larry Smarr Prof. Computer Science and Engineering Director, Calit2 (UC San Diego/UC Irvine). Abstract.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'High Performance Cyberinfrastructure Discovery Tools for Data Intensive Research' - emory


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
High performance cyberinfrastructure discovery tools for data intensive research

High Performance Cyberinfrastructure Discovery Tools for Data Intensive Research

Larry Smarr

Prof. Computer Science and Engineering

Director, Calit2 (UC San Diego/UC Irvine)


Abstract
Abstract

High performance cyberinfrastructure (10Gbps dedicated optical channels end-to-end) enable new levels of discovery for data-intensive research projects. I will use several different examples of large data projects drawn from cosmological simulations, ocean observing, and microbial metagenomics. I will discuss why local campus high performance clouds are essential for this sort of work in academia--as a high bandwidth, high I/O fast storage, large RAM compute augmentation to the remote commercial cloud.


Dedicated 10 000mbps 10gbps supernetworks enable remote visual analysis of big data
Dedicated 10,000Mbps (10Gbps) SupernetworksEnable Remote Visual Analysis of Big Data

Also

NLR 80 x 10Gb Wavelengths


Nsf s optiputer project using supernetworks to meet the needs of data intensive researchers
NSF’s OptIPuter Project: Using Supernetworksto Meet the Needs of Data-Intensive Researchers

OptIPortal– Termination Device for the OptIPuter 10Gbps Backplane


Exploring cosmology with supercomputers supernetworks and supervisualization

Supercomputer Output

148 TB Movie Output (0.25 TB/file)

80 TB Diagnostic Dumps (8 TB/file)

Connected at 10Gbps

Oak Ridge to ANL to SDSC

Intergalactic Medium on 2 Billion Light Year Scale

Exploring Cosmology With Supercomputers, Supernetworks, and Supervisualization

Science: Norman, Harkness, Paschos SDSC

Visualization: Insley, ANL; Wagner SDSC

ANL * Calit2 * LBNL * NICS * ORNL * SDSC


Providing end to end 10gbps cyberinfrastructure for petascale end users
Providing End-to-End 10Gbps Cyberinfrastructure for Petascale End Users

log of gas temperature log of gas density

Mike Norman, SDSC

Analyzing Super Data


Calit2 microbial metagenomics cluster next generation optically linked science data server
Calit2 Microbial Metagenomics Cluster-Next Generation Optically Linked Science Data Server

Source: Phil Papadopoulos, SDSC, Calit2

512 Processors

~5 Teraflops

~ 200 Terabytes Storage

Nearly 4000 Users

Over 75 Countries


Using 10 gbps big data access and analysis collaboration between calit2 and u washington
Using 10 Gbps Big Data Access and Analysis-Collaboration Between Calit2 and U Washington

Ginger Armbrust’s Diatom Chromosomes

Photo Credit: Alan Decker

Feb. 29, 2008

iHDTV: 1500 Mbits/sec Calit2 to UW Research Channel Over NLR


High performance cyberinfrastructure discovery tools for data intensive research
MIT’s Ed Between Calit2 and U WashingtonDeLong & Darwin Project Team Using OptIPortal to Analyze 10km Coupled Ocean Microbial Simulation


The nsf funded ocean observatory initiative a complex system of systems cyberinfrastructure
The NSF-Funded Ocean Observatory Initiative– a Complex System of Systems Cyberinfrastructure

Source: Matthew Arrott, Calit2 Program Manager for OOI CI


Taking sensornets to the ocean floor remote interactive hd imaging of deep sea vent

1 cm. System of Systems Cyberinfrastructure

Taking Sensornets to the Ocean Floor:Remote Interactive HD Imaging of Deep Sea Vent

Source: John Delaney and Research Channel, U Washington


Nsf ooi is a 400m program ooi ci is 34m part of ooi
NSF OOI is a $400M Program System of Systems Cyberinfrastructure-OOI CI is $34M Part of OOI

Source: Matthew Arrott, Calit2 Program Manager for OOI CI

30-40 Software Engineers

Housed at Calit2@UCSD


Ooi ci is built on national lambdarail s and internet2 s dcn optical infrastructure
OOI CI is Built on National System of Systems CyberinfrastructureLambdaRail’sand Internet2’s DCN Optical Infrastructure

Source: John Orcutt, Matthew Arrott, SIO/Calit2


High definition video connected optiportals virtual working spaces for data intensive research
High Definition Video Connected OptIPortals: System of Systems CyberinfrastructureVirtual Working Spaces for Data Intensive Research

Source: Falko Kuester, Kai Doerr Calit2; Michael Sims, NASA


Analyzing big data in 3d stereo the nexcave optiportal
Analyzing Big Data in 3D Stereo: System of Systems CyberinfrastructureThe NexCAVE OptIPortal

Source: Tom DeFanti, Calit2@UCSD


High performance cyberinfrastructure discovery tools for data intensive research

“Blueprint for the Digital University”--Report of the UCSD Research Cyberinfrastructure Design Teamresearch.ucsd.edu/documents/rcidt/RCIDTReportFinal2009.pdf

CENIC, NLR, I2DCN

N x 10Gbe

April 24, 2009

DataOasis(Central) Storage

Gordon –

HPC System

Cluster Condo

Triton – Petadata Analysis

Scientific

Instruments

Digital Data Collections

Campus Lab Cluster

OptIPortal

Source: Philip Papadopoulos, SDSC, UCSD


California and washington universities are testing a 10gbps connected commercial data cloud
California and Washington Universities Are Testing UCSD Research Cyberinfrastructure Design Teama 10Gbps Connected Commercial Data Cloud

  • Amazon Experiment for Big Data

    • Only Available Through CENIC and Pacific NW GigaPOP

      • Private 10Gbps Peering Path

    • Includes Amazon Computing and Storage Services


You can download this presentation at lsmarr calit2 net
You Can Download This Presentation UCSD Research Cyberinfrastructure Design Teamat lsmarr.calit2.net