qcloud n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
QCloud PowerPoint Presentation
Download Presentation
QCloud

Loading in 2 Seconds...

play fullscreen
1 / 23

QCloud - PowerPoint PPT Presentation


  • 173 Views
  • Uploaded on

QCloud. Queensland Cloud Data Storage and Services 27Mar2012. NATIONAL RDSI. 6 primary, 4 additional nodes 150-200 PB by 2014 100Gb/sec node interconnect Storage for large national collections Shared access by research communities Research data management On-shore data cloud

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'QCloud' - kalkin


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
qcloud

QCloud

Queensland Cloud Data Storage and Services

27Mar2012

QCloud

national rdsi
NATIONAL RDSI
  • 6 primary, 4 additional nodes
  • 150-200 PB by 2014
  • 100Gb/sec node interconnect
  • Storage for large national collections
  • Shared access by research communities
  • Research data management
  • On-shore data cloud
  • Low-cost research production quality of service

QCloud

national nectar research cloud
NATIONAL NeCTAR RESEARCH CLOUD
  • 6 primary nodes (maybe 7)
  • 24,000 cores by 2013
  • On-demand compute capacity for research
  • Hosted shared services for research communities
  • Virtual laboratories
  • Research tools, workflows

Uni of Melbourne

QCIF/UQ

ANU

MonashUni

QCloud

qcloud components
QCLOUD COMPONENTS

NeCTAR

RESEARCH CLOUD

RDSI

DATASTORE

>15x

QERN CLOUD

5x

GENOMICS CLOUD

QCloud

queensland rdsi nodes
QUEENSLAND RDSI NODES
  • ~ 30 Petabytes by 2014
  • Primary node hosted at UQ (embargoed)
  • Additional Node at JCU (awaiting decision)
  • National focus: ecosystems, genomics

75% Merit Allocated Collections

25% “CollectionDevelopment”

Can add RDSI+ commercial research storage

QCloud

collections
COLLECTIONS

Market Data Collections

Active research projects

Collaborations across multiple locations

Fast disk, flash memory – immediate access

Vault Data Collections

Rarely accessed data archival storage

Broad availability

Tape, slow disk

QCloud

rdsi node services
RDSI NODE SERVICES

OWNER

Qualification

Capture

Ingest

Bulk Update

Curation

Metadata (with ANDS)

Resilience (multiple copies)

Management

Entitlements to Access

Monitoring

Support, Help Desk, Training

USER

Entitlements to Access

Discovery

Read

Update

Duplicate

Monitoring

Support, Help Desk, Training

RESEARCH COMMUNITY

QCloud

target research users services
TARGET RESEARCH USERS/SERVICES

POWER USERS

PB-scale data collections

Low-level access services

Specialised treatment

DATA COLLECTION SIZE

LARGE DATA USERS

TB-scale data collections

Direct data access, FTP

Automated allocations

LONG-TAIL USERS

GB-scale data collections

Cloud access

Dropbox style on PC

Little allocation surveillance

NUMBER OF USERS

QCloud

qcif uq nectar node
QCIF/UQ NeCTAR NODE
  • 4,000 cores, up to 4,000 virtual machines
  • Research service quaility
  • 70% for NeCTAR Allocated Services
  • 30% for Queensland Allocation

QCloud

services
SERVICES

COMPUTATION

On-demand virtual machines

Off-load “small” jobs from HPC/clusters

HOSTED SERVICES

Permanent web sites

Research communities

Virtual laboratories

Research tools

Collaboration

QCloud

compute users services
COMPUTE USERS/SERVICES

Tier 1,2,3 HPC

More than 16 cores

Specialised treatment

NUMBER OF CORES REQUIRED

MEDIUM COMPUTE USERS

4-16 cores

Large memory VMs (1TB+)

Automated allocations

Smaller HPC jobs

LONG-TAIL USERS

HOSTED SERVICES

1-4 cores

Small HPC jobs

NUMBER OF USERS

QCloud

early node qern
EARLY NODE (QERN)
  • pQERN
    • Operational October 2011
    • Pre-RDSI/NeCTAR
    • Genomics++
  • QERN
    • Delivered February
    • Operational ~April
    • 330 cores
    • 0.5 PB disk
    • RDSI/NeCTAR services
    • Early adopter researchers
    • Operational experience

QCloud

projected node scale up
PROJECTED NODE SCALE-UP

PB

30

20

10

0

Cores

4000

3000

2000

1000

0

NeCTAR Research Cloud

RDSI Data Storage

Today, QERN

2011 2012 2013 2014

QCloud

participant roles
PARTICIPANT ROLES

NeCTARLead Agent

RDSI Lead Agent

Collection & Service Owners & Users

QCIF Governance, Management, Research Support

JCUManagement, Operations

UQ RCCManagement, SysAdmin

PartnersResearch Support

UQ ITSAcquisition, Operations

QCloud

qern progress
QERN Progress

Mid Feb

QCloud

qcloud partners
QCLOUD PARTNERS
  • QCIF
  • UQ
  • JCU
  • CQU
  • Griffith
  • QUT
  • USQ
  • USC
  • Bond
  • CSIRO
  • NICTA
  • TERN
  • DERM
  • DTMR
  • DEEDI
  • Ergon Energy

QCloud

risk management qcif
RISK MANAGEMENT – QCIF
  • Power upgrade at UQ DC2 (JCU also?)
    • Decision deferred to May
  • Transfer to new UQ data centre
    • PACE building offer replacing DC2 – network
  • Staff and skills availability
  • Software and skills maturity
  • Authentication, entitlements

QCloud

risk management national
RISK MANAGEMENT – NATIONAL
  • Levels of interaction: Lead Agents, other nodes
  • National support and help desk structure
  • RDSI ReDS and DaSh Programs

QCloud

risk management long term
RISK MANAGEMENT – LONG TERM
  • RDSI value proposition to researchers
  • Growth past 2014
  • Business model for sustainability
  • Commercial service quality

QCloud