Webscale Computing
Download
1 / 45

Webscale Computing Mike Culver - PowerPoint PPT Presentation


  • 74 Views
  • Uploaded on

Webscale Computing Mike Culver. Amazon Web Services. Amazon Has Three Parts. 1. 3. 2. Ideas Meet Pagers. What if Gravity Sets In?. How Do You Survive This?. Don’t Do the Muck. What is Cloud Computing?. Remote computing capacity On-demand Infinite scale XML Web services.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Webscale Computing Mike Culver' - marrim


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

Webscale Computing

Mike Culver

Amazon Web Services







What is cloud computing
What is Cloud Computing?

  • Remote computing capacity

  • On-demand

  • Infinite scale

  • XML Web services


Fallacies of distributed computing
Fallacies of Distributed Computing

  • The network is reliable.

  • Latency is zero.

  • Bandwidth is infinite.

  • The network is secure.

  • Topology doesn't change.

  • There is one administrator.

  • Transport cost is zero.

  • The network is homogeneous.

Wikipedia.com


Bandwidth Consumed by

Amazon Web Services

Bandwidth Consumed by

Amazon’s Global Websites

2001

2002

2003

2004

2005

2006

2007

2008


Amazon web services are
Amazon Web Services Are...

Building block services that allow developers to innovate and make money

  • Infrastructure As a Service

    • Amazon Simple Storage Service

    • Amazon Elastic Compute Cloud

    • Amazon Simple Queue Service

    • Amazon SimpleDB

  • Commerce As a Service

    • Amazon Flexible Payments Service

    • Fulfillment Web Service

  • People As a Service

    • Amazon Mechanical Turk

  • AlexaWeb Services

    • Alexa Web Information Service

    • Alexa Top Sites

    • Alexa Site Thumbnail

    • Alexa Web Search Platform


Amazon simple storage service amazon s3
Amazon Simple Storage Service (Amazon S3)

Highly scalable data storage in-the-cloud

Programmatic access via web services API

Simple to get going, simple to use

Highly available and durable

Pay-as-you-go:

Storage: $0.15 / GB / month

Data Transfer: starts at $0.17 / GB

Requests: nominal charges


Billions of objects stored
Billions of Objects Stored

22 Billion

18 Billion

14 Billion

10 Billion

5 Billion

.8 Billion

Q2 07

Q4 07

Q1 08

Q2 08

Q3 06

Q1 07


Amazon s3 namespace
Amazon S3 Namespace

Amazon S3

bucket

bucket

object

object

object

object

bucket

object

object


Amazon s3 namespace1
Amazon S3 Namespace

Amazon S3

mculver-images

media.mydomain.com

Beach.jpg

2005/party/hat.jpg

img1.jpg

img2.jpg

public.blueorigin.com

index.html

img/pic1.jpg


Internet backup on a stick or stick backed up on the net
Internet Backup on a StickOr Stick Backed Up on the Net?




Amazon elastic compute cloud amazon ec2
Amazon Elastic Compute Cloud(Amazon EC2)

  • Resizable compute capacity in the cloud

    • Obtain and boot new server instances in minutes

    • Quickly scale capacity, up or down, as your computing requirements change

  • Full root access to a blank Linux machine

  • Simple Web service management interface

  • Changes the economics of computing


Predictions cost money
Predictions Cost Money

Infrastructure

Cost $

You just lost

customers

Large

Capital

Expenditure

Predicted

Demand

Opportunity

Cost

Traditional

Hardware

Actual

Demand

Automated

Virtualization

time


Resilient infrastructure requires physical isolation
Resilient Infrastructure Requires Physical Isolation

Availability Zone A

Availability Zone B

EC2

EC2

EC2

EC2

EC2

EC2

Availability Zone C

EC2

EC2

EC2


Three flavors of amazon machine images
Three Flavors of Amazon Machine Images

  • Public AMIs: Use pre-configured, template AMIs to get up and running immediately. Choose from Fedora, Movable Type, Ubuntu configurations, and more

  • Private AMIs: Create an Amazon Machine Image (AMI) containing your applications, libraries, data and associated configuration settings

  • Paid AMIs: Set a price for your AMI and let others purchase and use it (Single payment and/or per hour)



5 or 30 000 for a prototype
$5 or $30,000 For a Prototype?

$30,000 worth of in-house servers

DISA paid a total of $5




4 TB Data

100 Nodes

11 Million PDFs

100 instances

x 24 hours

x $0.10 / Hr

= $240



Amazon simple queue service amazon sqs
Amazon Simple Queue Service(Amazon SQS)

A distributed queue in the cloud

Used for storing messages traveling between computers

Reliable

Runs within Amazon's high-availability data centers

Messages are stored redundantly across multiple servers and locations

Scalable to millions of messages a day

Simple: Only 6 methods

Platform agnostic

Provides access control and message locking


Amazon simpledb limited beta

Amazon SimpleDBLimited Beta


Databases should just work but they d better scale
Databases Should Just WorkBut They’d Better Scale…

  • Easy: no administration

  • Web Service API

  • Flexible (no schemas)

  • Scalable: create new domains as

    • Your data grows

    • Request throughput increases

  • Durable

    • Multiple nodes

    • Replicated data centers


Amazon simpledb
Amazon SimpleDB

PUT (item, 123), (description, Sweater), (color, Blue), (color, Red)

PUT (item, 456), (description, Dress shirt), (color, White), (color, Blue)

PUT (item, 789), (description, Shoes), (color, Black), (material, Leather)

Query

Domain = MyStore

[‘description’ = ‘Sweater’]


Learn more about aws
Learn More About AWS

  • Explore http://aws.amazon.com

  • Read our blog at http://aws.typepad.com

  • Email me at [email protected]



ad