Introduction to Cloud Computing

1. Introduction toCloud Computing Alexandru Iosup Parallel and Distributed Systems GroupDelft University of TechnologyThe Netherlands Our team: Undergrad Thomas de Ruiter, Anand Sawant, Ruben Verboon, … Grad Siqi Shen, Guo Yong, Nezih Yigitbasi Staff Henk Sips, Dick Epema, Alexandru Iosup, Otto Visser Collaborators Ion Stoica and the Mesos team (UC Berkeley), Thomas Fahringer, Radu Prodan, Vlad Nae (U. Innsbruck), Nicolae Tapus, Mihaela Balint, Vlad Posea (UPB), Derrick Kondo, Emmanuel Jeannot (INRIA), Assaf Schuster, Mark Silberstein, Orna Ben-Yehuda (Technion), ... SPEC RG Cloud Meeting

4. What is Cloud Computing?3. A Useful IT Service “Use only when you want! Pay only for what you use!” Q: What do you use? Q: Why not this level? Q: Why not this level?

5. Agenda • What is Cloud Computing? • IaaS Clouds, the Core Idea • The IaaS Owner Perspective • The IaaS User Perspective • Reality Check • Conclusion

6. IaaS Cloud Computing VENI – @larGe: Massivizing Online Games using Cloud Computing

7. Joe Has an Idea ($$$) MusicWave (Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: A. Iosup, 2011.)

8. 10% … Solution #1 Buy or Rent • Big up-front commitment • Load variability: NOT supported (Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: A. Iosup, 2011.)

9. Solution #2 • NO big up-front commitment • Load variability: supported Deploy on IaaS Cloud Q: So are we just shifting the problem to somebody else, that is, the IaaS cloud owner? (Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: V. Nae, 2008.)

10. Inside an IaaS Cloud Data Center (Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: A. Iosup, 2011.)

11. User C User B MusicWave Time and Cost Sharing Among Users (Source: A. Antoniou, MSc Defense, TU Delft, 2012.)

12. Main Characteristics of IaaS Clouds • On-Demand Pay-per-Use • Elasticity (cloud concept of Scalability) • Resource Pooling • Fully automated IT services • Quality of Service

13. Agenda • What is Cloud Computing? • IaaS Clouds, the Core Idea • The IaaS Owner Perspective:How to Deploy a Cloud? • The IaaS User Perspective • Reality Check • Conclusion

14. IaaS Cloud Deployment Models Private On-premises Public Off-premises Hybrid (Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: Mell and Grance, NIST Spec.Pub. 800-145, Sep 2011.)

15. Resource Sharing Models Grids IaaS Clouds Space-Sharing Time-Sharing Q: Which one is better? MusicWave MusicWave MusicWave OtherApp OtherApp OtherApp Host OS Host OS

16. Virtualization Applications Applications Guest OS Guest OS Q: What is the problem? Virtual Resources Virtual Resources Q: What to do now? MusicWave OtherApp OtherApp VM Instance VM Instance Virtualization Host OS

17. Virtualization and The Full IaaS Stack Applications Applications Applications Guest OS Guest OS Guest OS Virtual Resources Virtual Resources Virtual Resources VM Instance VM Instance VM Instance Virtual Machine Manager Virtual Machine Manager Virtual Infrastructure Manager Physical Infrastructure

18. The Virtual Machine Lifecycle Q: Is this fair? (Source: A. Antoniou, MSc Defense, TU Delft, 2012.)

19. Use Case: Amazon Elastic Compute Cloud (EC2) • Prominent IaaS provider • Datacenters all over the world • Many VM instance types • Per-hour charging

20. Agenda • What is Cloud Computing? • IaaS Clouds, the Core Idea • The IaaS Owner Perspective • The IaaS User Perspective:How to Use Clouds? How to Choose Clouds? • Reality Check • Conclusion

21. Workload MusicWave OtherApp OtherApp OtherApp Load = 4 OtherApp MusicWave Time RunTime= 6

22. Sources: CNN, Zynga. Source: InsideSocialGames.com Use Case: Workloads of Zynga (Massively Social Gaming) Selling in-game virtual goods: “Zynga made est. $270M in 2009 from.”http://techcrunch.com/2010/05/03/zynga-revenue/ “Zynga made more than $600M in 2010 from selling in-game virtual goods.”S. Greengard, CACM, Apr 2011

23. Use Case: Workloads of Zynga (Massively Social Gaming) • Load can grow very quickly Load

24. Provisioning and Allocation of Resources Provisioning Allocation Load Time

25. Provisioning and Allocation of Resources Q: What is the interplay between provisioning and allocation? Provisioning Allocation Load Time

26. Provisioning and Allocation Policies Q:How many policies exist? Q: How to select a policy? Provisioning Allocation When? From where? When? Where? How many? etc. Load Which type? etc. Time (Source: A. Antoniou, MSc Defense, TU Delft, 2012.)

27. Use Case:Two Provisioning Policies, Compared Startup OnDemand Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and Allocation Policies for Infrastructure-as-a-Service Clouds, (submitted). PDS Tech.Rep.2011-009

28. Use Case:Two Provisioning Policies, Compared Metrics for comparison • Job Slowdown (JSD ): Ratio of actual runtime in the cloud and the runtime in a dedicated non-virtualized environment • Charged Cost (Cc) • Utility (U) Q: Charged cost vs Total RunTime? Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and Allocation Policies for Infrastructure-as-a-Service Clouds, (submitted). PDS Tech.Rep.2011-009

29. Use Case:Two Provisioning Policies, Compared Workloads Increasing Bursty Uniform Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and Allocation Policies for Infrastructure-as-a-Service Clouds, (submitted). PDS Tech.Rep.2011-009

30. Use Case:Two Provisioning Policies, Compared Environments Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and Allocation Policies for Infrastructure-as-a-Service Clouds, (submitted). PDS Tech.Rep.2011-009

31. Use Case:Many Provisioning Policies, Compared Job Slowdown (JSD) Q: Why is OnDemand worse than Startup? A:waiting for machines to boot

32. Use Case:Many Provisioning Policies, Compared Charged Cost (Cc) Q: Why is OnDemand worse than Startup? A:VM thrashing Q: Why no OnDemand on Amazon EC2?

33. Use Case:Many Provisioning Policies, Compared Utility (U)

34. Agenda • What is Cloud Computing? • IaaS Clouds, the Core Idea • The IaaS Owner Perspective • The IaaS User Perspective • Reality Check: Who Uses Public Commercial Clouds? • Conclusion

35. The Real IaaS Cloud “The path to abundance” On-demand capacity Cheap for short-term tasks Great for web apps (EIP, web crawl, DB ops, I/O) VS Tropical Cyclone Nargis (NASA, ISSS, 04/29/08) http://www.flickr.com/photos/dimitrisotiropoulos/4204766418/ • “The killer cyclone” • Not so great performance for scientific applications (compute- or data-intensive) August 24, 2014 35

36. (Source: http://www.cca08.org/files/slides/w_vogel.pdf)

37. Zynga zCloud: Hybrid Self-Hosted/EC2 • After Zynga had large scale • More efficient self-hosted servers • Run at high utilization • Use EC2 for unexpected demand (Sources: http://seekingalpha.com/article/609141-how-amazon-s-aws-can-attract-ugly-economics and http://www.undertheradarblog.com/blog/3-reasons-zynga-is-moving-to-a-private-cloud/)

38. Other Cloud Customers • 218 virtual CPUs • 9TB/2TB block/S3 storage • 6.5TB/2TB I/O per month (Source: http://markbuhagiar.com/technical/businessinthecloud/)

39. Agenda • What is Cloud Computing? • IaaS Clouds, the Core Idea • The IaaS Owner Perspective • The IaaS User Perspective • Reality Check • Conclusion

40. Conclusion Take-Home Message • Cloud Computing = IaaS + PaaS + SaaS • Core idea = lease vs self-own • On-Demand, Pay-per-Use, Elastic, Pooled, Automated, QoS • The Owner Perspective • Time-Sharing • Virtualization • The User Perspective • Variable workloads • Provisioning and Allocation policies • Reality Check: 100s of users http://www.flickr.com/photos/dimitrisotiropoulos/4204766418/

41. Thank you for your attention! Questions? Suggestions? Observations? More Info: Alexandru IosupA.Iosup@tudelft.nlhttp://www.pds.ewi.tudelft.nl/~iosup/ (or google “iosup”)Parallel and Distributed Systems GroupDelft University of Technology • http://www.st.ewi.tudelft.nl/~iosup/research.html • http://www.st.ewi.tudelft.nl/~iosup/research_cloud.html • http://www.pds.ewi.tudelft.nl/ Do not hesitate to contact me…