Cloud Computing and RESERVOIR project CSFI 2008 30 May 2008

1. Resources and Services Virtualizationwithout Barriershttp://www.reservoir-fp7.eu Cloud Computing and RESERVOIR projectCSFI 200830 May 2008 Author: Stefano Beco (stefano.beco@elsagdatamat.com) The research leading to these results has received funding from the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 215605.

2. Outline • Introduction to Cloud Computing • Introduction to RESERVOIR • The Service Oriented Infrastructure Equation • RESERVOIR challenges • Conclusions Cloud Computing and RESERVOIR project

3. Just to start… “Five computers” • "I think there is a world market for about five computers" — Remark attributed to Thomas J. Watson (Chairman of the Board of International Business Machines) – 1943 Cloud Computing and RESERVOIR project

4. Cloud computing • Cloud computing is an information technology infrastructure in which computing resources are virtualized and accessed as a service. • "Cloud" will be a grand buzzword unifier in IT for the next months: utility computing, grid computing, software-as-a-service, and many other scalable remote computing models will get linked to cloud computing. Cloud Computing and RESERVOIR project

5. Cloud computing • As “Could computing” seems to be “anything anywhere”, shouldn’t we focus more on “Cloud business” instead? • “Technology vendors will deliver cloud infrastructure, but those details must be linked for us all, or 'the cloud' will just be nothing more than a buzz-word… We can't spend all of our time arguing about how to implement the cloud and almost no time talking about whether our business can fit the cloud model.” Daryl Plummer, Gartner Group Vice President, Gartner Fellow Cloud Computing and RESERVOIR project

6. So… Five computers! • "I think there is a world market for about five computers" — Remark attributed to Thomas J. Watson (Chairman of the Board of International Business Machines) – 1943 • “… In a sense, says Yahoo Research Chief Prabhakar Raghavan, there are only five computers on earth. He lists Google, Yahoo, Microsoft, IBM, and Amazon. Few others, he says, can turn electricity into computing power with comparable efficiency …” FromGoogle and the wisdom of clouds, by Steven Baker - BusinessWeek.com Cloud Computing and RESERVOIR project

7. RESERVOIR Motivation The research leading to these results has received funding from the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 215605. • Service-Oriented economy is at our door • Services over the Internet are winning in the market • Consumers use YouTube, eBay, Amazon, Second Life… • SMEs use hosted Microsoft Exchange, Salesforce.com • Enterprises routinely rely on remote IT outsourcing • Services reduce complexity and cost • Service-Oriented Economy requires Service-Oriented Infrastructure Cloud Computing and RESERVOIR project

8. RESERVOIR Vision • The Next Generation Infrastructure for Service Delivery • Provide revolutionary foundation for a new European infrastructure where resources and services can be transparently and dynamically managed, provisioned and relocated like utilities – virtually “without borders” • No single facility/provider can create a seemingly infinite infrastructure capable of serving massive amounts of users at all times, from all locations • Federation of clouds • Leverage the diversity factor to achieve economies of scale • Leverage locality • Analogies exists in areas outside IT services • Electrical power delivery: capacity can be shifted to guarantee supply and lower costs • Roaming cellular communications: talk wherever you are • Enable utility-like deployment of services, relieving the service consumer from awareness of the IT attributes while assuring QoS and security Cloud Computing and RESERVOIR project

9. Virtualization - Aware Grid Grid - Aware Virtualization BSM = SOI e . g . , VM usage / size as the unit e . g . , live migration across e . g . , policy - based management for metering and billing administrative domains of service - level agreement The Service Oriented Infrastructure (SOI) Equation • Integration of virtualization technologies with grid computing driven by new techniques for business service management + + Cloud Computing and RESERVOIR project

10. SOI: Grid Computing Grid node or Service Site Physical Resources Service Tasks Cloud Computing and RESERVOIR project

11. SOI: Grid Computing + Virtualization Virtual Execution Environment (VEE) Improved isolation, Relax dependencies, Well defined billing units Cloud Computing and RESERVOIR project

12. SOI: Grid Computing + Virtualization + BSM Policy 1: If possible keep VEEs fromthe same organization in the same physical box Cloud Computing and RESERVOIR project

13. SOI: Grid Computing + Virtualization + BSM Policy 1: If possible keep VEEs fromthe same organization in the same physical box Policy 2: Turn off underutilized physical boxes Cloud Computing and RESERVOIR project

14. SOI: Grid Computing + Virtualization + BSM Policy 1: If possible keep VEEs fromthe same organization in the same physical box Policy 2: Turn off underutilized physical boxes Local optimizations (within a single site): placement, power, etc. Cloud Computing and RESERVOIR project

15. SOI: Grid Computing + Virtualization + BSM - Boundaries Policy 3: If possible keep VEEs in “owning” organization Cloud Computing and RESERVOIR project

16. SOI: Grid Computing + Virtualization + BSM - Boundaries Policy 3: If possible keep VEEs in “owning” organization Policy 4: If possible keep VEEs in least number of external organizations Cloud Computing and RESERVOIR project

17. SOI: Grid Computing + Virtualization + BSM - Boundaries Policy 3: If possible keep VEEs in “owning” organization Policy 4: If possible keep VEEs in least number of external organizations Migration across sites  Global optimizations: placement, cost, etc. Cloud Computing and RESERVOIR project

18. SOI: Grid Computing + Virtualization + BSM - Boundaries Policy 5: “Follow” your customer Cloud Computing and RESERVOIR project

19. … - Boundaries  Virtualize the Network … Create virtual networks connecting VEEs regardless of physical server location Cloud Computing and RESERVOIR project

20. … - Boundaries  ... and the Storage Enable secure access to relevant data regardless of storage location Cloud Computing and RESERVOIR project

21. … - Boundaries  ... and the Storage “… Unfortunately, at least to date, the methods used to achieve these goals in today’s commercial cloudshave not been open and general purpose, but instead been mostly proprietary and specialized for the specific internal uses (e.g., large-scale data analysis) of the companies that developed them. The idea that we might want to enable interoperability between providers (as in the electric power grid) has not yet surfaced. Grid technologies and protocols speak precisely to these issues, and should be considered…” “…will move towards a mix of microproduction and large utilities, with increasing numbers of small-scale producers (wind, solar, biomass, etc., for energy; for computing, local clusters and embedded processors—in shoes and walls?) co-existing with large-scale regional producers, and load being distributed among them dynamically …” “ … In building this distributed “cloud” or “grid” (“groud”?), we will need to support on-demand provisioning and configuration of integrated “virtual systems” providing the precise capabilities needed by an end-user … We will need the centralized scale of today’s cloud utilities, and the distribution and interoperability of today’s grid facilities…” From There’s Grid in then thar Clouds - Ian Foster Enable secure access to relevant data regardless of storage location Cloud Computing and RESERVOIR project

22. RESERVOIR Challenges • The RESERVOIR envisioned highly dynamic and cooperative infrastructure relies on: • A service definition language that captures in a high level language the functional and infrastructure requirements of the service (including servers, images, network, storage, inter-tier relations and QoS requirements) • An abstraction layer that separates implementation details from the high level automation system that is responsible for the provisioning, monitoring and reallocation of resources • Inter-domain protocols that enable multiple management sites to cooperate in providing a single service, where the cooperation is automatically driven from a service definition document (fully automated cross-domains SLA management) • The capability of creating fully isolated virtual organizations spread across geographies and management domains • The flexibility of placing and relocating service instances on resources anywhere even across geographies and management domains Cloud Computing and RESERVOIR project

23. Value Chain Service Admin. Service End-user Service Consumer User Layer Service Manager Service Service Layer Service Provider Infrastructure Provider Virtual Execution Environment Management System Virtualization Layer Physical Layer Grid Site RESERVOIR from 10000 feet Cloud Computing and RESERVOIR project

24. Conclusions • Cloud computing is the top of “virtualization-as-a-service” concept! • “Grid” is (finally!) becoming an appliance, a commodity • “Cloud” targets to “anything anywhere” and “when you like” • Caveat! Don’t forget about “cloud business” when creating “cloud technology”! • RESERVOIR aims at Next-Generation Infrastructure for Service Delivery • Virtualization-aware Grid + Grid-aware virtualization + Business Service Management = Service Oriented Infrastructure • Resources and services must be transparently and dynamically managed, provisioned and relocated virtually “without borders”, in order to actually realize the utility computing paradigm in commercial scenarios • Security, scalability, availability, reliability, cost efficiency, data intensive, mobility, personalization Cloud Computing and RESERVOIR project

25. One Cloud a “Take Home” message:Five computers? • "I think there is a world market for about five computers" — Remark attributed to Thomas J. Watson (Chairman of the Board of International Business Machines) – 1943 • “… In a sense, says Yahoo Research Chief Prabhakar Raghavan, there are only five computers on earth. He lists Google, Yahoo, Microsoft, IBM, and Amazon. Few others, he says, can turn electricity into computing power with comparable efficiency …” FromGoogle and the wisdom of clouds, by Steven Baker - BusinessWeek.com • “… The World Wide Web is becoming one vast, programmable machine. As NYU's Clay Shirky likes to say, Watson was off by four …” – Nicholas Carr From Wired Magazine Q&A with Nicholas Carr Cloud Computing and RESERVOIR project

26. Resources and Services Virtualizationwithout Barriershttp://www.reservoir-fp7.eu Cloud Computing and RESERVOIR projectCSFI 200830 May 2008 Thanks!! Author: Stefano Beco (stefano.beco@elsagdatamat.com) The research leading to these results has received funding from the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 215605.