1 / 100

Art Vandenberg Account Manager Customer Relations/Research

Georgia State University. Cloud Computing at Georgia State University CSc 4998 September 14, 2011. Art Vandenberg Account Manager Customer Relations/Research. Georgia State Strategic Plan http://www.gsu.edu/strategicplan/ President Becker Plan adopted Jan 2011.

elgin
Download Presentation

Art Vandenberg Account Manager Customer Relations/Research

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GeorgiaStateUniversity Cloud Computing at Georgia State University CSc 4998 September 14, 2011 Art Vandenberg Account Manager Customer Relations/Research A.Vandenberg

  2. Georgia State Strategic Plan http://www.gsu.edu/strategicplan/President BeckerPlan adopted Jan 2011 • Goal 1: Become a national model for undergraduate… demonstrating that students from all backgrounds can achieve academic and career success • Goal 2: Significantly strengthen and grow the base of distinctive graduate and professional programs A.Vandenberg

  3. Georgia State Strategic Plan • Goal 3: Become a leading public research university addressing the most challenging issues of the 21st century. • Goal 4: Be a leader in understanding the complex challenges of cities and developing effective solutions. • Goal 5: Achieve distinction in globalizing the University. A.Vandenberg

  4. Cloud Computing for Students • Dr. Yi Pan, computer science, is working with Information Systems & Technology on cloud computing solutions for campus. http://www.gsu.edu/news/46617.html • Open source Virtual Computing Lab is improving student computing options. https://cwiki.apache.org/VCL/ • Instead sitting in a computer lab, students can request "images” via a browser - from anywhere. • MATLAB, SAS, SPSS, Maple… - is available “in the cloud” A.Vandenberg

  5. Selecting Matlab2010a (or other options) using my browser…

  6. VCL Cloud advantages • Not just student impact (software available that students did not have before, convenience of working from anywhere, anytime) • But also lab impact (images, HW costs, SW costs, complexity, turnaround time) • AND, it can be faster! Initial results with Matlab indicate that VCL performs better than a standalone laptop (Lenovo Thinkpad,Intel Core 2 Duo, 1.9GHz, 2GB RAM) A.Vandenberg

  7. VCL as a way to address costs -Hardware/Software Cost Cycles: Requested vs. Funded • Ref: An Analysis of Full Cost Student Computing Labs and Potential for Virtual Computing Options, M. L. Russell, A. Vandenberg and N. Xiong, Poster, 3rd International Conference on the Virtual Computing Initiative, October 22-23, 2009, Research Triangle Park, NC. A.Vandenberg

  8. VCL Architecture • https://cwiki.apache.org/VCL/ A.Vandenberg

  9. ESM MM ESM OPM Small VCL Configuration • 1 BladeCenter E chassis • 2 Ethernet Switch Modules (BNT Layer 2/3 copper) • Power supplies 3&4 (for 7 or more blades) • Chassis network module to connect management node to storage • Fiber Channel - Optical pass through • iSCSI - Copper pass through • 2-14 HSxy Blades • At least one blade configured to attach to external storage for Image Library (FC, iSCSI, …) • Server for scheduler, database, and management node • Server(s) to deliver VCL services • Storage for Images • FC or iSCSI storage array (few TB) Three Networks Public, Private, Management Intelligent Images, Security A.Vandenberg

  10. GigE Switch Public Network GigE Switch GigE Switch Private Management Network Private Network Scaling VCL • Network switch • Cisco 6509e (or equivalent in your favorite network vendor flavor) • 3 separate networks + VLANs • Network connected to Internet for user access • Private Network connected to VCL management node (for loading and managing images) • Private Management network (connecting BladeCenter Management Modules and VCL management node - controls power on/off, reboot, …) • VCL Management nodes • One management node for every ~100 blades • Physical connection to storage array - shared file system (GFS, GPFS) for multiple management nodes at one site A.Vandenberg

  11. IBM Cloud Academy IBM Cloud Academy - GSU one of inaugural members Nov 2009 http://www-03.ibm.com/press/us/en/pressrelease/28749.wss • Initial membership from 16 institutions (K-12, Higher Ed) world-wide • - "We are very pleased to be a founding member of this innovative initiative that will bring on-demand computing resources to all Georgia State students," said J. L. Albert, GSU's Associate Provost, CIO • The mission… provide an organization for K-12 schools and higher education institutions… actively integrating cloud technologies into their infrastructures… to share best practices… and to collaborate with partners to create innovative cloud technologies and models. • IBM Cloud Academy Goals • - Forum for exchange of best practices • - Access to emerging cloud technology R&D from IBM & partners • - Repositories for cloud computing curriculum, tools, resources • - Foster pilot projects and collaboration • - Disseminate insights, metrics, benefits of cloud computing A.Vandenberg

  12. Virtual Computing Lab VCL installed on IBM iDataPlex - cost effective solution • Students evaluated virtual computing options Jan-Mar 2009 • - recommended VCL, iDataplex option • - effective use of student tech fee funding • Acquired iDataPlexOctober 2009 • - dx340, 84 nodes (672 cores, 2GB/core) • - Power, UPS, HVAC completed Dec 2009 • First imagesJanuary 2010 • - config: ESXi for provisioning, LDAP, Antivirus… • Demo accounts released April 2010 • - image: Windows XP, browser, MS Office+app • Pilot Production accounts released August 2010 • - base image: 1GB RAM, Windows XP + (MS Office; Matlab, Maple, etc.) • Engineering & frank talk November 2010 A.Vandenberg

  13. Virtual Computing Lab Cloud Colloquium, August 30, 2010 • Computer Science, Departmental Colloquium • - Dr. Andy Rindos,IBM Research, RTP Center for Advanced Studies (CAS), Raleigh, NC • - Dr. Bill Robinson, CIS - Windows XP image with IBM Rational Products • Opportunities for collaboration with IBM around cloud computing, including a review of VCL-based education cloud activities around the world. • - Dr. Yi Pan, IBM Faculty Award ($24K) • - Potential University Delivery Services (students support/supporting VCL) • Outcome of Colloquium - Demand queue for images: • - Dr. AndreyShilnikov, Neuroscience - Matlab, dynamical systems • - Tim Olsen, PhD student - images for process improvement • - Dr. Robert Clewley, Neuroscience - Python based environment • - Dr. Dave McDonald, CIS - upper level database design courses • - Dr. Michael Weeks, CS – programming in Linux/Matlab environment A.Vandenberg

  14. Technical details of our VCL High level summary of experience July 2010… • RedHat Enterprise Linux 5 for iDataPlex management node • - ESXi for compute nodes provisioning • - free! • - enables multiple virtual machines per single node/hypervisor • (vs. xCAT provisioning of complete node) • Virtualized the head node • - avoids “burning” whole node as head node • - flexibility for head nodes (devl, test/QA, prod…) • Perhaps Might Have: • - configured iDataPlex dx360, not 340 (for remote system administration) • - reversed fast disk on compute nodes & GigE connection via switch A.Vandenberg

  15. Other technical notes Your experience may vary… • ESXi v.3 - newer version “broke” VCL code • - ESXi doesn’t support Windows 7, so using Windows XP • - ESXi v.3 no longer generally available • - hope to resolve • Antivirus software may not work well with clones… • - McAfee, for instance, refuses to update a virtual image that is - invoked with out-of-synch time-stamp. • - We’re use MS Security Essentials • Multimedia experience may be limited • - Ericom’s BLAZE (http://www.ericom.com/) being tested by GMU A.Vandenberg

  16. A Faculty teaching perspective… Dr. Predrag Punosevac, GSU Mathematics & Statistics On Jan 27, 2010, at 12:04 AM, PredragPunosevac wrote: Dear Art, This is so COOL! I was just using Windows 2003 image in the full screen mode over RDP (rdesktop) on my PIII laptop 700 MHz and 128 MB of RAM which is running OpenBSD 4.5. The session was so snappy, I could not believe my eyes. It is faster then DeLL workstation in my office with Core 2 duo and 4 GB of RAM. … Predrag P.S. I am like kid now :-) I will now play with RedHat images. A.Vandenberg

  17. Another Faculty perspective… Dr. William Robinson, GSU Computer Information Systems On Sep 30, 2010, at 11:53 AM, William Robinson wrote: Kelly, I’m concerned about the vcl. I just now reserved and ran an image. It took about 3 minutes to get the reservation. Then, I tried to connect. It failed until about 10 minutes later. Then, everything was fine. This was after all the students had left. I’m concerned that: -Its too slow -          Cannot handle 20 students -Unreliable I have to make other plans. I’ve contacted IBM about their cloud and will start restart our CIS vcl. A.Vandenberg

  18. An Engineering perspective IS&T Managing Technology Engineer’s feedback – November 2010 • 1) VCL is not a turnkey product. • There is not a clean definition of what is code vs. configuration, there is not a clean path for defining what you would need to customize. Most commercial software would document a few different install options based on how you were going to use the software, and have some descriptions of what those configuration require in order to function. • 2) VCL software is not designed to keep a good separation between users and infrastructure. • For example the VM that the user is given access to has two network interfaces, one of which is on a network that has infrastructure components (ESXi management interface on it). A.Vandenberg

  19. An Engineering perspective… Your experience may vary… • 3) iDataPlex network switches are a black box set of switches. • …Even IBM has a hard time making them do more advanced configurations. This makes debugging of issues that might involve the network extremely difficult, even if you have support from IBM. • 4) iDataPlex is built around xcat. • …But xcat doesn't (or at least IBM install engineer could not) get it to deploy ESXi. • 5) We did KVM on the head node. • …Which is helpful for allowing you to get a production and development system running on the same physical hardware, but this to adds a layer of complexity that IBM has a hard time offering support, especially if KVM, XCAT and the network switches all need to be looked at while trouble shooting a problem. A.Vandenberg

  20. An Engineering perspective The short answer… • The short answer is our implementation is going VERY slowly, and consuming a LOT of time. • We will eventually get it working, but if you factor in cost of staff time, we would have been much better off selecting a commercial product. A commercial product would have been in production sooner, cost us less, and in the long run be more maintainable, especially should we face any staff turn over issues in the future. A.Vandenberg

  21. My (Art Vandenberg) perspective The short answer… • Disruptive technologies are that. • We need to understand that production, research, teaching have different perspectives. • We need to work together on solutions (what is taking me forever may be easy for you to solve…) • The future is not built by doing the same thing as today • Update September 2011 • As part of VCL Office hours, we alerted NCSU developers to our performance issues • IBM, VCL developers conf called with GSU technical – recommended steps to take • VCL 2.2.1 inplemented • And by the way, our experience was similar to that of VCL Bootcamp performance Pop quiz: If NCSU has 1000-2000 blades across multiple racks and GSU has 84 blades in one rack, would there be different performance? A.Vandenberg

  22. IBM Cloud Academyan overview and timeline A.Vandenberg

  23. IBM and education: collaborating for innovation IBM Cloud Academy The mission of the IBM® Cloud Academy is to provide an organization for K-12 schools and higher education institutions who are actively integrating cloud technologies into their infrastructures to share best practices in the use of clouds and to collaborate with partners to create innovative cloud technologies and models. From IBM Cloud Academy charter as developed by initial member institutions, 1Q 2010

  24. Three Functions of the IBM Cloud Academy Integrate Cloud Services and Technologies Implement solutions for education based on IBM world-class cloud services and technology, accelerating the transformation to a Smarter Planet™ Collaborate with peers, researchers and developers Work with colleagues from around the globe in a cloud-based collaboration forum to share best practices, ideas, and insights Innovate Cloud services and technologies Participate in the definition of emerging cloud technologies and implementations with IBM researchers, developers and Business Partners

  25. What are the goals of the IBM Cloud Academy? • Exchange of best practices • Accelerate deployment of successful models • Access to emergingtechnologies • Gain insight from IBM developers and research • Creation of a repository • Provide curriculum, tools and resources • Support for pilot and collaborative projects • Evaluate technical, financial and service qualities • Dissemination our findings • Document experiences, performance metrics, and benefits IBM Cloud Academy Charter, 1Q 2010

  26. Integrate IBM cloud computing technologies and solutions into institutional infrastructure Institutional-level commitment to participle over a multi-year membership Commitment to collaborative projects and initiatives Engage.Use cloud computing technologies and solutions Participate.Share insights, lessons learned and experiences members and the broader education community. Advance.Contribute to or lead strategic projects Influence. Provide IBM with feedback on cloud computing solutions and offerings Membership qualifications criteria and responsibilities • Membership participation qualifications • Member responsibilities IBM Cloud Academy Charter, 1Q 2010

  27. Membership benefits • Community Access. Access to a support community that is changing local IT culture by embracing cloud computing. • Knowledge Sharing. Thought leaders and technical experts with knowledge of proven cloud computing technologies and solutions. • Project Support. Technical and business case examples, benchmarking data and access to resources that support cloud computing projects. • Project Funding. Funding opportunities for cloud computing projects and research that are competitively awarded • Resources. Strategies to use cloud computing to transform education and research in K-12 and higher education globally. • Headlights: Trends in K-12 and higher education globally as relates to the move to cloud computing models and approaches. IBM Cloud Academy Charter, 1Q 2010

  28. Collaboratory used for IBM Cloud Academy member projects • Collaboratory • Members from around the globe work together using IBM LotusLive™ cloud services with web conferencing, social networking and collaboration tools • Collaborative themes • Selected by the IBM Cloud Academy governing board • 2010 focus themes: • Enhancing research computing using cloud computing • Delivering educational resources with a cloud • Building the institution’s future infrastructure and roadmap with cloud • IBM technical community support • Initiatives supported by a technical board comprised of IBM researchers, architects, developers and members of the IBM Academy of Technology specializing in cloud computing

  29. IBM Cloud Academy’s first white paper illustrates a statewide approach:“The Transformation of Education through State Education Clouds” North Carolina Virtual Computing Lab / VCL cloud featuredProduction/pilots/users also present within: NC Community College System NC K-12 WFU NCA&T OC12 (622 Mbps Cicruit) OC48 (2.4 Gbps Circuit) DWDM (10 Gbps Ethernet) Research Production/ Pilots/Users Available on IBM Cloud Academy website: http://www.ibm.com/solutions/education/cloudacademy/us/en/ Interest/Plans

  30. K-12 and higher edsuccess storiesalso available on website

  31. Cast Iron Cloud Integration IBM Tivoli®Provisioning Manager IBM Smart Desktop Cloud IBM SPSS®Decision Managementfor Education IBM SmartCloud for Educationofferings to get started Education Workloads IBM ‘For Cloud’ (private) Enabling Technologies Increase agility Offerings on IBM SmartCloud Virtual Computing Lab IBM SmartCloud Enterprise LotusLive! Education solutions Business processes Turn information into insights Development and test Collaboration Connect and empower people Desktop and devices Analytics Infrastructure storage IBM BladeCenter® Foundation for Cloud Infrastructure compute IBM Smart Business Storage Cloud Life-cycle and service management *Note: Only key offerings mentioned, many more available Drive Effectiveness & Efficiency

  32. IBM Cloud Academy member locations globally (growing each month) Dublin Ireland Seoul S. Korea Beijing China Tokyo Japan Silicon Valley California Hanoi Vietnam Bangalore India São Paulo Brazil IBM Cloud Labs Johannesburg South Africa IBM Cloud Academy Members ibm.com/solutions/education/cloudacademy

  33. Is cloud computing really all that new? Yes and no. Cloud computing Centralized Computing Client-Server Cloud is a derivative of what we have done in the past, and is enabled by a convergence of maturing technologies Internet Virtualization It is a new IT consumption and delivery model well suited for colleges, universities and K-12 schools

  34. “Cloud-onomics”: Why education is looking to the cloud CLOUD COMPUTING + + + = = REDUCED COSTS VIRTUALIZATION ENERGY EFFICIENCY STANDARDIZATION AUTOMATION AND SELF SERVICE ….makes use of virtualization, standardization and automation to free up operational budget for new investment + + + = = OPTIMIZED SERVICES AGILITY BUSINESS AND IT ALIGNMENT SERVICE FLEXIBILITY INDUSTRY STANDARDS …allowing you to optimize new investments for direct business benefits

  35. Cloud computing helps move beyond organizational silos Without cloud computing With cloud computing • Virtualized resources • Automated deployment of IT resources • Standardized services • Location-independent • Rapid scalability • Self-service • Software • Hardware • Storage • Networking • Software • Hardware • Storage • Networking • Software • Hardware • Storage • Networking Universities, for example, can be the innovation centers within Smarter Cities™; associated business incubator & entrepreneurship parks for job & business creation

  36. There is a spectrum of deployment options for cloud computing Internal/Private Public Hybrid IT activities / functions are provided “as a service” over the Internet IT capabilities are provided “as a service,” over an intranet, within the client and behind the firewall Internal and external service delivery methods are integrated Third-partyoperated Third-party hosted and operated Users Client B Client A Client Client data center Client data center A B Managed private cloud Hosted private cloud Shared cloud services Public cloud services Private cloud Private 64% Cloud workload preference Public 30% Note: Not all workloads will move to cloud! Source: IBM Market Insights, Cloud Computing Research, July 2009. n=1,090

  37. Cloud computing benefits in education Students: • Raises computing resource accessibility, even in underserved districts • Increases availability and integrity of data, applications and research materials • Adds mobility • Reduces client application and system resource footprint • Amplifies application and computing performance • Improves server and data storage capacity • Offers convenient web access Faculty: • Grants accessibility to virtual machines • Schedules delivery of assignment instructions, study materials, syllabi or software • Enables faculty to create custom images for specific course, independent of (and not conflicting with) other faculty course images • Unites departments and campuses to eliminate information silos to deliver comprehensive educations Administration: • Standardizes applications and processes • Provisions software, resources and management of data • Lightens the burden of software version control • Reduces total cost of ownership (TCO) • Lowers the need for in-house IT staff • Cuts resource management costs including power and cooling • Raises server utilization and software licenses, reducing purchasing requirements • Brings greater virtualization • Optimizes resource allocation

  38. March 25, 2010 IBM Cloud Academy A.Vandenberg

  39. Preliminary Results of the Survey for Collaborative Themes A.Vandenberg

  40. April 8, 2010 IBM Cloud Academy A.Vandenberg

  41. Cloud Computing Seminar April 22-23 Friday, April 23rd (further update on call) IBM Research Cloud Computing Activities (including the Research Compute Cloud) Additional education presentations and follow-up discussions A.Vandenberg

  42. May 6, 2010 IBM Cloud Academy A.Vandenberg

  43. Binghamton University – SUNY (April 22 - 23) A.Vandenberg 43

  44. IBM philanthropic endeavor • Launched: November 2004 • Donates massive compute power to projects solving humanitarian and world problems using grid technology • Public donates spare PC cycles • Direct results to public domain • Grow membership for multiple projects – leverage recruitment effort • Over 342,000 CPU years • 300 cpu years in typical weekday • 1.52 million devices • 509,000 members • Over 100,000 IBM employees • 222 countries

  45. How it works • Member joins • Register at web site WCGRID.ORG • Download software • Install software • Agent asks for work • Device processes work at lowest CPU priority • Device contacts the servers • Repeat… Returns computed results Gets new work unit Don’t have to leave computer on 24/7…. Just use it as you normally would“BOINC” software Berkeley Open Infrastructure for Network Computing

  46. What research is being run on World Community Grid A.Vandenberg

  47. Input Output Typical Project • Large computing problem is split into millions of smaller independent runs • Donor machines around the world request those work units from our servers • The machines return their results after they have processed them • Servers assemble pieces of the answers to produce the final results of the research project • Direct results made available in the public domain

  48. And it is GREEN • We don’t ask people to leave computers on 24/7, just use them as they normally would • Default CPU use set to 60% to limit extra energy consumption • Checkpointing to not lose results computed so far • Can limit further with custom settings Watts 75 50 Thinkpad T42p power consumption CPU utilization 50% 100%

  49. Running on a Cloud • Cloud runs virtual images of production work • Hardware supports virtual images • Run World Community Grid at lowest priority on hardware not fully utilized by production work VS. Run as a virtual image VM VM VM VM VM VM VM VM VM VM VM VM VM

  50. World Community Grid assumes the burden of running the grid • Security work • Grid enabling new projects • Importing research data • Creating work units • Scheduling work units • Voting on results • Combining results • Backups • Results to researchers • Monitoring disk space • Checking errant devices • Problem work units • Helping the scheduler • Web site modifications • Forum monitoring • Support emails • Soliciting new research • Beta testing • System updates / upgrades • Audits Georgia State University has been a World Community Grid Partner since July 2007! http://www.worldcommunitygrid.org/ GSU team contributes to a dozen different such projects (over 44 years of compute total) and we are ranked overall as #781 out of 27,061 teams. Join GSU team: http://www.worldcommunitygrid.org/reg/viewRegister.do And then search for and select GEORGIA STATE UNIVERSITY team.

More Related