1 / 29

e-Clouds: A Platform and Marketplace to Access and Publish Scientific Applications as a Service

1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País. e-Clouds: A Platform and Marketplace to Access and Publish Scientific Applications as a Service. Mario José Villamizar Cano mj.villamizar24@uniandes.edu.co

vevina
Download Presentation

e-Clouds: A Platform and Marketplace to Access and Publish Scientific Applications as a Service

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País e-Clouds: A Platform and Marketplace to Access and Publish Scientific Applications as a Service Mario José Villamizar Cano mj.villamizar24@uniandes.edu.co Project Assistant – Cloud Computing Advisor Universidad de los Andes Bogotá, Colombia

  2. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País THE PROBLEM RELATED WORK • SOLUTION REQUIREMENTS • SOLUTION ARCHITECTURE • IMPLEMENTATION FUTURE WORK

  3. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País THE PROBLEM When Small and Medium research groups have projects that requires large processing capabilitiesthey regularly have to use dedicated cluster and/or grid computing infrastructures. However …

  4. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País THE PROBLEMS WITH CLUSTER AND GRID The total cost of ownership (TCO). Complex processes related to IT management. There are different models to parallelize applications. Researchers require large computing capabilities during peak periods.

  5. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País THE CLOUD COMPUTING MODEL - SaaS Users pay a subscription to access the service (not to buy the license or to buy and maintain hardware)

  6. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País THE CLOUD COMPUTING MODEL

  7. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País THE CLOUD COMPUTING MODEL - IaaS General Purpose Instances Compute Optimized Instances

  8. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País THE CLOUD COMPUTING MODEL

  9. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País THE PROBLEM Research groups of different sizes are adopting IaaS solutions. The adoption of cloud computing is a complex process, where non-IT researchers have to face similar or more complex processes as those found in cluster or grid infrastructures.

  10. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País THE PROBLEM At enterprise level, the Software as a Service (SaaS) model allows that small businesses can easily adopt complex and ready-to-use applications. Problems associated to the management and the configuration of the underlying (PaaS, IaaS) infrastructure are abstracted.

  11. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País RELATED WORK – e-Clouds GOAL We believe that cloud computing may provide more opportunities for a large number of small and medium research groups. e-Clouds: A SaaS marketplace where researches can access to on-demand and ready-to-use scientific applications via a Web Browser using a pay-per-usemodel.

  12. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País RELATED WORK Some commercial scientific SaaS marketplaces such as Cyclone and Cloud Numbers are offering scientific SaaS application on public IaaS.

  13. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País RELATED WORK

  14. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • SOLUTION REQUIREMENTS In most in-house HPC/HTC environments, clusters are the core element used to execute scientific applications.

  15. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • SOLUTION REQUIREMENTS Managed by researchers / groups Managed by researchers / groups A multi-tenant SaaS solution for scientific computing should allow that researchers ca access to different ready-to-use-applications, execute and monitor jobs, and the movement of data from and to the cloud; we call these three elements the workspace.

  16. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • SOLUTION REQUIREMENTS Scheduling Servers can be turned on or turned off as needed. Blob Storage Scalable storage systems that can grow to any size App Management On-demand installation of hundreds of scientific applications

  17. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • SOLUTION ARCHITECTURE e-Clouds is based on a new architecture that abstract the above problems, allowing researchers to focus their efforts in result analysis and experimental designs, and not on technical IT issues.

  18. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • SOLUTION ARCHITECTURE • e-Clouds provides mechanisms that allow users to act as application configurators, facilitate the installation and configuration of new applications: cluster creation on demand. • Queue based communications and different components of e-Clouds scale automatically and allows e-Clouds to support the execution of large workloads. • Costs Efficiency. • Traditional directory structure based on scalable blob systems.

  19. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • SOLUTION ARCHITECTURE Researchers/users: Choose the application. Configure the execution. Monitor the jobs/executions. Download the results. Pay only for what they use. e-Clouds is in charge of interacting with the public/private IaaS in all of the steps.

  20. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • IMPLEMENTATION Amazon Web Services (AWS) Ruby on Rails / Heroku. PostgreSQL. EC2, S3. e-Clouds Agent (Ruby). Script application in R of Von Humboldt Institute.

  21. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • IMPLEMENTATION

  22. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • IMPLEMENTATION

  23. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • IMPLEMENTATION

  24. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • IMPLEMENTATION

  25. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • IMPLEMENTATION

  26. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País • WHEN TO USE CLOUD SOLUTIONS SUCH AS e-Clouds Cases where Private and Commercial Clouds may be Cost Effective (Magellan R.): Unknown Demand. In the case of a new project or a new application where the potential demand is still poorly understood. Sporadic Demand. One of the more common cases for using commercial cloud offerings is when the demand is highly variable, especially if there are also time sensitive requirements for the service. Facility Constrained. Some sites are severely infrastructure limited.

  27. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País FUTURE WORK Usability tests with more researchers. Large scale performance tests. Auto scaling and queues mechanisms. More Bag of Tasks applications. e-Clouds as an Open Source project. Shared workspaces. Different public IaaS. Types of applications (MPI, GPUs). Stronger security mechanisms.

  28. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País WE ARE LOOKING FOR BETA USERS/RESEARCHERS Más información en: eclouds.uniandes.edu.co

  29. 1er Foro Internacional de Bioinformática Ciencia y Tecnología para el Futuro del País THANKS FOR YOUR ATTENTION! Mario Villamizar - Universidad de los Andes mj.villamizar24@uniandes.edu.co - @mariocloud

More Related