HPC in the Cloud Impact on Future Enterprise Architectures

1. HPC in the CloudImpact on Future Enterprise Architectures Dr. Tirumale K (TK ) Ramesh The Boeing Company NCOIC Cloud Computing Working Group tirumale.k.ramesh@boeing.com NCOIC Panel NAVAIR Military Aviation Architecture Conference September 22, 2010 Approved for Public Release Distribution Unlimited NCOIC-DefDaily-TKR20100917

2. Cloud Computing & High Performance ComputingDefinitions and Synergies • Cloud Computing • A paid-for service model for delivery and consumption of computing allowing organizations to access to applications, deployment and infrastructure platforms as a service provided on-demand • Infrastructure services which is more of a la carte with control for infrastructure provisioning is not what Cloud offers at least for now • What Cloud provides is an on-demand infrastructure as a whole (Infrastructure as a Service-IaaS) via set of pre-packaged menu options to choose the infrastructure from the providers • High Performance Computing (HPC) • A computational model in which high performance is delivered to support highly compute-intensive calculations mainly by using parallel algorithms with tightly-coupled, data-intensive inter-process communication, running on hundreds or even thousands of processors or cores. • HPC in the Cloud- Setting up a configuration of distributed cloud resources as a tightly coupled HPC engine to meet requirements of locality of reference, communication bandwidth and latency from node to node

3. Cloud Computing Impact on Future Enterprise Architectures (EA) • It is predicted that in next 10+ years as Cloud Computing(CC) grows and matures, it impacts and may redefine and advance the EA of an organization • There is even more interest of EA to global organizations to sustain global competition and support for interoperability in a global ecosystem environment • Users would be able to buy cost-effective mission-critical processes as cloud services and general buying habits of organizations may change from “buy all once” mindset to “buy breed of needed services” Adaptable and scalable architecture to support changing buying habits and support for ecosystem of cloud computing Evolvable Architectures Future Enterprise Architectures Cloud Services demands Organizations to periodically evaluate vendor technologies and risk management including COTS technologies risks Organizations to re-examine organizational security policies Organizations to have high level control over data & network demands Organizations to engage pro-actively in architecture implementations in cloud- For example designs that support integrating multiple CC interfaces

4. Cloud Service & Delivery Model Trade-offs Basis Criteria's: Future Architectures, Security, Interoperability and Reliability PaaS (IaaS high cost) better better better Trade-offs Vendor Responsible for Security SaaS Trade-off from EA Centric PaaS Reliability Interoperability Adaptation to Future Architectures Trade-off from Secured & global ops Centric PaaS User Responsible for Security IaaS concerns better Hybrid (Open arch) Open Standard Specifications Public Trade-off from EA Centric Hybrid Trade-off from Secured & global ops centric security Adaptation to Future Architectures Reliability Interoperability Hybrid Proprietary Specifications Private better better With balanced options, Security is still an issue for global operations

5. Cloud in Open Architecture Global Environment • Most of cloud providers expose APIs but have specific implementations that do not permit interoperability • Ope • Some Open Standards under development including OGF’s Open Cloud Computing Interface- OCC (Open Cloud Consortium) is working on obtaining consensus on open standards and best practices • The Cloud Security Alliance is a non-profit organization that is working on promoting the use of best practices for providing security assurance Virtualization Cloud Providers Enables open architecture Service-Oriented Arch Public Cloud Routing Switching Firewalls Hybrid Cloud Application Delivery Private Cloud Open Standards Provides global interoperability and portability

6. High Performance Computing (HPC) in the Cloud- Are there Cost Savings? • HPC in the Cloud offers the possibility of creating applications that would otherwise be prohibitive in HPC infrastructure costs to many HPC application developers • Transforming HPC to Cloud via virtualization of cloud infrastructure and adapting to HPC usage patterns of cloud resources • Primary determinants of HPC performance are data locality and locality of reference, and communications latency and bandwidth • Currently most of the HPC providers cannot guarantee these but possible in the near future • Today, nobody would build an HPC cloud for great grand challenge scientific applications as the business is not profitable • HPC users are far too small and does not take full advantage of cloud scaling • As HPC usage moves more from scientific users to main stream enterprise users, HPC cloud will become more economical

7. High Performance Computing (HPC) in the Cloud for Future EA • HPC benefits in future enterprise global operations • As organizations in future become smarter in global collaborative work using 3D web technologies and other collaborative computing technologies , it creates an opportunity for HPC to tap into much broader main stream enterprise user base and instantiate an architecture view in future enterprise architectures • HPC in the Cloud migration path for future EA • First migrate via SaaS by tapping some acceleration HPC applications as a Cloud Service to use with traditional HPC data centers (some FPGA vendors are interested in this) • Better Security in SaaS • Better Adaptation to Future Enterprise Architectures to support HPC for main stream users • Slowly migrate to IaaS (full provisioning of HPC resources in Cloud) • So, is it all good news to migrate HPC to Cloud to save cost? No, not yet. • More learning curve and initial efforts needed • Initial high cost leading to lot of wait and watch now

8. High Performance Computing (HPC) in the Cloud- What are the Gaps? Gaps for Migration of HPC to Cloud HPC (Traditional P & D computing with high throughput HW and optimized SW stack) Dynamic and adaptive workload management to fully utilize cloud resources Cloud Fabric Scalability: Intelligent management of resources from network all the way up to processor/multi-core level( to gain fine-grain multi-threading parallelism) Cloud Computing Open Architecture to leverage COTS HPC solutions and dramatically decrease the cost for doing HPC – a clear lift off opportunity for HPC to enter main stream Cloud Computing Need virtualization of accelerators on the cloud to migrate any Hybrid HPC to cloud More compute intensive applications today demands HPC acceleration via CPU/GPU, CPU/FPGA • Some HPC in Cloud offerings today • Penguin’s HPC-as-a ServiceTM • Open Question: Is the Cloud robust enough to handle the massive computing cycles and very high system throughput needed for an effective HPC environment?

9. Cloud in Open Architecture EnvironmentImpact to HPC in the Cloud • Security and Legal/Legislation Issues Impact • Potential exposure of sensitive and valuable information processed in HPC in the Cloud • HPC have well developed security layers in a single HPC data center environment • Security providers are looking to enhance the security of cloud offerings such as cloud-based intrusion prevention which allows users to monitor network activity for malicious behavior • This requires integrating traditional HPC security layers with higher level cloud security layer for HPC offerings in cloud • There is no doubt that Cloud Computing is still in its infancy and many offerings remain insecure or poorly documented • Need to put more trust in security suppliers • Private cloud architectures may be holding well at a good level in the enterprise, but open standards to facilitate managing across global competing platforms is still far away for global operations • Currently opportunities are opening up for HPC in private Clouds

10. Secured Cloud Computing for GlobalOperations- Are We There Yet? • I say it is a Mixed Bag • Security is a major concern • Some cloud opponents argue that customer data is more secure when managed internally and not throw it on cloud • Some cloud supporters argue that Cloud Providers have a strong incentive to maintain trust so that they can provide a higher level of security in the near future • Expectations going forward • Most organizations experimenting with small implementations as Private and Hybrid Cloud architectures • Private Cloud may move into the mainstream well before truly global standards may even come into play • Eventually there will be one standard that some experts argue may even take longer for standardization (10+ years)

11. Final Thoughts • Delivering Secured Cloud Computing for Global Operations is not the responsibility of one single organization • We need a well established framework for collaborations of all stakeholders (Industries, Consumers, Government and Academia) • Fundamentally Cloud needs to be a “Virtual Connector” to achieve “Net centricity” • Future Enterprise divides into community of people, processes, information, knowledge and services interconnected by a smarter network to achieve maximum benefit of its resources with reduced cost Smart Network (technology enabler) Technical interoperability People (Stakeholders) Cloud (Virtual Connector Organizational interoperability Processes Information/ Knowledge/ Semantic interoperability EA View as a Cloud Fabric

12. Final Thoughts • Commercial and Military Aviation Architecture need to align with the global enterprise architecture in order to support today’s global business using key technology pointers • Recommended migration plan is to first apply SoA in Aviation Architectures and transform them to cloud offerings • Take the architectural principle of SOA and applying it to an infrastructure offered by cloud • Finally integrate into HPC usage in the long run within a comprehensive enterprise architectural framework to support global interoperability • Network Technology is only an enabler for future aviation architectures implemented on Cloud but network itself is not a major problem • NCOIC can help in providing the necessary guidance in the proliferation of Cloud Computing in support of future enterprise open architectures that evolves and uses emerging technologies rendered on the cloud that can be accessed via cloud services Cloud computing can provide highly cost effective implementations of the architecture but Security is still the main issue

13. Thank You!