Smart solutions for data centers

1. May, 2019 Smart solutions for data centers Modular Edge-connected data centers

2. Agenda • Continuous operations • Energy Efficiency • Space Saving • Modularity/Flexibility

3. Continuous operations Modular Edge-connected data centers

4. Continuous operations Modular Edge-connected data centers Percent of data centers experienced an outage during one year Background Reliability is the most important parameter for data centers and still remains the most critical aspect of each data center. For example 31% of data centers have experienced at least one outage per year The cost of the outage has rapidly increased since 2010 with the average cost of USD 505k per an outage to USD 750k in the year 2016, we can expect that in the year 2019 the average cost of an outage will be around USD 900k 33.6% of all outages are due to an on-premises power supply failure, which represents the most usual cause of the data center outage 31%per year Source: 2018 Data Center Industry Survey Results by Uptime

5. Continuous operations Modular Edge-connected data centers Average cost of unplanned data center outage Background Reliability is the most important parameter for data centers and still remains the most critical aspect of each data center. For example 31% of data centers have experienced at least one outage per year The cost of the outage has rapidly increased since 2010 with the average cost of USD 505k per an outage to USD 750k in the year 2016, we can expect that in the year 2019 the average cost of an outage will be around USD 900k 33.6% of all outages are due to an on-premises power supply failure, which represents the most usual cause of the data center outage 505k$in 2010 690k$ in 2013 750k$ in 2016 900k$ in 2019 We may expect Source: Cost of Data Center Outages, Ponemon Institute, 2016

6. Continuous operations Modular Edge-connected data centers Outage usual cause Background Reliability is the most important parameter for data centers and still remains the most critical aspect of each data center. For example 31% of data centers have experienced at least one outage per year The cost of the outage has rapidly increased since 2010 with the average cost of USD 505k per an outage to USD 750k in the year 2016, we can expect that in the year 2019 the average cost of an outage will be around USD 900k 33.6% of all outages are due to an on-premises power supply failure, which represents the most usual cause of the data center outage 33.6% due to the power on premises supply failure Reliability is the most important parameter for data centers Source: 2018 Data Center Industry Survey Results by Uptime

7. Continuous operations Modular Edge-connected data centers ABB solution ABB offers unique UPS decentralized parallel architecture, complete and most reliable ATS portfolio, 100% selectivity and predictive maintenance features to allow maximum reliability of the data center power distribution Those solutions allows ABB customers to guarantee 100% uptime to their data center users ABB data center power distribution design and products are built according to the highest possible reliability level, ensuring the continuity of service

8. Continuous operations Modular Edge-connected data centers Up to ABB solution ABB offers unique UPS decentralized parallel architecture, complete and most reliable ATS portfolio, 100% selectivity and predictive maintenance features to allow maximum reliability of the data center power distribution Those solutions allows ABB customers to guarantee 100% uptime to their data center users 100% Uptime for data center users Source: ABB delivers 100% uptime for data center operator Systemec

9. Continuous Operation Data Center Power Supply Standards

10. Continuous Operation Standards-Examples Tier I – Very fault sensitive Tier II – Redundant Design Tier III – Concurrently Maintainable Tier IV – Fault Tolerant Utility Feed Utility Feed Utility Feed Utility Feed Utility Feed Utility Feed Gen GenN+1 GenN Gen Gen Gen Main Distribution Board Main Distribution Board Main Distribution Board Main Distribution Board Main Distribution Board Main Distribution Board UPS UPS UPS UPSN UPSN+1 UPS Mechanical load Mechanical load Mechanical load Mechanical load Secondary Distribution Board Secondary Distribution Board Secondary Distribution Board Secondary Distribution Board Secondary Distribution Board Secondary Distribution Board PDUs PDUs PDUs PDUs PDUs PDUs IT Loads IT Loads IT Loads IT Loads

11. Continuous Operation Uninterruptable Power Supply Modular UPSs Standalone UPSs UPS by ELIS 1. UPS by ELIS

12. Continuous Operation UPS system architecture Input Output Input Control logic Control logic Control logic Control logic Display Display Display Display Output Vertical and horizontal scalability for capacity and redundancy Horizontal scalability for capacity and redundancy

13. Continuous Operation DPA UPS Module Secured uptime and reliable performance with decentralized paralleling architecture (DPA), where every UPS module has all essential functions eliminating singe point of failures 50kW UPS module Bypass input Rectifier input Output Control logic Display Online swappable module for continuous uptimeIf one UPS module needs to be removed or added to the system, this can be man-aged fast and seamlessly. The DPA 250 S4 has a very robust design and features strong and practical handles. It is only possible to insert modules into the rack in the correct orientation and the slide rails have mechanical stoppers to stop the module from sliding out too far, thus preventing an unintentional drop Easy of controlling and monitoringThe DPA display allows fast data access and module management < 10 min service timeIt takes only 10 minutes to extract a module, replace consumable parts, insert it back to the system and turn it back online

14. Continuous Operation Transfer switching solutions portfolio Switching technology Switches / Power contactors1 Contactors Circuit breakers STS OT_C Range OTM_C Range Compact ATS TruONE ATS (open & enclosed) Zenith ATS AF contractors with relays Emax 2 and Tmax XT with ATS021/ATS022 Embedded ATS Cyberex Delayed: I-0-II Closed: I-I+II-II Delayed: I-0-II Delayed: I-0-II Open: I-II Delayed: I-0-II In-phase monitor Open: I-II Delayed: I-0-II Closed: I-I+II-II Bypass In-phase monitor Delayed: I-0-II Delayed: I-0-II Delayed: I-0-IIClosed: I-I+II-II Synchrocheck Transition types UL98 IEC 60947-3 CCC IEC 60947-6-1 CCC IEC 60947-6-1 CCC UL 1008 IEC 60947-6-1 CCC UL 1008 IEC 60947-6-1 IEC/UL 60947-4-1 CCC UL1066, UL489 IEC 60947-2 CCC UL1066 IEC 60947-2 CCC UL10085 Standards Controlling methods Manual transferswitch Remotely operatedtransfer switch Automatic transfer switch 1. Zenith and TruONE also known as power contactor based solutions in NEMA/UL market

15. Continuous Operation Transfer switching solutions application examples Application example Embedded ATS Emax 2 and Tmax XT embedded ATS Open transition Main – Gen TruONE In phase transition for cooling devices Utility Feed Utility Feed Gen Gen Main Distribution Board Main Distribution Board UPS UPS Cooling Devices Secondary Distribution Board Secondary Distribution Board PDUs PDUs Simple solution for maximum reliability IT Loads

16. Continuous Operation Transfer switching TruONE • Below 50 ms in-phase transfer • Onload emergency manual operation • IEC/UL1008 approved • Variants with and without stable OFF-position • Overlapping neutral • ABB Ability™: EDCS for cloud-based services • Ekip Com modules for uniform platform • Predictive maintenance • Modular structure to simplify service Embedded ATS • With embedded ATS, available for low voltage circuit breakers and Ekip platform, we can embed every protection function usually carried out by the external trip units, and the logic too • Main Tie Main Closed • Main Gen Open

17. Continuous Operation Transfer switching solutions portfolio Continuous operation • Predictive maintenance, extensive diagnostic data, and customer-replaceable critical modules • Reduced number of connection points • Fast in-phase and closed transition Easy to install • Revolutionary integrated designs • Reduce installation time by up to 80% and cut commissioning and cabling costs by up to 50% compared to classical ATS solutions Speed up your project • e-Configure for selection and order handling • Ekip Connect 3 software in conjunction with our most advanced ATS options, you can reduce commissioning time 80–95% Data & Connectivity • Apply energy management process and diagnose problems earlier with advanced measuring, diagnostic and maintenance data • Market-leading modular connectivity with seven communication protocols

18. Continuous Operation Protection devices Emax 2 and Tmax XT new generation of trip units offer same user experience over the whole range of circuit breakers from 160A up to 6300A Tmax XT Emax 2 E2.2 XT2 XT4 XT5 XT7 E1.2 E4.2 E6.2

19. ABB AbilityTMEDCS Advanced features Predictive Maintenance • Overall plant health conditions • Smart visualization (traffic light) to monitor the system at a glance, with proactive alerts • Operation and Maintenance cost saving thanks to optimized maintenance schedule • Spare parts management: you know exactly what you need, no waste of time • Reduced downtime • Based on an algorithm that considers: • Environmental conditions • Utilization conditions • Circuit breaker Aging • Measures (humidity/vibration/temperatures) E4.2N 4000 Ekip Touch LSIG 3p FHR BA98765432 E2.2S 1600 Ekip Touch LSIG 3p FHR BB98765432

20. Continuous Operation Advanced Selectivity Logic Zone Selectivity • Directional zone selectivity, suitable for ring distributed network, radial interconnected, main-tie-tie-main, recommended for Data Center improved reliability • Achievable through Ekip Link system (LV proprietary) or IEC 61850 • It allows for fast fault detection in any system configuration, with multiple power sources interconnected; ideal solution for increasing reliability of TIER III, IV systems Available with LV circuit breakers ranging from 160A up to 6300A

21. Protections Logical Zone Selectivity Digital Selectivity To have the ring connection among switchboards the logical zone selectivity is necessary in order to ensure the isolation of only the faulty area • This can be done using the: • Hardwired solution (24V) or • By communication protocols • Ekip Link (low voltage proprietary protocol) • Ekip Com IEC61850 G G G G G M G M M M

22. Protections Logical Zone Selectivity The benefits of Ekip Link and IEC61850 over 24V For the complex applications such as ring distribution in the low voltage the only acceptable solution is Ekip Link or IEC61850 Note that the same benefits stand for the IEC61850 with the additional possibility of interconnection with MV and with the possibility to have a time stamp

23. Continuous Operation Adaptive Settings Solutions for Low Voltage Paralleling Switchgear Embedded Circuit Breakers Adaptive Settings Two different selectivity curves depending on the power source to ensure the selectivity in any operating conditions ON grid OFF grid Adaptation to OFF grid scenario Utility Feed 103s 103s B B 102s 102s Utility Feed 10s 10s Gen Gen D C D 1s 1s 10-1s 10-1s C 10-2s 10-2s Main Distribution Board Main Distribution Board 10-3s 10-3s 1A 10A 1kA 100kA 1A 10A 1kA 100kA UPS UPS Mechanical load Secondary Distribution Board Secondary Distribution Board PDUs PDUs IT Loads

24. Continuous Operation Generator parallelization and protection Solutions for Low Voltage Paralleling Switchgear Embedded Circuit Breakers Generators Protection SACE Ekip G Hi-Touch Utility Feed Utility Feed Gen Gen Main Distribution Board Main Distribution Board UPS UPS Mechanical load Secondary Distribution Board Secondary Distribution Board PDUs PDUs IT Loads

25. Continuous Operation Renewables Integration Interface Protection • Interface Protection System and Interface Device embedded in single unit Tmax XT or Emax 2 as local generation circuit breaker In such scenario, there are loads not working in islanding condition. Tmax XT or Emax 2, installed on the generator feeder, performs the triple function of Interface Protection System, Interface Device and Generator Device Utility Utility Feed GD Utility Feed Renewables Gen Gen MV/LV Transformer Tmax XT Main Distribution Board Main Distribution Board Emax 2 UPS UPS GenD + IPS + ID Mechanical load Secondary Distribution Board Secondary Distribution Board Ekip UP Loads PDUs PDUs PV Plant IT Loads

26. Continuous Operation Ekip Connect 3 Concept Ekip Connect is the ABB programming and commissioning software tool that allows the user to unlock the full potential of circuit breakers, improving the reliability of a data center Using Ekip Connect, the user can manage power, acquire and analyze electrical values, and test protection, maintenance and diagnostic functions Breaker Start-up Record Events Export Report CB Diagnostic Logic Activation Perform Tests Configure System Parameters Set Protections View CB Status

27. Continuous Operation Ekip Connect 3 Configuration • Set protections • Configure system and communication parameters • Breaker start-up Product implementation • Set advanced protections • Logic activation • Enable advanced functions Monitoring & analysis • View breaker status and measure • Read events list • Breaker diagnostic Testing & Reporting • Check correct functionality • Perform tests • Export report

28. Continuous Operation Arc Flash Protection Arc Fault • Outages due to the arc flash • Arc flash hazards Up to 10 times a day Arc-flash incidents, happen between five and 10 times a day in industry

29. Continuous Operation Arc Flash Protection Enclosures MSS Breakers MV Internal arc tested enclosure (SPEP) Segregation (prevention) TVOC-2 + ACC Emax 2 with Dual settings or 2I REA UFES Provides protection with closed door only Provides protection with open or closed door of enclosure Passive protection Active protection Update date: September 2017

30. Continuous Operation Arc Flash Protection Arc Guard TVOC-2 Utility Feed Utility Feed Gen Gen Main Distribution Board Main Distribution Board UPS UPS Mechanical load Secondary Distribution Board Secondary Distribution Board PDUs PDUs IT Loads

31. Continuous Operation Arc Flash Protection Arc Guard TVOC-2 The Arc Guard TVOC-2 builds on the well-appreciated TVOC design and offers unmatched arc monitoring. The TVOC-2 is an optical detection system that together with an external breaker can limit the damage done to personnel and equipment in case of an arc accident happening Main benefits • Increased safety to personnel and equipment • Minimizes downtime after arc accident has happened • Easy-to-read interface makes reading status information quick and easy • Simple start-up menu quickens installation and setup • Can easily be expanded with up to 30 sensors to increase cabinet coverage from a single TVOC-2 • No calibration needed ensures reliable function and quick installation

32. Agenda • Continuous operations • Energy Efficiency • Space Saving • Modularity/Flexibility

33. Energy Efficiency Modular Edge-connected data centers

34. Energy Efficiency Modular Edge-connected data centers Number of hyperscale data centers globally Background Growth of modern technologies such as IoT, Industry 4.0, Big Data, AI, cloud computing are driving the huge growth of data center industry Number of hyperscale data centers is increasing rapidly, 338 in 2016 and it is estimated to reach 628 in 2021 The projected growth of the data center segment in the next 5 years is 4% To allow this huge growth of data centers without having a great impact on environment, energy efficiency must increase Data centers are already recognizing this need, which has led to the huge decrease of PUE over the years from 2.5 in 2007 to 1.58 in 2018 There are two main challenges when it comes to the energy efficiency of a data center: to build an energy efficient data center and to be able to maintain or improve data center efficiency over the years. Up to 20% of total electrical energy goes into electrical distribution losses (UPS, cables, transformer…) 338 in 2016 628 by 2021 Source: Number of Hyperscale Data Centers, in Units, Global, 2016 – 2021 by Cisco

35. Energy Efficiency Modular Edge-connected data centers Data Canter growth Background Growth of modern technologies such as IoT, Industry 4.0, Big Data, AI, cloud computing are driving the huge growth of data center industry Number of hyperscale data centers is increasing rapidly, 338 in 2016 and it is estimated to reach 628 in 2021 The projected growth of the data center segment in the next 5 years is 4% To allow this huge growth of data centers without having a great impact on environment, energy efficiency must increase Data centers are already recognizing this need, which has led to the huge decrease of PUE over the years from 2.5 in 2007 to 1.58 in 2018 There are two main challenges when it comes to the energy efficiency of a data center: to build an energy efficient data center and to be able to maintain or improve data center efficiency over the years. Up to 20% of total electrical energy goes into electrical distribution losses (UPS, cables, transformer…) 4%in 5 years (2018-2023) To allow the huge growth of data centers without having a grate impact on environment, energy efficiency must increase Source: Data Center Market - Global Outlook and Forecast 2018-2023 by Arizton

36. Energy Efficiency Metric PUE (Power Usage Effectiveness) is defined as follow It measures how efficiently the power is delivered to the IT equipment The PUE provides a way to: • improve a data center’s operational efficiency • Compare a datacenter with competitive ones Total facility power • Cooling • Chillers • Chilled water pump • Cooling towers • Condenser pumps • Dry coolers • CRACs & CRAHs • Fans • Humidifiers • In-row coolers • In-rack coolers • In-chassis cooling • etc • Power losses • Batteries • Transfer switch • UPS • PDUs • Transformers • Rack distribution units • Breaker panels • Distributed wiring • Lighting • Generators • etc + • IT equipments • Servers • Storage • Telco • etc Source: PUE: A Comprehensive Examination of the Metric by ASHRAE and The Green Grid

37. Energy Efficiency Three measurement levels Placement of the measurement equipment Utility feed Backup generators Generator paralleling switchboard L1 L2 L3 Main Distribution board L2 L2 UPS L1 Sub distribution board Mechanical switchboard RPPs L2 PDUs L3 L1 = Level 1L2 = Level 2 L3 = Level 3 = Required = Recommended L3 IT board Mechanical load Source: PUE: A Comprehensive Examination of the Metric by ASHRAE and The Green Grid

38. Energy Efficiency Standards EN 50600-2-2 (2014) Required: • Measurement of V, I, PF, E with accuracy: class 1 (± 1%) of EN 60044-1:1999 for non-billing purposes. Additionally kVA and kWh shall be monitored Recommended: • Measurement of total harmonic current distortion (THCD) total harmonic voltage distortion (THVD) Utility Feed Gen Granularity Level 1 Main Distribution Board Granularity Level 2 UPS Granularity Level 3 Mechanical load Secondary Distribution Board PDUs IT Loads

39. Energy Efficiency Modular Edge-connected data centers Uptime Institute survey showing PUE trend Background Growth of modern technologies such as IoT, Industry 4.0, Big Data, AI, cloud computing are driving the huge growth of data center industry Number of hyperscale data centers is increasing rapidly, 338 in 2016 and it is estimated to reach 628 in 2021 The projected growth of the data center segment in the next 5 years is 4% To allow this huge growth of data centers without having a great impact on environment, energy efficiency must increase Data centers are already recognizing this need, which has led to the huge decrease of PUE over the years from 2.5 in 2007 to 1.58 in 2018 There are two main challenges when it comes to the energy efficiency of a data center: to build an energy efficient data center and to be able to maintain or improve data center efficiency over the years. Up to 20% of total electrical energy goes into electrical distribution losses (UPS, cables, transformer…) 2.5in 2007 1.6 in 2018 Source: Uptime Institute Global Data Center Survey 2018 by Uptime

40. Energy Efficiency Modular Edge-connected data centers Up to Background Growth of modern technologies such as IoT, Industry 4.0, Big Data, AI, cloud computing are driving the huge growth of data center industry Number of hyperscale data centers is increasing rapidly, 338 in 2016 and it is estimated to reach 628 in 2021 The projected growth of the data center segment in the next 5 years is 4% To allow this huge growth of data centers without having a great impact on environment, energy efficiency must increase Data centers are already recognizing this need, which has led to the huge decrease of PUE over the years from 2.5 in 2007 to 1.58 in 2018 There are two main challenges when it comes to the energy efficiency of a data center: to build an energy efficient data center and to be able to maintain or improve data center efficiency over the years. Up to 20% of total electrical energy goes into electrical distribution losses (UPS, cables, transformer…) 20% of total electrical energy goes to distribution losses (UPS, cables, transformer…) Source: Data Center Market and Technology Trends Power Electronics presentation held at APEC 2016 from YoleDéveloppement Energy consumption in data center by The Green Grid Benefits of CHP in data centres by Clarke Energy High Performance Data Centers and Energy Efficiency Potential in Greece

41. Energy Efficiency Modular edge connected data centers Reduce down to ABB solution ABB high efficient power distribution solution is able to decrease distribution losses down to 5% ABB’s devices with embedded meters allow ease of implementation of 1% accuracy measurements and monitoring on all data center levels to ensure energy efficiency improvements based on accurate and detailed information 5% Electrical distribution losses 97.4% UPS efficiency on a system level in a double conversion mode Source: Data Center Market and Technology Trends Power Electronics presentation held at APEC 2016 from YoleDéveloppement Energy consumption in data center by The Green Grid Benefits of CHP in data centres by Clarke Energy High Performance Data Centers and Energy Efficiency Potential in Greece

42. Energy Efficiency Modular edge connected data centers ABB solution ABB high efficient power distribution solution is able to decrease distribution losses down to 5% ABB’s devices with embedded meters allow ease of implementation of 1% accuracy measurements and monitoring on all data center levels to ensure energy efficiency improvements based on accurate and detailed information 1% accuracy measurements and monitoring on all data center levels

43. Energy Efficiency DPA 250 S4 high efficiency UPS Featuring superior 97.6 percent UPS module efficiency and 97.4 percent system efficiency, the DPA 250 S4 reduces energy losses that create pure costs as direct electricity spend and costs for cooling. Thanks to three-level interleaved technology, the DPA 250 S4 achieves an efficiency of over 97 percent in a wide operating range, when the load is between 25 and 75 percent of nominal capacity Xtra VFI – double conversion mode maximizes efficiency under low-load conditions. Under this conditions, by using ABB’s intelligent Xtra VFI – double conversion mode, the DPA 250 S4 can step up the system efficiency by optimizing the number of modules used in double conversion mode to feed the load 98.0% 97.5% 97.0% Efficiency [%] 96.5% > 97% efficiency reached through wide operating range, typical for majority of applications 96.0% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60% 65% 70% 75% 80% 85% 90% 95% 100% Load [% of rated power] Double conversion mode Extra VFI – double conversion mode increases efficiency when load is low Xtra VFI mode

44. Energy Efficiency Highly efficient devices with measurement capabilities Embedded Metering Products • Circuit breakers: Emax 2 and Tmax XT • Ekip UP • TruONE ATS • Slimline XR Local monitoring system Cloud platform Utility feed Backup generators Main distribution board UPS Mechanical load RPDUs & IT load

45. Energy Efficiency Measurement Emax 2 and Tmax XT new generation of trip units offer same user experience over the whole range of circuit breakers from 160A up to 6300A New trip units provides: • Class 1 measurements certified according to IEC61557-12 • 0.5% accuracy for Current and Voltage measurement • 1% accuracy for Power and Energy measurement • Up to 50th harmonic with network analyzer

46. Energy Efficiency Remote Power Panels CMS – 700 and M2M Meters Values • Easy to install and appropriate for new and existing installations • Reduce downtime by early detection of potential issues • Easy commissioning via webserver • Minimum space requirement • AC, DC and mixed current measurement • Scalable and flexible bus wiring • Communication protocols enable integration into infrastructure management software (e.g. SNMP v3) Local monitoring system Cloud platform Utility feed Backup generators Main distribution board UPS Mechanical load RPDUs & IT load

47. Energy Efficiency Device Connectivity Power of data Emax 2, Tmax XT (new generation), Ekip Up and TruOne devices are embedded with 10 native communication protocols to allow interconnection among all ABB devices as well as 3rd party devices • Ekip Com Modbus RTU • Ekip Com Profibus DP • Ekip Com DeviceNet • Ekip Com Modbus TCP • Ekip Com ProfiNet • Ekip Com Ethernet/IP • Ekip Com IEC 618501 Ekip Com Profbus DP module Ekip Com Modbus RTU module Ekip Com DeviceNet module • Ekip link1 • Ekip Com Hub • EkipSignalling(2K, 4K1 and 10K2) • Ekip E-Hub2 Ekip Com HUB module Ekip UP Ekip Com Modbus TCP module Emax 2 Tmax XT Ekip Com IEC 61850 module Ekip Com Profinetmodule Ekip Com EtherNet/IP module Data Management 1. Not available with TruONE 2. DIN-rail mounted

48. Energy Efficiency ABB Value Proposition ABB Ability EDCS for data centers Local monitoring system Cloud platform Utility feed Backup generators Main distribution board UPS Mechanical load RPDUs & IT load

49. Energy Efficiency Communication MV + TRAFO integration EDCS + Local Control system + 61850 CONTROL SYSTEM Cloud Platform SCADA-serverIEC 61850 RJ45 Ethernet cable IEC 61850 To local BMS system Modbus TCP/IP Utility REF 542 PLUS; REF 6xx Modbus RS485 Analog/Digital signal (impulse) Section 1 Section 2 Section 3 Open/close/tripped MV/LVTransformer Digital input DI Analog input AI Temperature. Oil level… EKIP E-HUB 61850 HUB TCP/IP ACBs MCCB Loads

50. Energy Efficiency Environmental data – Ekip Signaling 3T