Mission Critical Power Review - E Technologies€¦ · Mission Critical Power Review Understanding concepts of mission critical power designs ... • Standby • Eaton 3105 • Double

Mission Critical Power Review

Understanding concepts of mission critical power designs

Chris Loeffler, [email protected] Spears, [email protected] Quality Global HQ, Raleigh, NC

2 2

Did you know?

• Eaton is the #2 UPS manufacturer worldwide for single phase systems.

• Eaton is the #1 UPS manufacturer worldwide for UPS systems > 5kVA.

• Eaton is the leading IT Sector OEM UPS Manufacturer

3 3

Covering 10-1100 kVA with single systems - Providing paralleled capacity up to 8.8 MVA

Three-Phase Product Lineup

4 4

Eaton Solutions Are Different, They Are Designed To Deliver Efficient Uptime

Eaton Backup Power solutions solve many of the challenges seen in other backups. Eaton solutions are designed to deliver:

5 5

Today's agenda

• UPS designs• Reliability and Availability • Types of redundancy• Improving redundancy • Options for power distribution flexibility• Energy efficient designs• Additional considerations • Closing

6 6

Do you find yourself asking:

• What makes the best sense for me?• How much redundancy do I need?• What is the best approach to save money?• How much is this going to cost?

7 7

UPS Designs

• Standby • Eaton 3105

• Double Conversion • Eaton 9130• Eaton 9355

• Multi-mode • Eaton BladeUPS• Eaton 9395

• Line Interactive • Eaton 5130• Eaton 5PX

8 8

Reliability vs. Availability

• Reliability is many times expressed as the products expected operational time before it quits operating properly• MTBF – Mean Time Before Failure

• MIL-HDBK-217F • Telcordia (Bellcore) SR-332

• MTBF is NOT a good measure of performance• “Availability” is a better measure

Availability = MTBF

MTBF + MTTRMTTR = Mean time to repair

Availability is usually expressed by the “number of 9’s”

9 9

Types of redundancy - improving availability

• No redundancy• Subsystem redundancy • Parallel redundancy• (N+1) redundancy • (2N) redundancy • (2N+1) redundancy

10 10

Subsystem A

λ 1

Subsystem B

λ 2

Subsystem C

λ 3

Subsystem D

λ 4INPUT OUTPUT

No Redundancy Power System

• All devices are serially connected

• A fault in any device causes downtime

11 11

Power Architectures Tier I

Tier level definitions per the Uptime Institute

12 12

How to increase “availability”

• Batteries are typically a UPS systems weakest point

Battery Battery Battery Battery Battery

Series connected

UPS System

Parallelconnected


Series connected


UPS System

• For additional reliability add an external battery monitor

13 13

How to increase “availability”

• Add a maintenance bypass in case of a system fault, or you need to work on the UPS/battery.

Maintenance Bypass (Manual)Utility AC

14 14

Eaton 9390

UPSBattery Cabinet

Maintenance Bypass/Distribution

Parallel Battery Cabinet

15 15

Eaton 5130

UPS with internal battery

Second Parallel Battery Module

Maintenance Bypass

16 16

Power Architectures Tier II

Tier level definitions per the Uptime Institute

17 17

Subsystem redundancy

• Redundancy in electronics• Some designs may include some redundant

internal components, but still contain a number of sub systems that are “common”.

Subsystem A

λ 1

Subsystem B

λ 2

Subsystem B

λ 2

Subsystem B

λ 2

Subsystem C

λ 3

Subsystem D

λ 4INPUT OUTPUT

18 18

Parallel redundancy

• Parallel Redundant systems.• The highest level of redundancy, because there are

no, or very simple redundant components, which have a minimal impact to overall reliability. These systems should also have “peer to peer” control capability, as then a control issue in one system will not impact another.

Subsystem A

λ 1

Subsystem A

λ 1

Subsystem A

λ 1

OUTPUTINPUT

19 19

Increasing power infrastructure “availability” N+1 systems

30 kVA 30 kVA 30 kVA 30 kVA

Load 90 kVA total

Any single UPS can be taken off line for maintenance or repair

20 20

Redundancy Scale

None Maximum

Which is more reliable?

System “A”

System “B”Redundancy Scale

None Maximum

21 21

Product examples of subsystem vs. parallel redundancy

System “A”

System “B”BladeUPS9355

Competitors products

9155 9E

9390

Eaton products

9395

22 22

Static Bypass

Maint B

ypass

Redundant components in a BladeUPS 60 kW (N+1) system

UPS 1 UPS 4UPS 2 UPS 3 UPS 5 UPS 6

Battery system Battery breaker Static Bypass Switch Logic Control

Maintenance Bypass Switch

Rectifier and Inverter

23 23

Maintaining a parallel rack system design

Power outPower in

Battery end of life

Failure of power module

Failure of chassis

In a BladeUPS system, all parts can be replaced by

end user or any other service provider.

24 24

PowerVaul t530F

Po werVa ult210 S

6

7

3

41

0

P o we r E d g e 2 9 5 0

6

7

3

41

0

P o we r E d g e 2 9 5 0

Po werVa ult210 S

PowerVault530F

Powe rVault2 10S

6

7

3

41

0

Po we r E d g e 29 5 0

6

7

3

41

0


Powe rVault2 10S

PowerVault530F

Powe rVault2 10S

6

7

3

41

0


6

7

3

41

0


Powe rVault2 10S

PowerVault530F

PowerVault530F

Power system integrated into the IT space

+12kW

• Modular power and power distribution• Using the Eaton RPM (rack power module) a

small initial UPS deployment can be easily expanded over time.

• 12kW power building blocks

• 12kW power distribution building blocks

• All power distribution in the racks

• Extra battery capacity can go in any cabinet

• Reduced need for electrical contractors

• Increase power and distribution on the fly

• Customers can change out power distribution

Total load 12kW 24kW 48kW

12kW

N+1

Red

unda

nt U

PS P

ower

24k

48k

+24kWRPM “ePDU”

25 25

Standalone “horizontal” parallel system

26 26

If total system is redundant (N+1), failure of any one system does not effect critical bus

Protected AC from inverters

4 x 80kVA (320) or 240kVA N+1 parallel system

27 27Tier level definitions per the Uptime Institute

Power Architectures Tier III

28 28

Increasing power infrastructure “availability”

Adding power supply redundancy at the server

UPS 1

Power panel

1

Power panel

2“A”

side

power

“B”

side

power

Tier III deployment, one power

source can be off-line for service or

repair

29 29

Increasing power infrastructure “availability” 2N systems

UPS 2

UPS 1

Power panel

1

Power panel

2“A”

side

power

“B”

side

power

2N deployment, one power

source can be off-line for service or

repair

30 30Tier level definitions per the Uptime Institute

Power Architectures Tier IV

31 31

Maximum power infrastructure “availability” 2N+1 systems

UPS 2B

UPS 1A

Power panel

1

Power panel

2

UPS 1B

UPS 1C

UPS 2C

UPS 2A

Rack Transfer switch (ATS)

32 32AC Unit

UPS RPP

AC Unit

UPS RPP

Today - Modular approach to IT

33 33

IT lo

ad e

quip

men

t

Modular building block concepts

• High density small footprint:• Each 12 kW BladeUPS system is 6U

and includes battery with automated maintenance bypass.

• Each 6U system can be a single system in a standard IT cabinet, supporting up to 12 kW

• Build a 12 to 60 kW N+1 system in 1 cabinet with up to 6 modules connected in one 42U cabinet.

12kW

24kW

36kW

48kW

60kW

60kW N+1

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

12kW

Single BladeUPS Scalable BladeUPS

PowerVault530F

PowerVault210S

PowerVault210S

6

7

3

41

0

P o w e r E d g e 2 9 5 0

6

7

3

41

0

P o w e r E d g e 2 9 5 0

6

7

3

41

0

P o w e r E d g e 2 9 5 0

Compute expansion needed

34 34

275 kVA Redundant! 550 kVA Redundant!On-site upgrade

Flexible, Scalable, Upgradeable

• Add another 275 kVA in the field for redundancy, or for capacity

• Simply choose an ISBM sized for future growth• Leave space on the left side

• Enables flexibility for future changes in load demands, and new requirements for higher reliability

On-site upgrade

35 35

Project BlueGrass – sites (Louisville, KY)Blue Site

• 20.7 acres• Expandable to support 6 data halls @ 10K sq. ft. • Max power density of 180 w/sq. ft. • 14 miles from Red Site

Red Site • 30 acres • Expandable to support 6 data halls @ 10K sq. ft. • Max power density of 180 w/sq. ft. • 14 miles from Blue Site

36 36

Blue Grass Design

Blue and Red Facilities are identical

• Overall facility – 102,000 sq. ft. • Office space – 10,000 sq. ft.

• Gray space: Electrical infrastructure – 35,000 sq. ft.

Mechanical infrastructure – 14,000 sq. ft.

• White space: Two data halls @ 10,000 sq. ft. each Power density 90 w/sq. ft. (day one) Upgrade steps at 120 and 180 w/sq. ft.

• All electrical and mechanical infrastructure components are redundant (n+1)

37 37

Out of UPS power (1500 sq ft floor)

AC Unit AC Unit

300kVA

AC Unit

150kVA PDU150kVA PDU

UPS room

Existing UPS will not support additional equipmentNeed to add 10 racks of Blade Servers, replacing two full rows of ~4kW per rack equipmentWould like 2(N+1) UPS protection for Blades

300

kVA

UPS

38 38

Modular concept in existing space

AC Unit AC Unit

300kVA

AC Unit

150kVA PDU150kVA PDU

Modular UPS

Modular UPS

Modular UPS

Modular UPS

6U Rack PDU

150 kVA

XFMR

150 kVA

XFMR

6U Rack PDU

6U Rack PDU

6U Rack PDU

6U Rack PDU

6U Rack PDU

6U Rack PDU

6U Rack PDU

6U Rack PDU

6U Rack PDU

High density – high availability compute 2(N+1) power

Standard density – standard availability N only power level

Area that could have density increased to 15 kW per rack

300

kVA

UPS

39 39

What are other considerations:

What size module is the right size?

What is the price I will pay for additional reliability?

40 40

The Value of EatonThe Value of Eaton

Eaton Three-Phase UPSs

provide the greatest combination of benefits, delivering tangible benefits for specifying engineers, consultants and end users

» Lowest Total Cost of Ownership industry-wide

» Superior Performance and efficiency

» Real-time Information and Control

» World-class Support and Service

Eaton 9390

41 41

Low TCOLow TCO

Eaton UPSs

deliver low TCO from advances in several product facets» 400V Site Design» High Power Density – small system footprints» Reduced weight and transportation costs» Low installation and Leading Efficiency – Quantifiable Benefits» Maintenance» Scalability

Low TCOImproving the bottom line

42 42

UPS Efficiency over time

43 43

Low TCO Low TCO –– Leading EfficiencyLeading Efficiency

Two complementary Eaton-proprietary technologies, maximizing UPS efficiency under any condition!

Energy Advantage Architecture Higher System Efficiency No Compromise On Reliability

Energy Saver Systems (ESS)» The ultimate savings: 99% efficiency» Automatic fast transfer to double conversion

mode when needed (in less than 2 ms)

Variable Module Management System (VMMS)» Maximized efficiency in double conversion mode» Both in single- and multi-UPS systems applications

44 44

Energy costs

are overwhelming equipment costs in data centers.» UPS electrical losses account for 5-10%

of the overall electrical expenditure.*

Eaton’s Energy Saver System drives these losses down to nearly zero.

The energy savings recovers the cost of the UPS in less than 5 years.

* Underlying figures from The Invisible Crisis in the Data Center: The Economic Meltdown of Moore’s Law, Uptime Institute, 2007


45 45

ESS Efficiency 99% –

across the complete operating range


46 46

The energy savings from ESS typically recovers 100%

of the UPS cost over a 3-5

year period» At 250kW of critical load, the savings is equivalent

to $4000 per year per point of efficiency gain.

Backing up your 250kW load with an ESS UPS is equivalent to pulling 29 cars off the road.


47 47

How to maximize efficiency with lighter loads in double conversion mode, especially in multi-UPS and redundant system configurations?

Solution #2: Eaton 9395 and its Variable Module Management System» Automatically optimize efficiency at UPM level

• Concentrate the load on certain UPM’s to maximize overall system efficiency

» Only possible thanks to modularity of Eaton 9395 UPS• Not limited to multiple-UPS systems• Achieve even higher optimization thanks to UPM’s modularity

Solution #1: Concentrate load on certain UPS’s to maximize UPS load level and overall system efficiency» Some energy savings

• Limited to multiple-UPS systems (with several UPS in parallel)• Still not optimal


48 48

Example with same load applied to different multi-UPS configurations


49 49

VMMS allows to shift to higher efficiency curves

(according to system’s redundancy requirements)

up to N+0 VMMS

efficiency curve

VMMS

allows to shift to higher efficiency curves


up to N+0 VMMS

efficiency curve

VMMS

allows to shift to higher efficiency curves


up to N+0 VMMS

efficiency curve

9395 UPS Efficiency

78

80

82

84

86

88

90

92

94

96

27.5 55 110

165

220

275

330

385

440

495

550

605

660

715

770

825

880

935

990

1045

1100

Load kVA

Effic

ienc

y %

Eaton 9395 275kVA UPS




9395 275kVA9395 550kVA9395 825kVA9395 1100kVA9395 VMMS N+0

Typical Operations Range

Notes:

-

Scaled drawing

-

VMMS and N+0 curves using VMMS default max

UPM % load level @ 80% (*)

9395 550kVA with VMMS and N+0 configuration*9395 825kVA with VMMS and N+0 configuration*9395 1100kVA with VMMS and N+0 configuration*


50 50

Low TCO Low TCO –– 400V Site Design400V Site Design

480V AC» Losses through the UPS, isolation transformer/PDU, and server equipment» End-to-end efficiency of approximately 76%

51 51


600V AC» Used primarily in Canada» Can provide small savings in equipment costs, and utilizes lower currents» Requires multiple isolation transformer-based PDUs» End-to-end efficiency of approximately 76%

52 52


400V AC» Commonly used throughout the world» PDU isolation transformers eliminated» End-to-end efficiency of approximately 80%

53 53

Options to increase flexibility• Maintenance bypass, PDUs, RPPs, paralleling cabinets, ATS

switches, 9155 & 9355 paralleling cabinets

9155 & 9355 bypass w/receptacle options

BladeUPS & 9355 rack power distribution Rack ATS switches

Power Distribution

RackPDUStatic Switch Remote

Power Panel

Data Center Bus Way

DC Systems

54 54

RealReal--time Information and Controltime Information and Control

• Keeping data centers and facilities online requires real-time information and control capabilities.

• Eaton UPSs offer flexible options to interface with multiple systems and give customers the best control.

Real-time Information and Control

Real-time Information and Control

55 55

Power Xpert and IPM Software

H2O

Compute• Main Frames• Volume Servers• Blade Servers

Storage• SATA Disk• Tape• Blended

Network• Corporate Networks• VoIP• Integrated Blade/Switch

Ice

Pumps

Chiller

Compute

Storage, Network

In-row Power& Cooling

Precision Cooling

DC Power

Low Voltage 600VAC Eqpt

Medium Voltage >600VAC Eqpt

Generator

Parallel or TransferEquipment

UtilitySubstationand Metering

In-Row Power and Cooling• Modular UPS• Rack Mount PDUs• In Row Cooling

• Rear Door Heat Exchanger• Liquid Cooling Racks

Central UPS

Power Distribution UnitsStatic Auto-Tie

CHP Fuel Cell or MicroTurbine

IT and NetworksIT and Networks

Tower

Eaton SoftwareEaton Software

Utility Monitoring

FacilityMonitoring

BusinessProcesses

ITMonitoring

IPM, IPP, IPM, IPP, vCentervCenterPower Power XpertXpert Software, Reporting & ForeseerSoftware, Reporting & Foreseer

CoolingCooling

PowerPower

Raised FloorRaised Floor

Power ManagementPower Management

56 56

Software Offerings

IPM –Intelligent Power Manager

PX –Power Xpert

57 57

Power Xpert Built in User View Templates - Geographical Layout Example

Data Center LIVE Webcam video stream embedded into PXS

Data Center LIVE Webcam video stream embedded into PXS

Events bubble up and change City-label colors accordingly

Events bubble up and change City-label colors accordingly

Local Weather LIVE webpage embedded Local Weather LIVE webpage embedded

http://10.222.50.187/powerxpertsoftware

http://10.222.50.187/powerxpertsoftware

58 58

Layout Manager - Design the GUI to your liking

The user can choose from a variety of available gauges The user can choose from a variety of available gauges

The Power Xpert Layout Manager provides the user a library of powerful design tools for the creation of custom Human-Machine Interface (HMI) graphical layouts. Objects can be easily animated, various gauges can be selected and custom bitmaps can be imported with little effort. The Layout Manager software module is included with Power Xpert Software as standard!


Indicators can appear animated and change color on status changes

Indicators can appear animated and change color on status changes


Custom mathematical formulas are supported to create calculations based on multiple variables e.g. PUE, DCiE

Custom mathematical formulas are supported to create calculations based on multiple variables e.g. PUE, DCiE

3rd party devices can be integrated into custom layouts easily.

3rd party devices can be integrated into custom layouts easily.

Custom bitmaps and graphical elements can be easily imported

Custom bitmaps and graphical elements can be easily imported

Custom layouts can be created for any supported devices

Custom layouts can be created for any supported devices

Links to other custom layout web pages can be easily embedded for drilling up or down for more information

Links to other custom layout web pages can be easily embedded for drilling up or down for more information

Review and acknowledge critical and cautionary alarms at-a-glance

Review and acknowledge critical and cautionary alarms at-a-glance

59 59

Trend ViewerTrend Viewer - Understand where things are heading

• High performance, easy to use, Web based trending

• Three ways to interact• Select attributes for a device from the

Grid View• Select attributes from multiple devices

from Trend Viewer page• Can save Trend Groups for easy future

access• Check attribute boxes on a User View

• Trend Display• Chart or Data option

• Mix and match• Multiple trends at one time• Multiple axis supported• Fixed or custom time frames• Export results to Excel

http://pqsosm.ch.etn.com:8081/wiki/lib/exe/detail.php?id=pxs:r3:trend_viewer_controls_implementation&cache=cache&media=pxs:r3:launchtrendviewer1.png



60 60

Monitoring points to understand efficiency

61 61

Summary

• Energy efficiency is peaking in interest• Use this opportunity to push high efficiency platforms

• IT Virtualization is hot• Requires highly reliable power infrastructure• Eaton’s software integration into VM’s is leading edge

• IT budgets are still recovering• Customers are looking for modular “build as you grow”, and some

level of increasing availability without a lot of extra cost

• Complete solutions are preferred• Reductions in staff require simpler to purchase, deploy and manage

solutions, and delivering flexible options means additional $

62 62

Documents

Mission Critical Power Review - E Technologies€¦ · Mission Critical Power Review Understanding concepts of mission critical power designs ... • Standby • Eaton 3105 • Double