TCO scoring model for effective data center solutions presentation

Presented by Ron Budicky and Debra Vieira

TCO Scoring Model for Effective Data Center Solutions

2CH2M HILL/IDC Architects Confidential and Proprietary

Debra Vieira has more than 20 years of experience in design of electrical systems for data centers and industrial facilities. As a data center specialist, she has developed recommendations for innovative data center upgrades and improvements and leveraged those innovations facility-wide through her active involvement in the planning, design and commissioning activities required for implementation of advanced mechanical and electrical infrastructures around the world.

Ronald Budicky has 28 years of experience in electrical engineering. He has served as a lead electrical engineer on many mission critical advanced technology facilities including data centers considered among the most advanced in the world. His vast knowledge of facility optimization is the product of his extensive experience in all aspects of facility design including programming, concept development, schematic design, design development, and construction documents.

Team BIOs


AGENDA

• Key factors that impact the TCO Scoring Model

• Review of TCO Scoring Model Process

• TCO Scoring Form

• Conclusion

• Questions

TCO Overview and Key Factors

Significant number of decisions

Many times analysis is based on cost alone, ignoring other important subjective factors, which all too often can lead to a facility that does not perform as expected.


What is the TCO Scoring Model

TIER?

TECHNOLOGYTOPOLOGY

COST

NEXT STEP

SCALABLE MODULAR

Establishing overall cost is the first and most basic component of the model development.


TCO Scoring Model Factors

0.0

5.0

10.0

15.0

20.0

25.0

0 5 10 15

M$

/ MW

IT (U

SD)

MW IT Capacity

Construction Costs: ~Tier 3 – M$/MW IT

What is your decision process?– Install Cost– Energy Usage– Reliability– Scalability– Total Cost of Ownership

This is an incomplete decision-making approach.

There is a need for a more rigorous analysis of the many design and operational component

options than a simple TCO model can provide.


CH2M HILL/IDC Architects Confidential and Proprietary 7

What about:– Simplicity of Scalability– Construction Impacts &

Lead Times– Flexibility for future

technologies & increased densities

– Sustainability beyond energy

– Vendor support through the life cycle of the facility or product


We will evaluate these decisions within a collaborative, constructive, inclusive and interactive

framework that clients often find quite effective.

Additional Components of TCO Analysis



The TCO scoring model is a tool that allows you to take

into account all parts of a design to give you a probable

cost of construction to enable clients to make a decision on

how to move forward. This includes capital and operating

costs of systems selected.


Factors Considered in the TCO Scoring Model

Facility’s Unique Functional Technology and Enhancing Reliability

– Scale (MW/Cost)– Electrical Topology Choices (Complexity vs.

Cost)– Flexibility and Expandability– Cooling Approaches– Location (Construction Labor, Land Cost)– Buyout Approaches (GC@Risk, Cost)

• Equipment & Contractors• Cost + Open Book

– Technology Choices– Eliminate Single Points of Failure– Fail Small Approach– Commissioning

11


Rapid Prototyping

CH2M HILL/IDC Architects Confidential and Proprietary

12


Rapid Prototyping


1

1.1

1.2

1.3

1.4

1.5

1.6

1.7

DX Chiller (noecon)

Waterside Indirect Airside Direct Airside plus HE Elec plus ElevatedTemps

plus chillerless

PUE

(App

roxi

mat

e)

13

PUE Approach for TCO Scoring Model


TCO Analysis

15

SL-01 2N SINGLE LINE

Mech Loads

Mech Loads

LB

STS

LBFA/LSS/SEC

vv

PDU PDUPDU PDUPDU PDU

UPS STSUPS

1 .1MWN

1.1 MWN

LB LB

Utility A Utility B

STSUPS

1.1 MWN

STSUPS

1.1 MWN

PDU PDU PDU PDU

2N

UPS

Key: Green-Phase 1Gray-Phase 2


16

SL-02 N+1 SINGLE LINE

MechLoads

STSUPSN

UPSN Mech

Loads

UPSN+1

STS STS STS STS

PDUPDUPDUPDU

PDUPDUPDUPDU

PDUPDUPDUPDU

PDUPDUPDUPDU

1.1 MWTypical

N+1

Utility A Utility B

Key: Green-Phase 1Gray-Phase 2


17

SL-03 ISO/STS SINGLE LINE

To B SideSTS/PDU

To A SideSTS/PDU

MechLoadsUPS

FA/LSS/SEC

MechLoads

UPS STS

To Phase 3UPS STS

UPS STSSTSUPS

1.1 MWN

1.1 MWN+1

1.1 MWN

STS

PDU

STS

PDU

To “B”Bus

To “B”Bus

STS

PDU

STS

PDU

To ”A”Bus

To “A”Bus

ISOKey: Green-Phase 1Gray-Phase 2

Utility BUtility A


18

UPS Technology Efficiency Comparison


Year Load Part Load (1100 kW)

Normal Mode Efficiency (1100 kW) Energy Cost UPS Maintenance Battery maintenance (1100 kW) Total (1100 kW)

0

1 257 23% 89.5% 0.076 $2,500 $11,000 $13,500

2 679 62% 92.1% 0.079 $2,575.00 $11,330.00 $13,905

3 834 76% 92.1% 0.081 $2,652.25 $11,669.90 $14,322

4 920 84% 91.9% 0.083 $2,731.82 $12,020.00 $14,752

5 1007 92% 91.7% 0.086 $2,813.77 $12,380.60 $15,194

6 1104 50% 91.9% 0.088 $2,898.19 $12,752.01 $15,650

7 1216 55% 92.0% 0.091 $2,985.13 $13,134.58 $16,120

8 1350 61% 92.1% 0.094 $3,074.68 $13,528.61 $16,603

9 1517 69% 92.1% 0.097 $3,166.93 $13,934.47 $17,101

10 1735 79% 92.0% 0.099 $3,261.93 $14,352.51 $17,614

11 2027 92% 91.7% 0.102 $3,359.79 $14,783.08 $18,143

12 2171 99% 91.5% 0.106 $3,460.58 $15,226.57 $18,687

13 2371 72% 92.1% 0.109 $3,564.40 $15,683.37 $19,248

14 2572 78% 92.0% 0.112 $3,671.33 $16,153.87 $19,825

15 2772 84% 91.9% 0.115 $3,781.47 $16,638.49 $20,420

Notes:2014 Energy Rate: $0.074/kW-hrTotal load extended linearly past year 11


UPS TCO Scoring Factors

Breakdown SL-01 SL-02 SL-03

Tier 4 Tier 3 Tier 3

0.8HRS/YR (99.99%) 1.6HRS/YR (99.98%) 1.6HRS/YR (99.98%)

2N UPS N+1 (SCC) ISO RED /STS

(M$) (M$/MW) (M$) (M$/MW) (M$) (M$/MW)

1 MW IT 3.0 3.0 3.4 3.4 3.3 3.3

2 MW IT 5.2 2.6 4.7 2.4 4.7 2.4

4 MW IT 10.4 2.6 9.4 2.4 9.4 2.4

Note: Costs are based on use of 20 year VRLA at 15 min EOL

Note: Costs are based on system from Substation level down to panel/PDU for distribution

Note: Tiers and reliability numbers above (unplanned failures-downtime/yr. & % availability) are based on Uptime Institute


Summary of Electrical UPS Power Options


UPS Options – Initial Capital Outlay

2.0

3.0

4.0

5.0

6.0

7.0

8.0

9.0

10.0

1 MW IT 2 MW IT 4 MW IT

M$

UPS Options - Initial Capital Outlay

2N UPS

N+1 (SCC)

ISO RED /STS

Given:2 MW Critical Load @ Full Build Out @15 Min VRLA @20 years

1100 kW Modules Load Running Hours AnnualQuantity kW (ea.) Total Full Energy Cost Peak Energy

1IT Load 1 257 257 8,760 $171,759 $171,759 Normal Mode Efficiency (1100 kW) 1 27 27 8,760 $18,035 $18,035 UPS Subtotal $189,793 $189,793




12IT Load 1 2,171 2,171 8,760 $2,006,108 $2,006,108 Normal Mode Efficiency (1100 kW) 1 184 184 8,760 $170,519 $170,519 UPS Subtotal $2,176,627 $2,176,627





Energy & Cost Analysis by UPS/Battery Option (1100 kW)


Battery TCO Scoring Factors

Assumptions:1. Prices below are based on single 1100kW UPS module.2. Building Cost per sqft: 150.00$ 3. Inflation rate for annual maintenance: 3%4. Annual discount rate: 5.0%5. Additional costs for 10 yr VRLA technology include battery monitoring (factory wired).6. Additional costs for 20 yr VRLA technology include battery monitoring field wired. No rack or cabinet for "stackable" jars.7. Additional costs for Wet cell technology include disconnect, and spill containment (at $150/SF of rack footprint per vendor quote).8. Install costs for 20 yr VRLA and 20 yr. Wet cell = 20% of battery cost+additional cost, 10 yr VRLA install costs = 15% due to cabinet vs. rack and factory installed battery monitoring.Budgetary information from vendors

Type TimeVRLA 10yr 10 min. 10 min. VRLA 10yr 4 60.4 $0 384 $57,600 $27,000 $35,000 $119,600 $180,000 $108,000 3-5 years 3,510.00$ 5 17,550.00$ VRLA 10yr 15 min. 15 min. VRLA 10yr 6 90.7 $0 576 $86,400 $31,500 $50,000 $167,900 $210,000 $126,000 3-5 years 3,510.00$ 6 21,060.00$ VRLA 10yr 20 min. 20 min. VRLA 10yr 6 90.7 $0 768 $115,200 $41,400 $70,000 $226,600 $276,000 $165,600 3-5 years 3,510.00$ 8 28,080.00$

VRLA 20yr 10 min. 10 min. VRLA 20yr 4 60.4 $0 480 $72,000 $64,200 $70,000 $206,200 $321,000 $192,600 12-15 years 5,500.00$ 2 11,000.00$ VRLA 20yr 15 min. 15 min. VRLA 20yr 5 75.6 $0 720 $108,000 $71,000 $70,000 $249,000 $355,000 $213,000 12-15 years 5,500.00$ 2 11,000.00$ VRLA 20yr 20 min. 20 min. VRLA 20yr 6 90.7 $0 960 $144,000 $97,420 $70,000 $311,420 $487,100 $292,260 12-15 years 5,500.00$ 2 11,000.00$

Wet Cell 10 min. 10 min. Wet Cell 5 202.5 $15,000 600 $90,000 $37,400 $163,875 $291,275 $187,000 $112,200 12-15 years 8,500.00$ 1 8,500.00$ Wet Cell 15 min. 15 min. Wet Cell 5 202.5 $30,000 900 $135,000 $43,000 $163,875 $341,875 $215,000 $129,000 12-15 years 8,500.00$ 1 8,500.00$ Wet Cell 20 min. 20 min. Wet Cell 5 202.5 $30,000 1200 $180,000 $50,000 $163,875 $393,875 $250,000 $150,000 12-15 years 8,500.00$ 2 17,000.00$

Battery # cabinets or racks

Rack/Cabinet Area (FT²)

QuoteBuilding CostRoom AreaRack/Cabinet Cost

Install CostFull Name

Initial Annual

Total Install

Additional Cost

Replacement Cost

Replacement Time PM Service per string

Number of Strings

UPS Install Cost Battery Cost Number of Units Battery Replacement

2N UPS $5,200,000 $355,000 4 $852,000

N+1 (SCC) $4,700,000 $355,000 3 $639,000

ISO RED/STS $4,700,000 $355,000 3 $639,000


Maintenance Cost Analysis by Option


Battery Options (Pros & Cons)

Pros Cons

10 yr. VRLA

Less Maintenance Shorter Life, 3-5 Yr. Replacement

Less Gassing 10 Year Design Life

Safer to handle, electrolytes are contained, do not corrode. Fails Open

No Spill Containment Needed Less Heat TolerantLess Space Required Battery Monitoring System

Lowest First Cost Thermal RunawayHigher Power Density

20 yr. VRLA

Less Maintenance Fails Open

Less Gassing Less Heat Tolerant

Safer to handle, electrolytes are contained, do not corrode. Higher First Cost

No Spill Containment Needed Battery Monitoring SystemLess Space Required Thermal Runaway

Longer Life, 12 to 15 Yr. Replacement

Higher Power Density

Wet Cells

Longer Life, 12 to 15 Yr. Replacement Requires H2 gas monitoring and ventilation to exhaust H2 gas emitted during charge

Warning Before Failure Higher Maintenance Required

Middle Cost More hazardous to handle due to acid electrolyte

More Heat Tolerant Spill Containment Required

No Battery Monitoring Required More Space RequiredLower Power Density


Battery TCO @ 1100kW

Inflation: 3%Annual Discount Rate: 5.0%

15 min. Wet Cell

YEAR DESCRIPTION Cost Running Total

Annual Discount Rate 5.0%

Initial cost of investment $215,000 $215,000

Racks $30,000 $245,000

0 Total Install Cost $341,875 $586,875

1 Annual Maintenance - yr. 1 $8,500 $594,970











12Annual Maintenance - yr. 12 plus Total String Replacement cost $140,766 $746,292




15 min. Wet Cell $765,208

15 min. VRLA 20 $860,431

15 min. VRLA 10 $900,876


Battery 15 Year Total Cost of Ownership - 1100kW

$0

$100,000

$200,000

$300,000

$400,000

$500,000

$600,000

$700,000

$800,000

$900,000

$1,000,000

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Battery 15 Year Total Cost of Ownership - 1100kW

15 min. Wet Cell

15 min. VRLA 10yr

15 min. VRLA 20yr


Total Cost of Ownership (TCO) Analysis by UPS/Battery Option

Running Total Option 1 DESCRIPTION5.0% Annual Discount Rate

$5,200,000 $5,200,000 Initial Cost: UPS & Battery$5,393,613 $203,293 Annual Operating Cost Year 1$5,862,943 $517,437 Annual Operating Cost Year 2$6,425,353 $651,059 Annual Operating Cost Year 3$7,033,661 $739,402 Annual Operating Cost Year 4$7,686,678 $833,434 Annual Operating Cost Year 5$8,386,322 $937,590 Annual Operating Cost Year 6$9,140,106 $1,060,649 Annual Operating Cost Year 7$9,958,909 $1,209,746 Annual Operating Cost Year 8

$10,860,242 $1,398,263 Annual Operating Cost Year 9$11,870,421 $1,645,476 Annual Operating Cost Year 10$13,029,826 $1,982,976 Annual Operating Cost Year 11$14,723,797 $3,042,127 Annual Operating Cost Year 12$16,022,562 $2,449,016 Annual Operating Cost Year 13$17,404,818 $2,736,771 Annual Operating Cost Year 14$18,867,112 $3,040,004 Annual Operating Cost Year 15

2N UPS

$18,867,112 Total Cost of Ownership (TCO)

Option 2:

Total Cost of Operation

Estimated Initial Capital Cost

$13,667,112

$5,200,000

Notes:1) Battery replacement at Year 12

Given:2MW Critical Load @ Full Build Out @15 Min VRLA @20 years

Option 1:

Option UPSTotal Cost of

OperationEstimated Initial

Capital CostTotal Cost of

Ownership (TCO)

1 2N UPS $13,667,112 $5,200,000 $18,867,112

2 N+1 (SCC) $13,548,506 $4,700,000 $18,248,506

3 ISO RED/STS $13,548,506 $4,700,000 $18,248,506


TCO Summary


UPS System Annual TCO Comparison (15 Year Period)

$4,000,000

$6,000,000

$8,000,000

$10,000,000

$12,000,000

$14,000,000

$16,000,000

$18,000,000

$20,000,000

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

TCO

in N

PV

UPS System Annual TCO Comparison (15 Year Period)

2N UPS

N+1 (SCC)

ISO RED/STS


TCO Scoring FormOption Evaluation Document - Data Centers Project

Key Decision Number: KD-014A KD-014A KD-014AKey Decision Description: 2N

(SL-01)Parallel Redundant

N+1(SL-02)

Iso-Redundant w/STS(SL-03)

Key Decision Sub-Option Number: 1 2 3Option Scoring Score Score Score1 Fatal Flaw? No No No2 Safety: 10 10 10 should be no difference3a TCO NPV: (Based on 2MW IT load) 18,867,112 18,248,506 18,248,506 3b TCO Score: 7 8 8 Based Lower to Higher score based on cost4 Cost Containable within Established Budget? Yes Yes Yes5 Enables Competitive Bidding 9 9 96 Provides a Concurrently Maintainable Solution 10 10 107 No single points of failure 10 10 108 Meets desired resiliency level (i.e. Tier) 10 10 109A Risk Avoidance: Technology (extent proven for application) 9 8 8 Scored 2N highest based on clients past use9B Risk Avoidance: Data Center Reliability 9 8 8 Scored 2N highest based on clients past use9C Risk Avoidance: Construction Schedule Delay from Baseline 8 8 810 Sustainability (other than energy) 8 8 811 Scalable in Appropriate Increments in a Non-Intrusive / Low-Risk Fashion 10 9 912 Flexibility for Future Changes 10 10 1013 Supportive of High Density Needs 9 9 914A Vendor support capability throughout facility lifecycle (consider long term viability of vendor) N/A N/A N/A N/A14B Vendor is acceptable to Client N/A N/A N/A N/A15 Supportive of Client IT Operations 10 9 8 Scored 2N highest based on clients past use

- Supportive of Legacy IT equipment voltages 10 10 10- Supportive of Future IT equipment voltages 10 10 10- Supportive of IT additions/changes without Electrically Energized Work (EEW) 9 9 9

16 Positive Effect on Site Environment (aesthetically pleasing, mitigated acoustics) 8 8 89 8 8 Adjustments made based on Pro's/Con's listed below

Decision Made/Basis for Decision: Client has a combination of 2N and Parallel redundant UPS systems. The idea of executing a 2N system is very intriguing to client based on their present operation and familiarity with this type of system. Option 1 favors clients present operational conditions and minimizes the impact of human error. The cost of the initial system is also in line with clients budget. See pro's & con's matrix below.

Recommendation from Workgroup: Proceed with This Option 175 171 170 Proceed with Option 1 (2N)


Conclusion

A true TCO is a thorough analysis taking into account all the factors affecting design, construction, maintenance and support throughout the life cycle of the facility.

– Site– Facility Architecture– Technology– Electrical Topology– Mechanical Cooling– Install Cost– Energy Usage– Sustainability– Reliability– Scalability– Maintenance– Vendor Support

Total Cost of Ownership


Questions


Thank You

Debra [email protected]

Ronald [email protected]

Documents

TCO scoring model for effective data center solutions presentation