Overview of Data CenterEnergy UseBill Tschudi, LBNLWFTschudi@lbl.gov

Data Center Definitions

Server closet < 200 sf Server room <500 sf Localized data center <1,000 sf Mid-tier data center <5,000 sf Enterprise class data center 5000+ sf

Focus today’s training on larger data centers—however most principles apply to any size

center

EPA report to Congress—Breakdown of Space

Data Center Efficiency Data Center Efficiency OpportunitiesOpportunities

Benchmarking of over 25 centers consistently lead to opportunities

No silver bullet

Lots of silver bb’s

Server Load/ComputingOperations

Cooling Equipment

Power Conversion & Distribution

AlternativePower

Generation

• High voltage distribution

• Use of DC power

• Highly efficient UPS systems

• Efficient redundancy strategies

• Load management

• Server innovation

Energy Efficiency Opportunities Energy Efficiency Opportunities Are EverywhereAre Everywhere • Better air management

• Better environmental conditions

• Move to liquid cooling

• Optimized chilled-water plants

• Use of free cooling

• On-site generation

• Waste heat for cooling

• Use of renewable energy/fuel cells

IT Equipment Load DensityIT Equipment Load Density

IT Equipment Load Intensity

0

10

20

30

40

50

60

70

80

90

100

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23

Data Center Number

Watts/sq. ft.

2003 BenchmarksAve. ~ 25

2005 BenchmarksAve. ~ 52

Benchmarking Energy End UseBenchmarking Energy End Use

local distribution lines

to the building, 480 V

HVAC system

lights, office space, etc.

UPS PDU computer racks

backup diesel generators

Electricity Flows in Data CentersElectricity Flows in Data Centers

computerequipment

uninterruptible

load

UPS = Uninterruptible Power Supply

PDU = Power Distribution Unit;

Overall Electrical Power UseOverall Electrical Power Use in Data Centers in Data Centers

Courtesy of Michael Patterson, Intel Corporation

Performance Varies

Data Center Server Load

51%

Data Center CRAC Units

25%

Cooling Tower Plant4%

Electrical Room Cooling

4%

Office Space Conditioning

1%

Lighting2%

Other13%

Computer Loads67%

HVAC - Air Movement

7%

Lighting2%

HVAC - Chiller and

Pumps24%

The relative percentages of the energy actually doing computing varied considerably.

High Level Metric— High Level Metric— Percentage of Electricity Percentage of Electricity Delivered Delivered to IT Equipmentto IT Equipment

IT Power to Total Data Center Power

0.00

0.10

0.20

0.30

0.40

0.50

0.60

0.70

0.80

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25

Data Center Number

Ratio

Average .57

Higher is better

Source: LBNL Benchmarking

Alternate High Level Metric – Data Center Total Electrical Demand/ IT Equipment Demand (PUE)

Total Data Center Power/IT Power

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Center Number

Ratio

Average 1.83

Lower is better

Source: LBNL Benchmarking

HVAC System EffectivenessHVAC System Effectiveness

HVAC Effectiveness Index

0.0

0.5

1.0

1.5

2.0

2.5

3.0

3.5

4.0

1 2 3 4 5 6 7 8 9 10 11 12 14 16 17 18 19 20 21 22

Data Center Number

Ratio of IT Equipment Power to HVAC Power

We observed a wide variation in HVAC performance

Benchmark Results Can Help Benchmark Results Can Help Identify Best PracticesIdentify Best Practices

The ratio of IT equipment power to the The ratio of IT equipment power to the total is an indicator of relative overall total is an indicator of relative overall efficiency. Examination of individual efficiency. Examination of individual systems and components in the systems and components in the centers that performed well helped to centers that performed well helped to identify best practices.identify best practices.

Best HVAC PracticesBest HVAC Practices

Air ManagementAir Management Air EconomizersAir Economizers Humidification Humidification

ControlControl Centralized Air Centralized Air

HandlersHandlers Low Pressure Low Pressure

Drop SystemsDrop Systems Fan EfficiencyFan Efficiency

Cooling Plant Cooling Plant OptimizationOptimization

Water Side Water Side EconomizerEconomizer

Variable Speed Variable Speed ChillersChillers

Variable Speed Variable Speed PumpingPumping

Direct Liquid Direct Liquid CoolingCooling

Best Electrical PracticesBest Electrical Practices

UPS systemsUPS systems Self-generationSelf-generation AC-DC AC-DC

distributiondistribution Standby Standby

generationgeneration

Best Practices and IT Best Practices and IT Equipment Equipment

Power supply Power supply efficiencyefficiency

Standby/sleep Standby/sleep power modespower modes

IT equipment IT equipment fansfans

VirtualizationVirtualization Load shiftingLoad shifting

Best Practices—Best Practices—Cross-Cutting and Misc. IssuesCross-Cutting and Misc. Issues

Motor efficiencyMotor efficiency Right sizingRight sizing Variable speed Variable speed

drivesdrives Lighting Lighting MaintenanceMaintenance Continuous Continuous

Commissioning Commissioning and Benchmarkingand Benchmarking

Heat RecoveryHeat Recovery Building Building

EnvelopeEnvelope Redundancy Redundancy

StrategiesStrategies Methods of Methods of

charging for charging for space and powerspace and power

Potential Savings

Electrical bill will exceed the cost of IT equipment over its useful life

20-40% savings typically possible Aggressive strategies – better than

50% savings Paybacks are short – 1 to 3 years are

common

Scenarios of Projected Energy Use from EPA Report to Congress 2007 - 2011

The Good News:

Industry is taking action– IT manufacturers– Infrastructure equipment manufacturers

Industry Associations are leading:– ASHRAE– Green Grid– Uptime Institute– Afcom– Critical Facilities Roundtable– 7 X 24 Exchange

IT Industry Taking Action

www.climatesaverscomputing.org.

www.thegreengrid.com

More Good News:

Utilities are getting involved:– PG&E, SCE, San Diego– CEE

CA incentive programs are aggressive California Energy Commission, DOE,

EPA all have data center initiatives

Design Guidelines Were Design Guidelines Were Developed in Collaboration Developed in Collaboration With PG&E With PG&E

Guides available through PG&E’s Energy Design Resources Website

Design Guidance is Design Guidance is Summarized in a Web Based Summarized in a Web Based Training Resource Training Resource

http://hightech.lbl.gov/dctraining/TOP.html

Resources summary sheet available

Take Aways

Various meanings for “data centers” Benchmarking helps identify

performance Benchmarking suggests best practices Efficiency varies Large opportunity for savings Resources are being developed