Upload
vuongngoc
View
219
Download
0
Embed Size (px)
Citation preview
DELTH
LL™ PERM
POWE
DEL
MAL DERED
R
LL ENTER
DESIGDGE™
Enterp
Round Rock
RPRISE W
GN O™ M-S
prise Therm
One Dell k, Texas 78
www.dell
WHITEPAP
OF THSERIE
K.C. Cmal Enginee
Way 8682 .com
PER
HE ES
Coxe ering
THIS WHERRORS AIMPLIED W AMD andtrademarrefer to einterest in For more Informatio
ITE PAPER ISAND TECHNICWARRANTIES
d Opteron arks of Intel Co
either the entn the marks a
information, on in this doc
S FOR INFORCAL INACCUR
S OF ANY KIND
re trademarkorporation. Otities claimingnd names of
contact Dell.cument is sub
RMATIONAL PRACIES. THE D.
ks of AdvancOther trademg the marks aothers.
. bject to chang
PURPOSES OCONTENT IS
ed Micro Demarks and trad
and names o
ge without no
NLY, AND MS PROVIDED
evices, Inc. de names ma
or their produ
otice.
MAY CONTAINAS IS, WITH
Intel and Xeay be used inucts. Dell dis
2 | P a
N TYPOGRAPHHOUT EXPRES
eon are regisn this documeclaims propr
a g e
HICAL SS OR
stered ent to ietary
1 INTWith enecustomerdevelopmoverall sy The launcblades mathe systemanages some of tare intend A reader blades an
2 DEThe Dell Mof up to performamore typoperatingsignificant The challe
• R• O
The sectithermal m
3 COThe sectithermal sbut will ho
TRODUrgy costs risis. One of th
ment of a highstem power,
ch of the Dearks an evolum stretches cooling to th
the features oded to result
seeking a mod peripherals
ESIGN GM1000e is de
10,000 feet nce requirem
pical data ceng condition. t opportunity
enge that Deleliable opera
Optimized for
ons below wmanagement
OOLINGons below aolution in theopefully prov
UCTIONng, energy e
he key avenuhly efficient th
but it doesn’
ell™ PowerEdutionary leap
from the layhe fan moduof the thermin one of the
ore detailed ds should read
GOALS signed to reli(3,048m).
ments to meenter could b
Even a datay for reducing
l faced in thetion at worsttypical data c
will detail howthrough the I
G SOLUre intended
e Dell PowerEvide the reade
N efficiency in Iues of addreshermal solutit need to.
dge™ M1000ein thermal deyout of eachles that proval design and most therma
description of the Dell M-S
iably operateIn addition,
et such condite supplying a center opeg power-to-co
e developing tt-case, redundcenter condit
w Dell accomIntegrated De
UTION to provide a
Edge M1000eer an apprecia
T equipmentssing energy on. System c
e Modular Eesign efficienh blade to Cvide the airflod discuss the ally efficient s
f the featureseries Archite
e at ambient cthe system stions, howev15-17°C air f
erating at “hool vs. a 35°C
the M1000e wdancy lost coions
mplished thisell Remote Ac
OVERVa general une Modular Encation of the e
t has quickly efficiency at
cooling can co
nclosure andncy by Dell. Thassis Managow. This papunderlying p
servers on the
s of the Powecture Whitep
conditions upsupports reder, are not tyfrom the floigher” tempeenvironment
was to develonditions
s in hardwarccess Control
VIEW derstanding closure. Thesengineering th
become a mt the platformonsume a sig
d PowerEdge The thermal agement Contper will walkprincipals ande market.
erEdge M100paper availabl
p to 35°C (95°dundant coolypical of mosor tiles, a meratures arout.
op a solution
e design as ler (iDRAC) an
of the majose sections arhat has gone
3 | P a
major focus om level lies ignificant porti
M600 and architecture wtroller (CMC)
k the user thrd design goals
00e and assocle at dell.com
°F) and at altiing. The the
st deploymenmuch more bund 25°C off
that is both:
well as in synd CMC.
r elements ore not all-inclinto the desi
a g e
of Dell n the ion of
M605 within ) that rough s that
ciated m.
tudes ermal
nts. A benign fers a
ystem
of the usive, gn.
Figure 1:1
3.1 WThe Powespecific corequiremesystem co
Cooling isFigure 4). from the configuratambient tthe enclos
: Front View 16 Half-Heigh
What proverEdge M1000ooling requireents. Each f
ooling during
s managed by The thermaBMC that runtion on eachtemperature sure.
of PowerEdght Blade Encl
vides th0e is cooled bements of thfan is hot swnormal run t
F
y a combinatil control algo
ns on the Dellh blade, the
of the blade
ge M1000e wilosures
he coolinby 9 custom fe M1000e, in
wappable andime or if redu
Figure 3: Del
ion of blade-orithm runninl PowerEdge thermal condand then co
ith Fig
ng fan modules.ncluding its ad can be indiundancy is los
l M1000e Fan
level (iDRAC)ng on each bl9G servers. Idition create
ommunicate t
gure 2: Rear V
The fan moirflow operatividually speest.
n Module
) and enclosuades’ iDRAC it has the cap
ed by softwarthe blade’s sp
View of Powe
dule was desting point anded controlled
ure-level (CMCis an evolutio
pability to anare load on thpecific coolin
4 | P a
erEdge M1000
signed to meed power effic
d to help opt
C) controllersonary step foralyze the hardhe blade, ang requiremen
a g e
0e
et the ciency timize
s (See rward dware d the nts to
The enclotemperatthe front and powein zones, This desigpower-intsaving lev
3.2 AiThe M10Because modules despite thengineericompone The servethe systemthrough texhaust t
osure (CMC),ure sensors iof the M100
er consumptiowith each zo
gn allows the tensive hardwvel.
ir Manag00e makes uof this, eachin the back heir locationsng, with thent temperatu
er modules arm is dominathe server mo
the air from
, in turn, is n the M1000
00e), and set on – to meet
one mapped tCMC to incre
ware configur
Fi
gement use of parallh of the maj
of the systes in the rear e goal of alure requireme
re cooled withted by inlet aodules, througthe chassis.
designed to0e infrastruct
each fan to tt the cooling to the coolinease only therations, while
igure 4: Fan C
el air paths or subsystemm. Providinof the syste
lowing the ments.
h traditional rea for the ingh vent holes There are p
o interpret eure (such as the lowest sprequirements
ng of a groupe fans needede leaving the r
Control Block
to cool the ms receives ag ambient am, was a mamodules to
front-to-backndividual blads in the midpplenums both
each of the in the IO Mopeed possibles of the syste of blades bad to cool hottrest of the fan
k Diagram
blades, IO Mambient air tir to the IO ajor focus of consume les
k cooling. As des (green higplane, and is th upstream o
16 blades’ idules and the
e – helping toem. The CMCased on locatter blades orns at a lower
Modules, andto help avoiModules andthe early sys
ss airflow w
shown in Figghlighted arethen drawn inof the midpl
5 | P a
nputs, as we control pano minimize aC controls thetion in the chr blades with power and a
d power supd pre-heatind Power Supstem archite
while still me
gure 5, the froea). The air pnto the fans wane, betwee
a g e
ell as nel on irflow e fans hassis.
more irflow
pplies. g the
pplies, ctural eeting
ont of passes which n the
midplane distribute
The Poweinlet air frFigure 6. required v
The IO Minlet, as sThis cool plenum bCMC and
Ser(M1
(
and the blae the cooling p
er Supplies, lorom a duct lo This insures
volume of air
odules use aseen in Figureair is then d
between the mIntegrated Ke
rver Module1000e front
Power Sup(M1000e fro
des, and dowpotential from
Figure 5
ocated in thecated beneat
s that the por needed to co
Figure
bypass duct e 7. This du
drawn down midplane andeyboard/Vide
e Inlet t view)
pply Inlet ont view)
wnstream of m the three c
5: Dell Blade
e rear of the th the server wer suppliesool the powe
e 6: M1000e P
to draw ambct is located through the
d fans. From eo/Mouse (iK
the midplanolumns of fan
Server Modu
system, use modules, as s receive ambr supply.
Power Supply
bient air fromabove the seIO Modules this plenum,
VM) are also
Server Mo(M
Power Sup(M10
ne, between tns across the
ule Cooling P
basic front-tseen in the gbient temper
y Cooling Pat
m the front oerver modulein a top-to-b, the air is excooled by air
odule CoolM1000e side
pply Cooling000e side v
the midplaneserver modu
Path
to-back coolinreen highlighature air, wh
th
of the systemes (again highbottom flow xhausted fromr in this flow p
ing Air Profe view)
g Air Profileview)
6 | P a
e and the fanules.
ng, but drawt in the left s
hich minimize
to the IO Mhlighted in grpath and int
m the systempath.
file
e
a g e
ns, to
their ide of
es the
odule reen). to the . The
4 DETO
4.1 ImDevelopincomputinpoint, yetaccomplisfit the neeit is critica There is slocal electwhen inst
(M
ESIGN CO-COOL
mpedancng a fan to g architecturt fall within shed by identeds of the M1al to an efficie
somewhat of tronics store talled in a PC.
IO Module M1000e fron
Figu
CONSIDL
ce, Airflocool the M1
re provided aa much tigh
tifying a fan e1000e. This sent thermal d
a misconceptfor a desktop. This is calle
Inlet nt view)
ure 7: M1000e
DERATI
ow, and1000e and p unique chalter power b
efficiency targsection will prdesign.
tion about hop PC that is add a “free air”
IO Coo(M100
e IO Module C
IONS A
Fan Effprovide scalalenge. The faudget than oget that requrovide a brief
ow fans perfodvertised as a measureme
oling Air Pro00e side vie
IOM Lo
Cooling Path
AFFECT
ficiencybility for thean needed tooff-the-shelf
uired custom f overview of
orm and are san “80 CFM” fnt of the fan
ofile ew)
ocations and(M1000e b
h
TING PO
y e next severo meet an agfans could ptechnology twhat fan effi
specified. A ffan will not mperformance
d Airflow Dback view)
7 | P a
OWER-
ral generatiogressive oper
provide. Thiso be developiciency is, and
fan purchasemove 80 CFM e, and is how
irection
a g e
ons of rating s was
ped to d why
d at a of air much
air the fancomponeeven list airflow ou The half oflow of a(Pascals inmoves. Aoperating The chartchart, thewater (in.
Why is thelectronicpoint reqfor how mamount othrough afan can be
n moves whents of a comthis value on
utput.
of the fan equair, is measurn SI derived uA fan in free g point of ‘airf
t below is type free-air ratinw.g.).
his importantcs enclosure uired of the s
much power of energy (wha system. Whe determined
0
0.1
0.2
0.3
0.4
0.5
0.6
0
Impe
danc
e (in
.w.g
.)
en sitting on aputer). This
n their datash
uation that isred in pressuunits). The mair has zero
flow at a give
pical of a fan ng is 116 CFM
Figu
t? A thermaand can mesystem fan. is needed to hich can be rhen comparedd.
20
Fan Curve
System ImpCurve
a table with nmethod of dheets, even t
n’t often discure, and in Umore impeda
impedance. en impedance
that might bM, but the act
ure 8: Exampl
al design engasure the imThe operatincool the syst
represented d to the elect
40
pedance
nothing occluescribing a fathough it is o
cussed is impeUS customarynce that a fa In an electr
e.’
be found in a tual operating
le Fan Perform
gineer knowsmpedance of ng point of thtem. The opas power) thtrical power r
60
Airflow (CF
OperatPoint
ding the inletan is so commonly a partial
edance. Impy units is rep
an is loaded wronics system
desktop comg point is clos
mance Curve
s how much the enclosur
he system faperating pointhat needs to required to ru
80 10
FM)
ting
t or outlet (sumonplace thal specification
edance is thepresented bywith, the less
m, however, t
mputer or towser to 80 CFM
e
airflow is rere to determn is a significt of a fan actube put into
un the fan, th
0 120
Free
8 | P a
uch as the intat fan vendorn of a fan’s a
e opposition ty inches of ws airflow it acthe fan runs
wer server. IM at 0.19 inch
equired to comine the opercant driving fually describethe air to fo
he efficiency o
140
e Air
a g e
ternal rs will actual
to the water, ctually
at an
n this hes of
ool an rating factor es the orce it of the
WorWor
=η
Fan efficiequality ofWhat doe
1. Ahcotrmsede
2. Ifpoimisteim
These priimpedanchigher thaachieved custom fo This fan ismarket anblade encunderstanimprovemsubtle chathermal d
4.2 AiThere areair tempe1950 servsystem, a
Operrkrk
in
out =
ency is depenf the motor, aes all this mea
higher efficigher efficienomputing. Aranslated into
more expensivelect a fan weployment.
f a system caower. We
mpedance of s somewhat emperature rmpedance is t
ncipals guidece drove a loan typical 92mthrough opt
orm factor.
s coupled wind a chassis closure and lnd what facto
ment. These anges in the i
design.
irflow ane numerous berature from ver into basic nd a fan (Figu
InFlowrating
ndent on howand can vary an with respe
iency fan wincy fan designAlternatively,o cost savingsve componenith a materia
an be designehave discusthe system. flexible, it o
rise through tthe other vari
ed not only dow-impedancmm or 80mmtimization of
th a blade demidplane thaayouts were ors contributlayout studi
ndustrial des
nd Tempbenefits a cusa server. To thermal build
ures 9 and 10
PowernputOperwrate×
w the fan is bsignificantly,
ect to cooling
ill consume pn, leading to it can resus in the deplnts to build tl cost approp
ed with a lowsed how thWhile the vo
often needs the system (miable that can
development e design as
m form factor f the aerody
esign with upat underwent
studied exteted to the imes resulted i
sign of the bla
peraturestomer can re
illustrate thiding blocks: a
0).
rPressrating
built and des, even from opower? The
proportionallya lower pow
lt in lower ooyment. Thethe fan, so it
priate to the
wer work outpe operating lume of airfloto be maint
more on thatn affect the po
of the M100well. The effans used in m
ynamics, mot
p to half the t several desiensively priorpedance of tin componenade, all to hel
e Rise ealize by lowes effect, cons
an airflow res
sure
signed, from one fan to anre are two im
y less powerwer fan, resuloverall powee higher effict is critical thamount of en
put requirempoint is de
ow required tained at a m later). Assuower-to-cool
00e fan, but tfficiency of tmany PCs curtor, and mot
impedance oign iterationsr to building the module, nt placementp drive lower
ering fan spesider the simsistance, a he
the shape ofnother in the mportant poin
r than a low ts in more p
er consumptiociency may cohat a thermanergy that m
ment, the fan termined by
to cool an eleminimum levming a minim.
the close relahe M1000e frrently on thetor controlle
of competitivs to help optithe first funcand targetings made for ar impedance a
eds and increplification of
eat source, a p
9 | P a
f the blades tsame form fa
nts:
efficiency faower availabon, which caome at the coal design engay be saved i
will consumy the airflowectronics enclvel to contromum fixed ai
ationship witfan is signific
e market. Thir design wit
ve products omize airflowctional systemg certain areaairflow, as wand a lower p
easing the exf a Dell Powepower distrib
a g e
Eq. 1
to the actor.
an. A ble for an be ost of gineer in the
e less w and
osure ol the rflow,
th the cantly is was thin a
on the . The ms to as for
well as power
xhaust rEdge
bution
In this exarunning aRPM, thedecreases
Figur
ample, assumat 9,000 RPM exit air tem
s 55W!
re 10: Block-D
me the serverM, there is an mperature inc
Figure 9:
Diagram Simp
r is under a c8°C rise thro
reases to 22
: PowerEdge
plification of
constant loadough the syst°C above the
1950
f a Server's A
d that requiretem. By dece inlet tempe
Airflow System
es a 300W increasing the ferature, but t
10 | P a
m
put. With thfan speed to the system p
a g e
he fan 3000
power
Figure 1
The reasofan powespeed chaof a fan (E
fi
ini
PowerPower
As an exaconsumptminimize reducing airflow ha An expectimprovemincrease wto its optmatch it temperat
11: Comparis
on for the drar and RPM doange, so smaEq 2).
⎜⎜⎝
⎛=
final
itial
RPMRPM
mple, and ustion! Becausfan speed asystem powe
ave been desi
ted benefit oments in the with a highertimum return
to a dataceure from the
on of Fan Sp
amatic poweo not have a lll decreases i
3
⎟⎟⎠
⎞
final
initial
MM
sing (Eq 2), a e of this relatnd increase er and airfloigned to mee
of the high teM1000e is thr temperaturen temperaturenter deploysystem) can
eed, Power D(botto
r decrease belinear relationin fan speed
10% reductiotionship, theexhaust air tw consumptt the high tem
emperature rhat the capace rise as the re. Care musyment, but thave benefits
Draw, and Exhom) Fan Speed
etween the hnship. In factcan have sign
on in fan RPMre was a constemperature,ion. All of tmperature re
rise that stretcity of the aiCRAC (Compst be taken wthe higher res beyond pow
haust Tempeds
high and low t, power channificant impa
M can result inscious effort , with the inthe componequirements o
tches beyondr conditioneruter Room A
when selectineturn tempe
wer-to-cool at
erature at Hig
fan speeds inges as a cubicts on the po
n a 27% redumade in the tended bene
ents downstrof this design
d the enclosurs in a data cAir Conditioneng air conditerature to tht the IT enclo
11 | P a
gh (top) and L
n Figure 11 isic function ofower consum
ction in fan pM1000e des
efit of significream in the w
condition.
ure-level efficcenter can acer) operates cioning to prohe CRAC (exsure level.
a g e
Low
s that f a fan
mption
(Eq 2)
power ign to cantly warm
ciency ctually closer operly xhaust
4.3 CoWith a chlower pow The M600(Intel Xeoprocessorthe X5355temperat Memory cmore effiDIMMs todependinDIMMs beto-DIMM
5 CAPO
What doethe produservers w
• (2• (4
And also c
• (2• (4
omponehassis designewer and airflo
0, for examplon X5355) ther power, the 5 provides anure, dependi
configurationcient coolingo achieve a g on memoreing populateheating.
ASE STUOWERED
es the customuct’s inceptioith similar ha
2) Intel Xeon 54) 2GB Fully B
consider an M2) AMD Opter4) 2GB DDR2
ent Seleced for therm
ow consumpt
le, is availablermal design lower prehean opportunityng on other c
ns can also afg memory wh
given memory capacity reed in every o
UDY: PDGE 19mer get for a on? Consider
rdware, part5130 process
Buffered DIMM
M605 deploymron™ 2218 H2Rx4 DIMMs
ction mal efficiency,
ion by selecti
e with procepower levels
at placed on y for airflow
components i
ffect cooling hen 4 higher ory capacity.equired and oother slot in t
OWERE950-III
well-designer an M600 deicularly:
sors Ms
ment of 16 blHE processors
, there are sting easier-to-
ssors rangings. In additiodownstreamreductions rn the blade.
power and acapacity DIM
. Airflow reother compothe memory b
EDGE M
ed blade serveployment an
ades with s
till several op-cool compon
g from 40W (n to the pow
m componentsranging from
airflow requirMMS are useeductions of onents in thebank, and the
M600 V
ver with coolind a deploym
pportunities nents and blad
Intel® Xeon®wer savings ass by the 51485% to 40% a
rements. Noted in place of
up to 25% blade. Thise resulting re
VS. M60
ing efficiencyment of 16 P
12 | P a
for a customde configurat
5148LV) to 1ssociated wit8LV as opposat a 25°C am
tably, the M6f 8 lower capcan be achi
s is a result oeduction in D
05 VS.
y designed-in owerEdge 19
a g e
mer to tions.
120W th the sed to
mbient
600 is pacity ieved, of the IMM-
from 950 III
NumRacSerTot AirfAve1 Poand2 Facoo3 Aias t
From Tabairflow thefficiency The Poweefficient cassociated
6 CODesigninginstalling solution tPowerEdgmaximizinoperatingsystems mthe powepower to
Table
mber of Servck-Space to Drver Density tal AC Power Fan Power1,
flow Consumerage Airflowower represend assumes a San power is inling efficiencirflow consumemperature v
ble1, a deployhan the Powey in the coolin
erEdge M605 cooling in thed with DDR2
ONCLUSg the cooling
it in a compthat is optimge M1000e Mng energy efg conditions. management er consumptiobe dedicated
1: Compariso
ers Deploy
Required1 2
med by Deployw per Server3 nted in AC W
SPECjbb workncluded in tocy. mption is basvaries.
yment of 16 rEdge 1950 II
ng solution.
deployment e parallel layoas compared
SIONS solution for
uter, and turmized for poModular Encfficiency and Tools such fan control, a
on of the M1d to computin
on of Deploymvs. 16 Power
Po1916161.04753
yment3 4931
Watts “at the kload.
otal AC powe
sed on a 25°C
M600 bladeII deploymen
shows additout of the CP to FBD mem
r IT equipmerning it on. Aower, airflowlosure and itminimizing as high efficand low airflo1000e therm
ng, as oppose
ment of 16 MrEdge 1950-IIIowerEdge 950 III 6 6U 0 Servers/U
785W 30W 95 CFM 1 CFM wall” after p
r, but is brok
C ambient tem
es deployment. Of the 845
ional power aPU and memoory.
nt can be asA basic appro
w, or coolingts associatedairflow requ
ciency fans, low/high tem
mal solution ad to cooling.
M600 Blades vI Servers
PowerEdM600 16 10U 1.6 Serve3835W 80W 370 CFM23 CFM
power supply
ken out here f
mperature to
nt consumes 5W in power
and airflow sory in the air
s simple as soach like thag. The coold blades werirements whow-impedancperature rise
and allow mo
vs. M605 Blad
dge PowM6016 10U
ers/U 1.6 S366065W
340 21 C
y efficiency is
for compariso
the server an
19% less posavings, 450W
avings, maderflow, as well
selecting a fat, however, wling solution re developedhile still suppce system de are designed
ore of the cu
13 | P a
des
werEdge 05
Servers/U 0W
W CFM FM s considered
on of
nd will vary
ower and 29%W is a result o
e possible by l as power sa
an from a cawill not resul
deployed in with the go
porting worstesign, advancd to help minstomer’s ava
a g e
% less of the
more avings
talog, lt in a n the oal of t-case ces in
nimize ailable