Upload
trandien
View
222
Download
3
Embed Size (px)
Citation preview
Data Envelopment Analysis Data Envelopment Analysis
1
Ahti SaloSystems Analysis Laboratory
Aalto University School of Science and TechnologyP.O.Box 11100, 00076 Aalto
FINLAND
These slides build extensively on the teaching materials of Prof. Sri Talluri who gave a DEA course in Helsinki in 2007 (used with permission).
Data Envelopment Analysis Ahti Salo 2
Which Decision Making Unit (DMU) is most productive?Which Decision Making Unit (DMU) is most productive?
Data Envelopment Analysis Ahti Salo 3
DMU labor hrs. #cust. #cust/hr.
� DMU = Decision Making Unit
� A method for measuring the productivity of DMUs which
consume multiple inputs and produce multiple outputs
DEA (DEA (CharnesCharnes, Coopers & Rhodes ‘78) , Coopers & Rhodes ‘78)
Data Envelopment Analysis Ahti Salo 4
DMU labor hrs. #cust. #cust/hr.1 100 150 1.502 75 140 1.873 120 160 1.334 100 140 1.40
5 40 50 1.25
labor hrs.
x x
50 100
100
200
x
x
x
DMU’s 1,3,4,5 are dominated by DMU 2.
#cust
� 8 M.D.s works at a Hospital for the same 160 hrs in a month.
– Each performs exams and surgeries
– Which ones are most “productive”?
D o c to r # E x a m s # S u rg e rie s
1 4 8 6 8
Extending to multiple outputs ..Extending to multiple outputs ..
Data Envelopment Analysis Ahti Salo 5
– Note: There is some “efficient” trade-off between the number of surgeries and
exams that any one M.D. can do in a month, but what is it?
2 1 2 8 0
3 3 5 7 6
4 3 1 7 1
5 2 0 7 0
6 2 0 1 0 5
7 3 6 5 38 1 5 6 5
60
80
100
120
#S
urg
eri
es
Efficient M.D.’s: These two M.D.’s (#1 and #6) define the most efficient trade-off between the two outputs.#6
#1
Scatter plot of Scatter plot of ouputsouputs
Data Envelopment Analysis Ahti Salo 6
0
20
40
60
0 10 20 30 40 50 60
#Exams
#S
urg
eri
es
These points are dominated
by #1 and #6.
“Pareto-Koopman efficiency” along the efficient frontier: It is impossible to increase an output (or to decrease an input) without a compensating decrease (increase) in other outputs (inputs).
� How “bad” are inefficient M.D.s relative to the efficient ones?
� Where are the gaps?
Performance gapsPerformance gaps
Data Envelopment Analysis Ahti Salo 7
� How “bad” are the gaps?
� “Nearest” efficient DMUs define � a reference set and
� linear combination of the reference set inputs and outputs
of a hypothetical composite unit (HCU)
Reference setReference set
Data Envelopment Analysis Ahti Salo 8
Summary of DEA thus far Summary of DEA thus far
� Input/output productivity is defined relative to the efficient
frontier
� This frontier characterizes observed efficient trade-offs
among inputs and outputs for a given set of DMUs
Data Envelopment Analysis Ahti Salo 9
among inputs and outputs for a given set of DMUs
� Efficiency is defined as the relative distance to the frontier
� “Nearest point” on the frontier is the efficient comparison
unit (hypothetical comparison unit, HCU)
� Differences in inputs and outputs between DMU and HCU
correspond to productivity “gaps” (improvement potential)
� But how can we do this analysis systematically?
A real example on NY Area Sporting Goods StoresA real example on NY Area Sporting Goods Stores
Data Envelopment Analysis Ahti Salo 10
� Conceptually, productivity (efficiency) is the ratio between
outputs and inputsOutputs
Productivity =Inputs
ProductivityProductivity
Data Envelopment Analysis Ahti Salo 11
� Yet reality is rather more complex
Technology+
Decision Making
Inputs Outputs
equipment
facility space
server labor
mgmt. labor
#type A cust.
#type B cust.
quality index
$ oper. profit
� Mix of customers served
� Availability and cost of inputs
� Configuration of production facilities
� Processes and practices used
Differences among Operating Units (DMUs)Differences among Operating Units (DMUs)
Data Envelopment Analysis Ahti Salo 12
� Examples
– Bank branches, retail stores, clinics, schools, etc
� Questions:
– How to compare the productivity of diverse operating units that serve
diverse markets?
– What are the “best practice” and under-performing units?
– What are the trade-offs among inputs and outputs?
– Where are the improvement opportunities and how big are they?
� Operating ratios
– Examples: Labor hours per transaction, € sales per square meter
– Appropriate for highly standardized operations
– But these do not reflect the varying mix of inputs/outputs of diverse operations
Some approachesSome approaches
Data Envelopment Analysis Ahti Salo 13
� Financial approach: Convert everything to monetary terms
� Concerns
– Some inputs/outputs cannot be valued in € (non-profit)
– Profitability is not the same as operating efficiency (e.g. variances in margins and
local costs matter as well)
Inputs in € Outputs in €
Profitability vs. efficiencyProfitability vs. efficiency
� Profitability is a function of three elements …
– Input prices (costs)
– Output prices
– Technical efficiency: How much input is required to generate the output
Data Envelopment Analysis Ahti Salo 14
� Improving operations calls for an understanding of technical
efficiency, not just overall profitability.
� CCR Model
– Charnes, Cooper, and Rhodes (1978)
– Assumes constant returns to scale in production possibilities: an increase in the
amount of inputs leads to a proportional increase in outputs
� BCC Model
Variants of DEA ModelsVariants of DEA Models
Data Envelopment Analysis Ahti Salo 15
� BCC Model
– Banker, Charnes and Cooper (1984)
– Constant returns to scale not assumed, efficiency depends on the scale of
operations
� Super efficiency model
� DEA models with weight information
� Cross-efficiency models in DEA
� Ratio-based Efficiency Analysis (REA)
#operating units (DMUs)
# inputs
#outputs
observed level of output from DMU
observed level of input from DMU
nk
K k = 1,...,K
M m = 1,...,M
N n = 1,...,N
y n k
x m k
NotationNotation
� Data
Data Envelopment Analysis Ahti Salo 16
observed level of input from DMU
weight of inp
mk
m
x m k
v ut
weight on output
efficiency of DMU (0-100%)
∑
∑
n
k
N
n nk
n=1
k M
m mk
m=1
i
u n
E k
u y
E =
v x
� Model variables
� Choose nonnegative I/O weights to
� This is equivalent to
Evaluating the CCR efficiency of DMU Evaluating the CCR efficiency of DMU kk
max subject to
≤
k
k
E
E 1, k = 1,...,K
∑ n nku y
∑
Data Envelopment Analysis Ahti Salo 17
max
subject to
≤
≥
∑
∑
∑
∑
n nk
n
m mk
m
n nl
n
m ml
m
n m
v x
u y
1, l = 1,...,Kv x
u ,v 0
Weighted input of DMU k is normalized
to one
max
subject to
− ≤
≥
∑
∑
∑ ∑
n nk
n
m mk
m
n nl m ml
n m
n m
u y
v x = 1
u y v x 0, l = 1,...,K
u ,v 0
� Four DMUs, one input, one output
� The efficiency ratio is highest for DMU A
– Max.efficiency = 1
⇒ Input weight twice as high
as output weight
An example with 4 DMUs An example with 4 DMUs
Data Envelopment Analysis Ahti Salo 18
as output weight
⇒ Efficiencies of other DMUs
EB = 6/8 = 0.75
EC = 9/12 = 0.75
ED = 10/16 = 0.625 Output needed to reach efficiency = 2x4 = 8
Actual output = 6
� How much less inputs should an inefficient DMU use in order
to become efficient?
min subject toθ
λ θ≤∑K
x x , m = 1,...,M
InputInput--Oriented CCR Ratio ModelOriented CCR Ratio Model
Data Envelopment Analysis Ahti Salo 19
� Optimal θ is the same efficiency as from the primal model
λ θ
λ
λ
≤
≥
≥
∑
∑
i mi mk
i=1
K
i ni nk
i=1
i
x x , m = 1,...,M
y y , n = 1,...,N
0, i = 1,...,K
� Dual variable associated with DMU i
� These variables can be used to construct an efficient
hypothetical composite unit (HCU) with
DMU is in the reference set of DMU⇒iλ > 0 i k
Dual formulationDual formulation
iλ
Data Envelopment Analysis Ahti Salo 20
such that
ˆ
ˆ
∑
∑
K
n i ni
i=1
K
m i mi
i
y = λ y , n = 1,...,N
x = λ x , m = 1,...,M Input n of HCU
Output n of HCU
ˆ
ˆ
≥
≤
n nk
m mk
y y , n = 1,...,N
x x , m = 1,...,M
� HCU can be used to measure how much more the DMU
should produce or how much less it should consume inputs in
order to become efficient
Output ˆ∆ ≥ = y - y 0, n = 1,...,N
Uses of the HCUUses of the HCU
Data Envelopment Analysis Ahti Salo 21
� Cf. spreadsheet examples
Output ˆ
Input ˆ
∆ ≥
∆ ≥
n nk
mk m
= y - y 0, n = 1,...,N
= x - x 0, m = 1,...,M
� Examples
– B should produce its current
output (6) with one unit less
of inputs in order to reach the
efficient frontier
Excessive uses of inputs by inefficient DMUsExcessive uses of inputs by inefficient DMUs
Data Envelopment Analysis Ahti Salo 22
– The gap is therefore one unit
Input∆ = 4 - 3 = 1
� Seeks to answer how much more DMU k should produce in
order to become efficient
max subject toθ
λ ≤∑K
x x , m = 1,...,M
OutputOutput--oriented CCR modeloriented CCR model
Data Envelopment Analysis Ahti Salo 23
� Efficiency is the reciprocal of optimum θ (i.e. )
λ
λ θ
λ
≤
≥
≥
∑
∑
i mi mk
i=1
K
i ni nk
i=1
i
x x , m = 1,...,M
y y , n = 1,...,N
0, i = 1,...,K
1
θ
� Examples
– The optimal θ for is 4/3
– Thus B should produce
(4/3)*6 – 6 = 2 units more
using its current inputs to
Output gaps for inefficient DMUsOutput gaps for inefficient DMUs
Data Envelopment Analysis Ahti Salo 24
using its current inputs to
reach the efficient frontier
– The CCR efficiency of B is
1 over 4/3 = 0.75
An illustrative CCR modelAn illustrative CCR model
DMU Input 1 Input 2 Output 1 Output 2 Output 3
1 5 14 9 4 16
2 8 15 5 7 10
3 7 12 4 9 13
Data Envelopment Analysis Ahti Salo 25
max subject to
≤
≤
≤
≥
1 2 3
1 2
1 2 3 1 2
1 2 3 1 2
1 2 3 1 2
1 2 3 1 2
9u + 4v + 16v
5v + 14v = 1
9u + 4u + 16u 5v + 14v
5u +7u + 10u 8v + 15v
4u + 9u + 13u 7v + 12v
u ,u ,u ,v ,v 0
� DMU 1 and DMU 3 are efficient
– Efficiency of 1.00 with no slacks
� DMU 2 is inefficient
– Efficiency < 1.00
Results for the illustrative exampleResults for the illustrative example
Data Envelopment Analysis Ahti Salo 26
– Efficiency < 1.00
– DMUs 1 and 3 can be employed as benchmarks for improvement
� See Excel example
BCC ModelBCC Model
� CCR model assumes constant returns to scale (CRS)
whereas the BCC model considers variable returns to scale
(VRS)
min subject toθ
Data Envelopment Analysis Ahti Salo 27
New constraint(convexity)
≤
≥
≥
∑
∑
∑
K
i mi mk
i=1
K
i ni nk
i=1
K
i i
i=1
λ x θx , m = 1,...,M
λ y y , n = 1,...,N
λ = 1, λ 0
� C is BCC efficient
� B is BCC inefficient
– A 50%-50% combination of
DMUs A and C uses 6 input
Change in the set of production possibilitiesChange in the set of production possibilities
CCR efficient frontier
Data Envelopment Analysis Ahti Salo 28
DMUs A and C uses 6 input
units and produces 6,5 output
units
– This is more than the 6 units that
B produces
– The resulting BCC output
efficiency becomes
1 over (6.5/6) = 0.92307
– Similar analyses for input can be made
� The resulting
BCC efficient frontier
� Helps determine how much more efficient an efficient DMU is
relative to other DMUs
Super efficiency modelSuper efficiency model
max subject to∑ n nk
n
u y DMU k under evaluationis removed from the constraintset thereby allowing its efficiency
Data Envelopment Analysis Ahti Salo 29
� The model does help rank inefficient DMUs
≤ ≠
≥
∑
∑ ∑
m mk
m
n nl m ml
n m
m n
v x = 1
u y v x , l = 1,...,K, l k
u ,v 0
set thereby allowing its efficiencyscore to exceed a value of 1.00
� D evaluated relative to the frontier defined by C-E-F
� Superefficiency defined
by the distance OD/OD’
� Similarly E evaluated in
O1/I
A
E
DC
D’
Super efficiency illustratedSuper efficiency illustrated
Data Envelopment Analysis Ahti Salo 30
comparison with the frontier
C-D-F and its superefficiency
defined by the distance
OE-OE’
� By visual inspection, D is
slightly more superefficient
than D O2/I
F
E
Efficient frontier
E’
O
DEA models with weight informationDEA models with weight information
� DMUs may attain their efficiency scores for ‘extreme’ weights
in conventional DEA models
� Preference information can be captured through preference
Data Envelopment Analysis Ahti Salo 31
statements about the relative values of
� input units
� output units
� Statements impose constraints on the input/output weights
– The introduction of weight information often leads to lower (but never higher)
efficiency scores
Sets of feasible weights (assurance regions)
� Preference statements constrain feasible weights
– “A Dissertation is as at least as valuable as 2 Master’s Theses, but not more
valuable than 7 master’s theses”
» udoctoral ≥ 2umaster’s , udoctoral ≤ 7umaster’s
– “An article in a refereed journal is at least as valuable as a Master’s Thesis”
Data Envelopment Analysis Ahti Salo 32
» uarticle ≥ umaster’s
– Only relative weights matter
– Several elicitation methods can be employed
� Feasible sets defined by corresponding constraints
{ }
{ }
1
1
( ,..., ) ' 0 | 0, 0
( ,..., ) ' 0 | 0, 0
u N u
v M v
S u u u u A u
S v v v v A v
= = ≠ ≥ ≤
= = ≠ ≥ ≤
max subject to∑
∑
n nk
n
m mk
u y
v x = 1
Example of a DEA model with weight restrictions Example of a DEA model with weight restrictions
Data Envelopment Analysis Ahti Salo 33
,
,
≤
≤ ≤
≤ ≤
≥
∑
∑ ∑
m mk
m
n nl m ml
n m
m m 1 m m
n n 1 n n
m n
u y v x , l = 1,...,K
α v v β v m = 1,…,M
a u u b u n = 1,…,N
u ,v 0
� Without any weight information,
F is efficient
� Assume that the 1st output
on the vertical axis is has
O1/I
A
E
DC
Weight constraints illustrated (1 input, 2 outputs)Weight constraints illustrated (1 input, 2 outputs)
Data Envelopment Analysis Ahti Salo 34
more weight than the 2nd
output on the horizontal axis
� Now F becomes dominated
by D and E (i.e., for all weights
in the revised weight set,
D and E will have a higher
efficiency)
F
OO2/I
� CCR efficiencies are based on the weights which are most
favourable to the DMU being evaluated
� Yet it may be of interest to know how the DMU performs when
CrossCross--efficiencies in DEAefficiencies in DEA
Data Envelopment Analysis Ahti Salo 35
using other weights as well.
� The cross efficiency score represents how the DMU performs
when evaluated with the optimal weights for all DMUs
� A DMU with a high cross efficiency score can be considered to
be a good overall performer; others are more “niche” DMUs
Cross efficiency matrixCross efficiency matrix
Data Envelopment Analysis Ahti Salo 36
� Cross-efficiency score for DMU k is the average of these scores
� Multiple optima are possible, selections either based on
aggressive formulation or benevolent formulation
Efficiency score of DMU 2 when evaluatedwith the optimal weights of DMU 1
1
1 K
k ik
i
CRK =
= Θ∑
� Examples of inputs in operations management
– Workers, machines, operating expenses, budget, etc.
� Examples of outputs
– Number of actual products produced
Selecting inputs and outputsSelecting inputs and outputs
Data Envelopment Analysis Ahti Salo 37
– Number of actual products produced
– Performance and activity measures such as quality levels, throughput rates,
lead-times, etc.
� If there are M inputs and N outputs then potentially MN DMUs
can be efficient ⇒ To achieve discrimination the number of
DMUs should be high enough
Designing DEA StudiesDesigning DEA Studies
� Enough DMUs in relation to inputs/outputs for building an
efficient frontier
� “Ambivalence” about inputs/outputs - all should matter!
“Approximate similarity” (comparability) of DMUs
K > 2(N + M)
Data Envelopment Analysis Ahti Salo 38
� “Approximate similarity” (comparability) of DMUs
– Objectives
– Technology
� DEA provides relative efficiency only
– Choice of DMUs does matter
– Inclusion of “global leader” unit may be desirable
� Experiments with different I/O combinations may be necessary
Using the results: Efficiency Using the results: Efficiency –– Profit matrixProfit matrixHigh Profit
Low High
Under-performingpotential leaders
Best practice comparison group
Data Envelopment Analysis Ahti Salo 39
Low Profit
LowEff.
HighEff.
Under-performingpossibly profitable
Candidates forclosure
Information provided by DEAInformation provided by DEA
� Objective measures of efficiency
� A reference set of comparable units
Data Envelopment Analysis Ahti Salo 40
� Indicators of excess use of inputs
� Shortfalls in the production of outputs
� Returns to scale measure
DEA SummaryDEA Summary
� Uses of DEA
– Benchmarking to identify “best practice” units
– “Data mining” to generate hypotheses about the drivers of efficiency
– Performance evaluation and measurement
Data Envelopment Analysis Ahti Salo 41
� Caveats
– Essentially a “black box” approach - gives no information about the causes of
inefficiency
– Strong assumptions (linearity, set of production possibilities)
– Should not be employed for resource allocation in any straightforward manner
– Results can be sensitive to selection of inputs/outputs and introduction of outlier
DMUs
For further reading, see, e.g., W.D. Cook, L.M. Seiford (2009) Data envelopment analysis (DEA) – Thirty years on, European Journal of Operational Research 192/1, 1-17.
Ratio-based Efficiency Analysis (REA)1
� DEA measures efficiencies relative to the efficient frontier that
is defined by production possibilties
– This set may not be easy to characterize
– Introduction of an outlier DMUs may disrupt efficiency scores
– DEA scores reflect DMUs performance only for weights that are most
Data Envelopment Analysis Ahti Salo 42
– DEA scores reflect DMUs performance only for weights that are most
fabourable to it (cf. motivation for cross-efficiencies)
� REA
– Offers efficiency results without making assumptions about production
possibilities beyond the set of DMUs that are under comparison
– Considers the relative efficiencies of DMUs for all feasible weights
– Offers several efficiency measures1 Ahti Salo and Antti Punkka (2010). Ranking Intervals and Dominance
Relations for Ratio-Based Efficiency Analysis, submitted manuscript, downloadable at http://www.sal.hut.fi/Publications/pdf-files/msal09.pdf
Efficiency measures in REA
� Key questions
– What are the best and worst rankings that a given DMU can attain in
comparison with other DMUs, based on the comparison of DMUs' efficiency
ratios for all feasible weights?
Data Envelopment Analysis Ahti Salo 43
– Given a pair of DMUs, does the first DMU dominate the second one? (in the
sense that the efficiency ratio of the first DMU is higher than or equal to that of
the second for all feasible weights and strictly higher for some weights)
– How much more/less efficient can a given DMU be relative to some other
DMU? Or relative to the most and least efficient DMU in some subset of DMUs?
�Ranking intervals, dominance relations, efficiency bounds
Efficiency ratios in CCR-DEA
� Efficiency score of DMUk is computed with weights uk*,vk* to
maximize minl=1,...,K Ek/El
– Does not provide information about the
efficiencies for other weights
– These weights depend on what DMUs E
Data Envelopment Analysis Ahti Salo 44
– These weights depend on what DMUs
are considered ⇒ changing the
set of DMUs can influence the
order of two DMUs’ scores
� DMU1 and DMU3 are efficient
– If DMU5 is included, then DMU2 becomes more
efficient than DMU3 in terms of its DEA score
E1
E2
E3
E4
E*
E1 / E*=1
E
E4 / E*=0.82
u1
E5
E3 / E*=1
E3 / E*=0.98
Efficiency dominance (1/2)
� DMUk dominates DMUl iff
(i) its efficiency ratio is at least as high
as that of DMUl for all feasible weights
(ii) higher for some feasible weights
≥ ∈ E
E
Data Envelopment Analysis Ahti Salo 45
� Example, 2 outputs, 1 input
– Feasible weights such that 2u1 ≥ u2 ≥ u1
– DMU3 and DMU2 dominate DMU4
– Also the inefficient DMU2 is non-
dominated
( , ) ( , ) ( , ) ( , )
( , ) ( , ) ( , ) ( , )
for all
for some
k l u v
k l u v
E u v E u v u v S S
E u v E u v u v S S
≥ ∈
> ∈
u1=1/3
u2=2/3
u1=1/2
u2=1/2
E1
E2
E3
E4
E*
Efficiency dominance (2/2)
� A graph shows dominance relations
among several DMU
– Transitive: If A dominates B, and B dominates
C, then A dominates C
– Asymmetric: (i) If A dom. B, then B does not
1 2
4
3
1
2
4
3
E
E
Data Envelopment Analysis Ahti Salo 46
– Asymmetric: (i) If A dom. B, then B does not
dom. A and (ii) no DMU dominates itself
� Additional preference information
helps establish additional relations» An exception: if A dom. B and EA = EB for some
feasible weights, then it is possible that EA = EB
throughout the smaller feasible region
– Statement 5u1 ≥ 4u2 leads to new dominance
relations
5u1=
4u2
u1=1/3
u2=2/3
u1=1/2
u2=1/2
E1
E2
E3
E4
E*
Ranking intervals (1/2)
� For any feasible weights (u,v), the
DMUs can be ranked based on
their Efficiency Ratios
– The minimum ranking of DMUk, rkmin, is
obtained for weights such that the
E1
E2
E3
E4
E*
E
Data Envelopment Analysis Ahti Salo 47
obtained for weights such that the
number of DMUs with strictly higher
Efficiency Ratio is minimized
– The maximum ranking of DMUk, rkmax, is
obtained for weights such that the
number of DMUs with higher or equal
Efficiency Ratio is maximized
DMU1 DMU3DMU2 DMU4
ranking 1
ranking 2
ranking 3
ranking 4
u1=1/3
u2=2/3
u1=1/2
u2=1/2
Ranking intervals (2/2)
� Properties
– Can be readily compared
– Provides a holistic view of efficiency ratios at a glance
– Show also how ’bad’ DMUs can be
– Are insentitive to the introduction of outlier DMUS
Data Envelopment Analysis Ahti Salo 48
– Are insentitive to the introduction of outlier DMUS
� Additional weight information can narrow (but not widen)
ranking intervals
� CCR-DEA-efficient DMUs have the highest efficiency ratio for
some weights ⇒ their minimum ranking is 1
Computation of dominance relations (1/2)
� How to determine whether DMUk dominates DMUl
( , ) ( , ) ( , ) ( , ) and
( , ) ( , ) for some ( , ) ( , )?
k l u v
k l u v
E u v E u v u v S S
E u v E u v u v S S
≥ ∀ ∈
> ∈
Data Envelopment Analysis Ahti Salo 49
( , ) ( , )
( , ) ( , )
( , ) ( , ) ( , ) ( , ) if
min [ ( , ) ( , )] 0
( , )min 1 ...
( , )
u v
u v
k l u v
k lu v S S
k
u v S Sl
E u v E u v u v S S
E u v E u v
E u v
E u v
∈
∈
≥ ∀ ∈
− ≥ ⇔
≥ ⇔(Su,Sv) is open, not bounded, and the
objective function non-linear...
How to solve the optimization problem?
Computation of dominance relations (2/2)
� Normalize weights so that
– The value of inputs of DMUk=1
– The value of outputs of DMUl is equal
to its value of inputs
� Feasible weights are now
1 1
00
min / 1u
N N
n nk n nl
n n
M MA uA v
u y u y
v x v x
= =
≤≤
≥ ⇔
∑ ∑
∑ ∑
Data Envelopment Analysis Ahti Salo 50
� Feasible weights are now
bounded, closed by linear
constraints, objective function
linear
� If the minimum is exactly 1,
maximize the same objective
function to see whether there
exists weights such that Ek > El
0
1 1
100
1
min 1
u
v
u
v
m mk
m ml n nl
A vm mk m ml
m m
N
n nk
nA uA v
v x
v x u y
v x v x
u y
≤
= =
=≤≤
=
=
≥
∑∑ ∑
∑ ∑
∑
Computation of ranking intervals and efficiency bounds
� Minimum (best) rankings for DMUk
1. For all other DMUs, define binary variables zl so that zl = 1 if El > Ek
2. Choose a suitable normalization to come up with a MILP model
( , ) ( , ) , 0l k l
E u v E u v Cz C≤ + >>
Data Envelopment Analysis Ahti Salo 51
3. The minimum is 1 + the minimum of zl over (Su,Sv)
– Maximum rankings with a corresponding model
� Efficiency bounds compared to the most efficient DMU
– Maximum with LP similar to the computation of DEA scores
– Minimum
1. Minimize the linear model used for the computation of dominance relations against all DMUs in the benchmark group
2. The smallest of these is the minimum
– Comparisons to the least efficient DMU with corresponding models
Example: Efficiency analysis of TKK’s departments
� Departments consume inputs in order to produce outputs
– Data from TKK’s reporting system
– 2 inputs, 44 outputs
x1 (Budget funding) y1 (Master’s Theses)
Data Envelopment Analysis Ahti Salo 52
� Preferences from 7 members of the Resources Committee
– Ex: What is the value of a Master’s thesis relative to a dissertation.?
– Each member responded to elicitation questions, which yielded crisp weights
– The feasible weights were then modeled as all possible convex combinations
of these weightings
Department y2 (Dissertations)
y3 (Int’l publications)
x2 (Project funding)
1.00
0.72
0.810.76
1.00 0.97 1.00
0.83
0.71
0.77
0.59
0.39
0.46
0.31
0.51
0.39
0.580.57
0.47
0.64
0.53
0.66
0.480.52
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
A B C D E F G H I J K L
1
2
3
4
5
6
7
8
9
10
11
12
13
A B C D E F G H I J K L
1
2
3
4
5
6
7
8
9
10
11
12
1
2
3
4
5
6
7
8
9
10
11
12
13
A B C D E F G H I J K L
1
2
3
4
5
6
7
8
9
10
11
12
Efficiency bounds compared tothe most efficient department
Ranking intervals
� Departments A, J and L are efficient
Data Envelopment Analysis Ahti Salo 53
A
D, F, H
B
C, E
G
I
J
K
L
Dominance relations
� Departments A, J and L are efficient– But A can attain ranking 7 > 4, the worst ranking of the
inefficient department K
– There are feasible weights so that the Efficiency Ratio of A is only 57 % of that of the most efficient department
» For K, the corresponding ratio is 71%
� The efficiency intervals of D, F and H overlap with those of B and G– Yet, for all feasible weights the Efficiency Ratios of D, F
and H are smaller than those of B and G
Conclusion
� REA results use all feasible weights to evaluate DMUs
– Dominance relations compare DMUs pairwise
– Ranking intervals show which rankings can be attained by DMUs
– Efficiency bounds show how efficient a DMU can be compared to the DMUs
in a benchmark group
Data Envelopment Analysis Ahti Salo 54
in a benchmark group
– Computed with LP and MILP models
� Admits preference information
– Helps exclude the use of extreme weights in efficiency determination:
“100 dissertations is less valuable than an article”
– Additional preference information makes REA results more conclusive
� Introduction of new DMUs do not affect results for other DMUs