54
Data Envelopment Analysis Data Envelopment Analysis 1 Ahti Salo Systems Analysis Laboratory Aalto University School of Science and Technology P.O.Box 11100, 00076 Aalto FINLAND These slides build extensively on the teaching materials of Prof. Sri Talluri who gave a DEA course in Helsinki in 2007 (used with permission).

Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Embed Size (px)

Citation preview

Page 1: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Data Envelopment Analysis Data Envelopment Analysis

1

Ahti SaloSystems Analysis Laboratory

Aalto University School of Science and TechnologyP.O.Box 11100, 00076 Aalto

FINLAND

These slides build extensively on the teaching materials of Prof. Sri Talluri who gave a DEA course in Helsinki in 2007 (used with permission).

Page 2: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Data Envelopment Analysis Ahti Salo 2

Page 3: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Which Decision Making Unit (DMU) is most productive?Which Decision Making Unit (DMU) is most productive?

Data Envelopment Analysis Ahti Salo 3

Page 4: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

DMU labor hrs. #cust. #cust/hr.

� DMU = Decision Making Unit

� A method for measuring the productivity of DMUs which

consume multiple inputs and produce multiple outputs

DEA (DEA (CharnesCharnes, Coopers & Rhodes ‘78) , Coopers & Rhodes ‘78)

Data Envelopment Analysis Ahti Salo 4

DMU labor hrs. #cust. #cust/hr.1 100 150 1.502 75 140 1.873 120 160 1.334 100 140 1.40

5 40 50 1.25

labor hrs.

x x

50 100

100

200

x

x

x

DMU’s 1,3,4,5 are dominated by DMU 2.

#cust

Page 5: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� 8 M.D.s works at a Hospital for the same 160 hrs in a month.

– Each performs exams and surgeries

– Which ones are most “productive”?

D o c to r # E x a m s # S u rg e rie s

1 4 8 6 8

Extending to multiple outputs ..Extending to multiple outputs ..

Data Envelopment Analysis Ahti Salo 5

– Note: There is some “efficient” trade-off between the number of surgeries and

exams that any one M.D. can do in a month, but what is it?

2 1 2 8 0

3 3 5 7 6

4 3 1 7 1

5 2 0 7 0

6 2 0 1 0 5

7 3 6 5 38 1 5 6 5

Page 6: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

60

80

100

120

#S

urg

eri

es

Efficient M.D.’s: These two M.D.’s (#1 and #6) define the most efficient trade-off between the two outputs.#6

#1

Scatter plot of Scatter plot of ouputsouputs

Data Envelopment Analysis Ahti Salo 6

0

20

40

60

0 10 20 30 40 50 60

#Exams

#S

urg

eri

es

These points are dominated

by #1 and #6.

“Pareto-Koopman efficiency” along the efficient frontier: It is impossible to increase an output (or to decrease an input) without a compensating decrease (increase) in other outputs (inputs).

Page 7: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� How “bad” are inefficient M.D.s relative to the efficient ones?

� Where are the gaps?

Performance gapsPerformance gaps

Data Envelopment Analysis Ahti Salo 7

� How “bad” are the gaps?

Page 8: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� “Nearest” efficient DMUs define � a reference set and

� linear combination of the reference set inputs and outputs

of a hypothetical composite unit (HCU)

Reference setReference set

Data Envelopment Analysis Ahti Salo 8

Page 9: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Summary of DEA thus far Summary of DEA thus far

� Input/output productivity is defined relative to the efficient

frontier

� This frontier characterizes observed efficient trade-offs

among inputs and outputs for a given set of DMUs

Data Envelopment Analysis Ahti Salo 9

among inputs and outputs for a given set of DMUs

� Efficiency is defined as the relative distance to the frontier

� “Nearest point” on the frontier is the efficient comparison

unit (hypothetical comparison unit, HCU)

� Differences in inputs and outputs between DMU and HCU

correspond to productivity “gaps” (improvement potential)

� But how can we do this analysis systematically?

Page 10: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

A real example on NY Area Sporting Goods StoresA real example on NY Area Sporting Goods Stores

Data Envelopment Analysis Ahti Salo 10

Page 11: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� Conceptually, productivity (efficiency) is the ratio between

outputs and inputsOutputs

Productivity =Inputs

ProductivityProductivity

Data Envelopment Analysis Ahti Salo 11

� Yet reality is rather more complex

Technology+

Decision Making

Inputs Outputs

equipment

facility space

server labor

mgmt. labor

#type A cust.

#type B cust.

quality index

$ oper. profit

Page 12: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� Mix of customers served

� Availability and cost of inputs

� Configuration of production facilities

� Processes and practices used

Differences among Operating Units (DMUs)Differences among Operating Units (DMUs)

Data Envelopment Analysis Ahti Salo 12

� Examples

– Bank branches, retail stores, clinics, schools, etc

� Questions:

– How to compare the productivity of diverse operating units that serve

diverse markets?

– What are the “best practice” and under-performing units?

– What are the trade-offs among inputs and outputs?

– Where are the improvement opportunities and how big are they?

Page 13: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� Operating ratios

– Examples: Labor hours per transaction, € sales per square meter

– Appropriate for highly standardized operations

– But these do not reflect the varying mix of inputs/outputs of diverse operations

Some approachesSome approaches

Data Envelopment Analysis Ahti Salo 13

� Financial approach: Convert everything to monetary terms

� Concerns

– Some inputs/outputs cannot be valued in € (non-profit)

– Profitability is not the same as operating efficiency (e.g. variances in margins and

local costs matter as well)

Inputs in € Outputs in €

Page 14: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Profitability vs. efficiencyProfitability vs. efficiency

� Profitability is a function of three elements …

– Input prices (costs)

– Output prices

– Technical efficiency: How much input is required to generate the output

Data Envelopment Analysis Ahti Salo 14

� Improving operations calls for an understanding of technical

efficiency, not just overall profitability.

Page 15: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� CCR Model

– Charnes, Cooper, and Rhodes (1978)

– Assumes constant returns to scale in production possibilities: an increase in the

amount of inputs leads to a proportional increase in outputs

� BCC Model

Variants of DEA ModelsVariants of DEA Models

Data Envelopment Analysis Ahti Salo 15

� BCC Model

– Banker, Charnes and Cooper (1984)

– Constant returns to scale not assumed, efficiency depends on the scale of

operations

� Super efficiency model

� DEA models with weight information

� Cross-efficiency models in DEA

� Ratio-based Efficiency Analysis (REA)

Page 16: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

#operating units (DMUs)

# inputs

#outputs

observed level of output from DMU

observed level of input from DMU

nk

K k = 1,...,K

M m = 1,...,M

N n = 1,...,N

y n k

x m k

NotationNotation

� Data

Data Envelopment Analysis Ahti Salo 16

observed level of input from DMU

weight of inp

mk

m

x m k

v ut

weight on output

efficiency of DMU (0-100%)

n

k

N

n nk

n=1

k M

m mk

m=1

i

u n

E k

u y

E =

v x

� Model variables

Page 17: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� Choose nonnegative I/O weights to

� This is equivalent to

Evaluating the CCR efficiency of DMU Evaluating the CCR efficiency of DMU kk

max subject to

k

k

E

E 1, k = 1,...,K

∑ n nku y

Data Envelopment Analysis Ahti Salo 17

max

subject to

n nk

n

m mk

m

n nl

n

m ml

m

n m

v x

u y

1, l = 1,...,Kv x

u ,v 0

Weighted input of DMU k is normalized

to one

max

subject to

− ≤

∑ ∑

n nk

n

m mk

m

n nl m ml

n m

n m

u y

v x = 1

u y v x 0, l = 1,...,K

u ,v 0

Page 18: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� Four DMUs, one input, one output

� The efficiency ratio is highest for DMU A

– Max.efficiency = 1

⇒ Input weight twice as high

as output weight

An example with 4 DMUs An example with 4 DMUs

Data Envelopment Analysis Ahti Salo 18

as output weight

⇒ Efficiencies of other DMUs

EB = 6/8 = 0.75

EC = 9/12 = 0.75

ED = 10/16 = 0.625 Output needed to reach efficiency = 2x4 = 8

Actual output = 6

Page 19: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� How much less inputs should an inefficient DMU use in order

to become efficient?

min subject toθ

λ θ≤∑K

x x , m = 1,...,M

InputInput--Oriented CCR Ratio ModelOriented CCR Ratio Model

Data Envelopment Analysis Ahti Salo 19

� Optimal θ is the same efficiency as from the primal model

λ θ

λ

λ

i mi mk

i=1

K

i ni nk

i=1

i

x x , m = 1,...,M

y y , n = 1,...,N

0, i = 1,...,K

Page 20: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� Dual variable associated with DMU i

� These variables can be used to construct an efficient

hypothetical composite unit (HCU) with

DMU is in the reference set of DMU⇒iλ > 0 i k

Dual formulationDual formulation

Data Envelopment Analysis Ahti Salo 20

such that

ˆ

ˆ

K

n i ni

i=1

K

m i mi

i

y = λ y , n = 1,...,N

x = λ x , m = 1,...,M Input n of HCU

Output n of HCU

ˆ

ˆ

n nk

m mk

y y , n = 1,...,N

x x , m = 1,...,M

Page 21: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� HCU can be used to measure how much more the DMU

should produce or how much less it should consume inputs in

order to become efficient

Output ˆ∆ ≥ = y - y 0, n = 1,...,N

Uses of the HCUUses of the HCU

Data Envelopment Analysis Ahti Salo 21

� Cf. spreadsheet examples

Output ˆ

Input ˆ

∆ ≥

∆ ≥

n nk

mk m

= y - y 0, n = 1,...,N

= x - x 0, m = 1,...,M

Page 22: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� Examples

– B should produce its current

output (6) with one unit less

of inputs in order to reach the

efficient frontier

Excessive uses of inputs by inefficient DMUsExcessive uses of inputs by inefficient DMUs

Data Envelopment Analysis Ahti Salo 22

– The gap is therefore one unit

Input∆ = 4 - 3 = 1

Page 23: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� Seeks to answer how much more DMU k should produce in

order to become efficient

max subject toθ

λ ≤∑K

x x , m = 1,...,M

OutputOutput--oriented CCR modeloriented CCR model

Data Envelopment Analysis Ahti Salo 23

� Efficiency is the reciprocal of optimum θ (i.e. )

λ

λ θ

λ

i mi mk

i=1

K

i ni nk

i=1

i

x x , m = 1,...,M

y y , n = 1,...,N

0, i = 1,...,K

1

θ

Page 24: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� Examples

– The optimal θ for is 4/3

– Thus B should produce

(4/3)*6 – 6 = 2 units more

using its current inputs to

Output gaps for inefficient DMUsOutput gaps for inefficient DMUs

Data Envelopment Analysis Ahti Salo 24

using its current inputs to

reach the efficient frontier

– The CCR efficiency of B is

1 over 4/3 = 0.75

Page 25: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

An illustrative CCR modelAn illustrative CCR model

DMU Input 1 Input 2 Output 1 Output 2 Output 3

1 5 14 9 4 16

2 8 15 5 7 10

3 7 12 4 9 13

Data Envelopment Analysis Ahti Salo 25

max subject to

1 2 3

1 2

1 2 3 1 2

1 2 3 1 2

1 2 3 1 2

1 2 3 1 2

9u + 4v + 16v

5v + 14v = 1

9u + 4u + 16u 5v + 14v

5u +7u + 10u 8v + 15v

4u + 9u + 13u 7v + 12v

u ,u ,u ,v ,v 0

Page 26: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� DMU 1 and DMU 3 are efficient

– Efficiency of 1.00 with no slacks

� DMU 2 is inefficient

– Efficiency < 1.00

Results for the illustrative exampleResults for the illustrative example

Data Envelopment Analysis Ahti Salo 26

– Efficiency < 1.00

– DMUs 1 and 3 can be employed as benchmarks for improvement

� See Excel example

Page 27: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

BCC ModelBCC Model

� CCR model assumes constant returns to scale (CRS)

whereas the BCC model considers variable returns to scale

(VRS)

min subject toθ

Data Envelopment Analysis Ahti Salo 27

New constraint(convexity)

K

i mi mk

i=1

K

i ni nk

i=1

K

i i

i=1

λ x θx , m = 1,...,M

λ y y , n = 1,...,N

λ = 1, λ 0

Page 28: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� C is BCC efficient

� B is BCC inefficient

– A 50%-50% combination of

DMUs A and C uses 6 input

Change in the set of production possibilitiesChange in the set of production possibilities

CCR efficient frontier

Data Envelopment Analysis Ahti Salo 28

DMUs A and C uses 6 input

units and produces 6,5 output

units

– This is more than the 6 units that

B produces

– The resulting BCC output

efficiency becomes

1 over (6.5/6) = 0.92307

– Similar analyses for input can be made

� The resulting

BCC efficient frontier

Page 29: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� Helps determine how much more efficient an efficient DMU is

relative to other DMUs

Super efficiency modelSuper efficiency model

max subject to∑ n nk

n

u y DMU k under evaluationis removed from the constraintset thereby allowing its efficiency

Data Envelopment Analysis Ahti Salo 29

� The model does help rank inefficient DMUs

≤ ≠

∑ ∑

m mk

m

n nl m ml

n m

m n

v x = 1

u y v x , l = 1,...,K, l k

u ,v 0

set thereby allowing its efficiencyscore to exceed a value of 1.00

Page 30: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� D evaluated relative to the frontier defined by C-E-F

� Superefficiency defined

by the distance OD/OD’

� Similarly E evaluated in

O1/I

A

E

DC

D’

Super efficiency illustratedSuper efficiency illustrated

Data Envelopment Analysis Ahti Salo 30

comparison with the frontier

C-D-F and its superefficiency

defined by the distance

OE-OE’

� By visual inspection, D is

slightly more superefficient

than D O2/I

F

E

Efficient frontier

E’

O

Page 31: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

DEA models with weight informationDEA models with weight information

� DMUs may attain their efficiency scores for ‘extreme’ weights

in conventional DEA models

� Preference information can be captured through preference

Data Envelopment Analysis Ahti Salo 31

statements about the relative values of

� input units

� output units

� Statements impose constraints on the input/output weights

– The introduction of weight information often leads to lower (but never higher)

efficiency scores

Page 32: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Sets of feasible weights (assurance regions)

� Preference statements constrain feasible weights

– “A Dissertation is as at least as valuable as 2 Master’s Theses, but not more

valuable than 7 master’s theses”

» udoctoral ≥ 2umaster’s , udoctoral ≤ 7umaster’s

– “An article in a refereed journal is at least as valuable as a Master’s Thesis”

Data Envelopment Analysis Ahti Salo 32

» uarticle ≥ umaster’s

– Only relative weights matter

– Several elicitation methods can be employed

� Feasible sets defined by corresponding constraints

{ }

{ }

1

1

( ,..., ) ' 0 | 0, 0

( ,..., ) ' 0 | 0, 0

u N u

v M v

S u u u u A u

S v v v v A v

= = ≠ ≥ ≤

= = ≠ ≥ ≤

Page 33: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

max subject to∑

n nk

n

m mk

u y

v x = 1

Example of a DEA model with weight restrictions Example of a DEA model with weight restrictions

Data Envelopment Analysis Ahti Salo 33

,

,

≤ ≤

≤ ≤

∑ ∑

m mk

m

n nl m ml

n m

m m 1 m m

n n 1 n n

m n

u y v x , l = 1,...,K

α v v β v m = 1,…,M

a u u b u n = 1,…,N

u ,v 0

Page 34: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� Without any weight information,

F is efficient

� Assume that the 1st output

on the vertical axis is has

O1/I

A

E

DC

Weight constraints illustrated (1 input, 2 outputs)Weight constraints illustrated (1 input, 2 outputs)

Data Envelopment Analysis Ahti Salo 34

more weight than the 2nd

output on the horizontal axis

� Now F becomes dominated

by D and E (i.e., for all weights

in the revised weight set,

D and E will have a higher

efficiency)

F

OO2/I

Page 35: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� CCR efficiencies are based on the weights which are most

favourable to the DMU being evaluated

� Yet it may be of interest to know how the DMU performs when

CrossCross--efficiencies in DEAefficiencies in DEA

Data Envelopment Analysis Ahti Salo 35

using other weights as well.

� The cross efficiency score represents how the DMU performs

when evaluated with the optimal weights for all DMUs

� A DMU with a high cross efficiency score can be considered to

be a good overall performer; others are more “niche” DMUs

Page 36: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Cross efficiency matrixCross efficiency matrix

Data Envelopment Analysis Ahti Salo 36

� Cross-efficiency score for DMU k is the average of these scores

� Multiple optima are possible, selections either based on

aggressive formulation or benevolent formulation

Efficiency score of DMU 2 when evaluatedwith the optimal weights of DMU 1

1

1 K

k ik

i

CRK =

= Θ∑

Page 37: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

� Examples of inputs in operations management

– Workers, machines, operating expenses, budget, etc.

� Examples of outputs

– Number of actual products produced

Selecting inputs and outputsSelecting inputs and outputs

Data Envelopment Analysis Ahti Salo 37

– Number of actual products produced

– Performance and activity measures such as quality levels, throughput rates,

lead-times, etc.

� If there are M inputs and N outputs then potentially MN DMUs

can be efficient ⇒ To achieve discrimination the number of

DMUs should be high enough

Page 38: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Designing DEA StudiesDesigning DEA Studies

� Enough DMUs in relation to inputs/outputs for building an

efficient frontier

� “Ambivalence” about inputs/outputs - all should matter!

“Approximate similarity” (comparability) of DMUs

K > 2(N + M)

Data Envelopment Analysis Ahti Salo 38

� “Approximate similarity” (comparability) of DMUs

– Objectives

– Technology

� DEA provides relative efficiency only

– Choice of DMUs does matter

– Inclusion of “global leader” unit may be desirable

� Experiments with different I/O combinations may be necessary

Page 39: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Using the results: Efficiency Using the results: Efficiency –– Profit matrixProfit matrixHigh Profit

Low High

Under-performingpotential leaders

Best practice comparison group

Data Envelopment Analysis Ahti Salo 39

Low Profit

LowEff.

HighEff.

Under-performingpossibly profitable

Candidates forclosure

Page 40: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Information provided by DEAInformation provided by DEA

� Objective measures of efficiency

� A reference set of comparable units

Data Envelopment Analysis Ahti Salo 40

� Indicators of excess use of inputs

� Shortfalls in the production of outputs

� Returns to scale measure

Page 41: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

DEA SummaryDEA Summary

� Uses of DEA

– Benchmarking to identify “best practice” units

– “Data mining” to generate hypotheses about the drivers of efficiency

– Performance evaluation and measurement

Data Envelopment Analysis Ahti Salo 41

� Caveats

– Essentially a “black box” approach - gives no information about the causes of

inefficiency

– Strong assumptions (linearity, set of production possibilities)

– Should not be employed for resource allocation in any straightforward manner

– Results can be sensitive to selection of inputs/outputs and introduction of outlier

DMUs

For further reading, see, e.g., W.D. Cook, L.M. Seiford (2009) Data envelopment analysis (DEA) – Thirty years on, European Journal of Operational Research 192/1, 1-17.

Page 42: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Ratio-based Efficiency Analysis (REA)1

� DEA measures efficiencies relative to the efficient frontier that

is defined by production possibilties

– This set may not be easy to characterize

– Introduction of an outlier DMUs may disrupt efficiency scores

– DEA scores reflect DMUs performance only for weights that are most

Data Envelopment Analysis Ahti Salo 42

– DEA scores reflect DMUs performance only for weights that are most

fabourable to it (cf. motivation for cross-efficiencies)

� REA

– Offers efficiency results without making assumptions about production

possibilities beyond the set of DMUs that are under comparison

– Considers the relative efficiencies of DMUs for all feasible weights

– Offers several efficiency measures1 Ahti Salo and Antti Punkka (2010). Ranking Intervals and Dominance

Relations for Ratio-Based Efficiency Analysis, submitted manuscript, downloadable at http://www.sal.hut.fi/Publications/pdf-files/msal09.pdf

Page 43: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Efficiency measures in REA

� Key questions

– What are the best and worst rankings that a given DMU can attain in

comparison with other DMUs, based on the comparison of DMUs' efficiency

ratios for all feasible weights?

Data Envelopment Analysis Ahti Salo 43

– Given a pair of DMUs, does the first DMU dominate the second one? (in the

sense that the efficiency ratio of the first DMU is higher than or equal to that of

the second for all feasible weights and strictly higher for some weights)

– How much more/less efficient can a given DMU be relative to some other

DMU? Or relative to the most and least efficient DMU in some subset of DMUs?

�Ranking intervals, dominance relations, efficiency bounds

Page 44: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Efficiency ratios in CCR-DEA

� Efficiency score of DMUk is computed with weights uk*,vk* to

maximize minl=1,...,K Ek/El

– Does not provide information about the

efficiencies for other weights

– These weights depend on what DMUs E

Data Envelopment Analysis Ahti Salo 44

– These weights depend on what DMUs

are considered ⇒ changing the

set of DMUs can influence the

order of two DMUs’ scores

� DMU1 and DMU3 are efficient

– If DMU5 is included, then DMU2 becomes more

efficient than DMU3 in terms of its DEA score

E1

E2

E3

E4

E*

E1 / E*=1

E

E4 / E*=0.82

u1

E5

E3 / E*=1

E3 / E*=0.98

Page 45: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Efficiency dominance (1/2)

� DMUk dominates DMUl iff

(i) its efficiency ratio is at least as high

as that of DMUl for all feasible weights

(ii) higher for some feasible weights

≥ ∈ E

E

Data Envelopment Analysis Ahti Salo 45

� Example, 2 outputs, 1 input

– Feasible weights such that 2u1 ≥ u2 ≥ u1

– DMU3 and DMU2 dominate DMU4

– Also the inefficient DMU2 is non-

dominated

( , ) ( , ) ( , ) ( , )

( , ) ( , ) ( , ) ( , )

for all

for some

k l u v

k l u v

E u v E u v u v S S

E u v E u v u v S S

≥ ∈

> ∈

u1=1/3

u2=2/3

u1=1/2

u2=1/2

E1

E2

E3

E4

E*

Page 46: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Efficiency dominance (2/2)

� A graph shows dominance relations

among several DMU

– Transitive: If A dominates B, and B dominates

C, then A dominates C

– Asymmetric: (i) If A dom. B, then B does not

1 2

4

3

1

2

4

3

E

E

Data Envelopment Analysis Ahti Salo 46

– Asymmetric: (i) If A dom. B, then B does not

dom. A and (ii) no DMU dominates itself

� Additional preference information

helps establish additional relations» An exception: if A dom. B and EA = EB for some

feasible weights, then it is possible that EA = EB

throughout the smaller feasible region

– Statement 5u1 ≥ 4u2 leads to new dominance

relations

5u1=

4u2

u1=1/3

u2=2/3

u1=1/2

u2=1/2

E1

E2

E3

E4

E*

Page 47: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Ranking intervals (1/2)

� For any feasible weights (u,v), the

DMUs can be ranked based on

their Efficiency Ratios

– The minimum ranking of DMUk, rkmin, is

obtained for weights such that the

E1

E2

E3

E4

E*

E

Data Envelopment Analysis Ahti Salo 47

obtained for weights such that the

number of DMUs with strictly higher

Efficiency Ratio is minimized

– The maximum ranking of DMUk, rkmax, is

obtained for weights such that the

number of DMUs with higher or equal

Efficiency Ratio is maximized

DMU1 DMU3DMU2 DMU4

ranking 1

ranking 2

ranking 3

ranking 4

u1=1/3

u2=2/3

u1=1/2

u2=1/2

Page 48: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Ranking intervals (2/2)

� Properties

– Can be readily compared

– Provides a holistic view of efficiency ratios at a glance

– Show also how ’bad’ DMUs can be

– Are insentitive to the introduction of outlier DMUS

Data Envelopment Analysis Ahti Salo 48

– Are insentitive to the introduction of outlier DMUS

� Additional weight information can narrow (but not widen)

ranking intervals

� CCR-DEA-efficient DMUs have the highest efficiency ratio for

some weights ⇒ their minimum ranking is 1

Page 49: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Computation of dominance relations (1/2)

� How to determine whether DMUk dominates DMUl

( , ) ( , ) ( , ) ( , ) and

( , ) ( , ) for some ( , ) ( , )?

k l u v

k l u v

E u v E u v u v S S

E u v E u v u v S S

≥ ∀ ∈

> ∈

Data Envelopment Analysis Ahti Salo 49

( , ) ( , )

( , ) ( , )

( , ) ( , ) ( , ) ( , ) if

min [ ( , ) ( , )] 0

( , )min 1 ...

( , )

u v

u v

k l u v

k lu v S S

k

u v S Sl

E u v E u v u v S S

E u v E u v

E u v

E u v

≥ ∀ ∈

− ≥ ⇔

≥ ⇔(Su,Sv) is open, not bounded, and the

objective function non-linear...

How to solve the optimization problem?

Page 50: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Computation of dominance relations (2/2)

� Normalize weights so that

– The value of inputs of DMUk=1

– The value of outputs of DMUl is equal

to its value of inputs

� Feasible weights are now

1 1

00

min / 1u

N N

n nk n nl

n n

M MA uA v

u y u y

v x v x

= =

≤≤

≥ ⇔

∑ ∑

∑ ∑

Data Envelopment Analysis Ahti Salo 50

� Feasible weights are now

bounded, closed by linear

constraints, objective function

linear

� If the minimum is exactly 1,

maximize the same objective

function to see whether there

exists weights such that Ek > El

0

1 1

100

1

min 1

u

v

u

v

m mk

m ml n nl

A vm mk m ml

m m

N

n nk

nA uA v

v x

v x u y

v x v x

u y

= =

=≤≤

=

=

∑∑ ∑

∑ ∑

Page 51: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Computation of ranking intervals and efficiency bounds

� Minimum (best) rankings for DMUk

1. For all other DMUs, define binary variables zl so that zl = 1 if El > Ek

2. Choose a suitable normalization to come up with a MILP model

( , ) ( , ) , 0l k l

E u v E u v Cz C≤ + >>

Data Envelopment Analysis Ahti Salo 51

3. The minimum is 1 + the minimum of zl over (Su,Sv)

– Maximum rankings with a corresponding model

� Efficiency bounds compared to the most efficient DMU

– Maximum with LP similar to the computation of DEA scores

– Minimum

1. Minimize the linear model used for the computation of dominance relations against all DMUs in the benchmark group

2. The smallest of these is the minimum

– Comparisons to the least efficient DMU with corresponding models

Page 52: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Example: Efficiency analysis of TKK’s departments

� Departments consume inputs in order to produce outputs

– Data from TKK’s reporting system

– 2 inputs, 44 outputs

x1 (Budget funding) y1 (Master’s Theses)

Data Envelopment Analysis Ahti Salo 52

� Preferences from 7 members of the Resources Committee

– Ex: What is the value of a Master’s thesis relative to a dissertation.?

– Each member responded to elicitation questions, which yielded crisp weights

– The feasible weights were then modeled as all possible convex combinations

of these weightings

Department y2 (Dissertations)

y3 (Int’l publications)

x2 (Project funding)

Page 53: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

1.00

0.72

0.810.76

1.00 0.97 1.00

0.83

0.71

0.77

0.59

0.39

0.46

0.31

0.51

0.39

0.580.57

0.47

0.64

0.53

0.66

0.480.52

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

A B C D E F G H I J K L

1

2

3

4

5

6

7

8

9

10

11

12

13

A B C D E F G H I J K L

1

2

3

4

5

6

7

8

9

10

11

12

1

2

3

4

5

6

7

8

9

10

11

12

13

A B C D E F G H I J K L

1

2

3

4

5

6

7

8

9

10

11

12

Efficiency bounds compared tothe most efficient department

Ranking intervals

� Departments A, J and L are efficient

Data Envelopment Analysis Ahti Salo 53

A

D, F, H

B

C, E

G

I

J

K

L

Dominance relations

� Departments A, J and L are efficient– But A can attain ranking 7 > 4, the worst ranking of the

inefficient department K

– There are feasible weights so that the Efficiency Ratio of A is only 57 % of that of the most efficient department

» For K, the corresponding ratio is 71%

� The efficiency intervals of D, F and H overlap with those of B and G– Yet, for all feasible weights the Efficiency Ratios of D, F

and H are smaller than those of B and G

Page 54: Data Envelopment Analysis - CentraleSupelecmousseau/mcda-ss/pmwiki-2.1.27/.../SlidesDEA-Ahti.pdf · These slides build extensively on the teaching materials of Prof. Sri Talluri who

Conclusion

� REA results use all feasible weights to evaluate DMUs

– Dominance relations compare DMUs pairwise

– Ranking intervals show which rankings can be attained by DMUs

– Efficiency bounds show how efficient a DMU can be compared to the DMUs

in a benchmark group

Data Envelopment Analysis Ahti Salo 54

in a benchmark group

– Computed with LP and MILP models

� Admits preference information

– Helps exclude the use of extreme weights in efficiency determination:

“100 dissertations is less valuable than an article”

– Additional preference information makes REA results more conclusive

� Introduction of new DMUs do not affect results for other DMUs