26
Chapter 5 Forecasting © 2008 Prentice-Hall, Inc. Quantitative Analysis for Management, Tenth Edition, by Render, Stair, and Hanna Introduction Forecast – to calculate or estimate something in advance or to predict the future Managers are always trying to reduce uncertainty and make better estimates of 5 – 2 uncertainty and make better estimates of what will happen in the future when they make decisions E.g. inventory to order, new equipment to purchase, investments to make This is the main purpose of forecasting Introduction Some firms (especially small ones) use subjective methods Seat-of-the pants methods, intuition, experience, guesswork 5 – 3 experience, guesswork There are also several quantitative techniques Moving averages, exponential smoothing, trend projections, least squares regression analysis Introduction Regardless of what method is used, the same eight steps are used to make the forecast: 1. Determine the use of the forecast — what objective are we trying to obtain? 2. Select the items or quantities that are to be forecasted 5 – 4 forecasted 3. Determine the time horizon of the forecast — shot term (1 month), medium term (1 year) or long term (> 1 year) 4. Select the forecasting model or models 5. Gather the data needed to make the forecast 6. Validate the forecasting model 7. Make the forecast 8. Implement the results

RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Chapter 5

Forecasting

© 2008 Prentice-Hall, Inc.Quantitative Analysis for Management , Tenth Edition ,by Render, Stair, and Hanna

Introduction

� Forecast – to calculate or estimate something in advance or to predict the future

� Managers are always trying to reduce uncertainty and make better estimates of

5 – 2

uncertainty and make better estimates of what will happen in the future when they make decisions� E.g. inventory to order, new equipment to

purchase, investments to make� This is the main purpose of forecasting

Introduction

� Some firms (especially small ones) use subjective methods�Seat-of-the pants methods, intuition,

experience, guesswork

5 – 3

experience, guesswork� There are also several quantitative

techniques�Moving averages, exponential

smoothing, trend projections, least squares regression analysis

Introduction

� Regardless of what method is used, the same eight steps are used to make the forecast:

1. Determine the use of the forecast — what objective are we trying to obtain?

2. Select the items or quantities that are to be forecasted

5 – 4

forecasted3. Determine the time horizon of the forecast —

shot term ( ≤ 1 month), medium term ( ≤ 1 year) or long term (> 1 year)

4. Select the forecasting model or models5. Gather the data needed to make the forecast6. Validate the forecasting model7. Make the forecast8. Implement the results

Page 2: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Introduction

� These steps are a systematic way of initiating, designing, and implementing a forecasting system

� When used regularly over time, data is collected routinely and calculations performed automatically

5 – 5

automatically� There is seldom one superior forecasting

system� Different organizations may use different

techniques� Whatever tool works best for a firm is the one

they should use

Regression MovingDelphi

Time-Series Models

Qualitative Models

Causal Models

Forecasting ModelsForecasting Techniques

5 – 6

Regression Analysis

Multiple Regression

MovingAverage

Exponential Smoothing

Trend Projections

Decomposition

DelphiMethods

Jury of ExecutiveOpinion

Sales ForceComposite

ConsumerMarket Survey

Figure 5.1

Time-Series Models

�� TimeTime--series modelsseries models attempt to predict the future by using historical data� Assume what happens in the future is a

function of what has happened in the past

5 – 7

� Look at what happened over a period of time and use a series of past data to make a forecast

� E.g. use past weekly sales to forecast the next week’s sales

Time-Series Models

� Common time-series models are� Moving average� Exponential smoothing� Trend projections

Decomposition

5 – 8

� Decomposition

� Regression analysis (Chapter 4) is used in trend projections and in one type of decomposition model

� We emphasize time-series forecast in this chapter

Page 3: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Causal Models

�� Causal modelsCausal models use variables or factors that might influence the quantity being forecasted (may also include past data)

� The objective is to build a model with the best statistical relationship ( r2, p-value, etc)

5 – 9

best statistical relationship ( r , p-value, etc) between the variable being forecast and the independent variables

� E.g. daily sales of a cola drink might depend on factors such as temperature, season, humidity, day of the week, and past sales

� Regression analysis is the most common technique used in causal modeling

Qualitative Models

�� Qualitative modelsQualitative models incorporate judgmental or subjective factors into the model –time-series and causal models relying on quantitative data

� Useful when subjective factors are

5 – 10

� Useful when subjective factors are thought to be important or when accurate quantitative data is difficult to obtain

� Common qualitative techniques are� Delphi method� Jury of executive opinion� Sales force composite� Consumer market surveys

Qualitative Models

�� Delphi MethodDelphi Method – an iterative group process where a panel of possibly geographically dispersed experts or respondents respondents provide input to decision decision makers makers through questionnaires and surveysquestionnaires and surveys

�� Jury of Executive OpinionJury of Executive Opinion – collects opinionsopinions of a

5 – 11

�� Jury of Executive OpinionJury of Executive Opinion – collects opinionsopinions of a small group of high-level managers, possibly using statistical models, to estimate the demand

�� Sales Force Composite Sales Force Composite – individual salespersons estimateestimate the sales in their region and the data is combined at a district or national level to reach an overall forecast

�� Consumer Market SurveyConsumer Market Survey – input is solicited from customers or potential customers regarding their future purchasing plansplans

� Time-series models are based on past data� Scatter diagrams are very helpful when

forecasting time series data, because they depict the relationship between variables

Scatter Diagrams and Forecasting

5 – 12

** **

** ** *

Linear relationship Payroll

Sales

Page 4: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Scatter Diagrams and Forecasting

� Wacker Distributors wants to forecast sales for three different products

YEAR TELEVISION SETS RADIOS COMPACT DISC PLAYERS

1 250 300 1102 250 310 100

5 – 13

2 250 310 1003 250 320 1204 250 330 1405 250 340 1706 250 350 1507 250 360 1608 250 370 1909 250 380 200

10 250 390 190

Table 5.1: Annual Sales of Three Products

���� ���� ���� ���� ���� ���� ���� ���� ��������

330 –

250 –

200 –

Ann

ual S

ales

of T

elev

isio

ns

(a)� Sales appear to be

constant over timeSales = 250

� A good estimate of

Scatter Diagrams and Forecasting

5 – 14

Figure 5.2

200 –

150 –

100 –

50 –

| | | | | | | | | |

0 1 2 3 4 5 6 7 8 9 10

Time (Years)

Ann

ual S

ales

of T

elev

isio

ns

� A good estimate of sales in year 11 is 250 televisions

��������

��������

����

� Sales appear to be increasing at a constant rate of 10 radios per year

420 –

400 –

380 –

360 –

Ann

ual S

ales

of R

adio

s

(b)

Scatter Diagrams and Forecasting

5 – 15

��������

��������

��������

����

Sales = 290 + 10(Year)� A reasonable

estimate of sales in year 11 is 400 televisions

340 –

320 –

300 –

280 –

| | | | | | | | | |

0 1 2 3 4 5 6 7 8 9 10

Time (Years)

Ann

ual S

ales

of R

adio

s

Figure 5.2

����

����

����

���� ��������

� This trend line may not be perfectly accurate because of variation from year to year

� Sales appear to be

200 –

180 –

160 –

140 –A

nnua

l Sal

es o

f CD

Pla

yers

(c)

Scatter Diagrams and Forecasting

5 – 16

��������

����

�������� � Sales appear to be

increasing� A forecast would

probably be a larger figure each year

140 –

120 –

100 –

| | | | | | | | | |

0 1 2 3 4 5 6 7 8 9 10

Time (Years)

Ann

ual S

ales

of C

D P

laye

rs

Figure 5.2

Page 5: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Measures of Forecast Accuracy

� We compare forecasted values with actual values to see how well one model works or to compare models

Forecast error = Actual value – Forecast value

5 – 17

� A good forecasting model is one that minimizes the overall errors

� One measure of accuracy is the mean absolutemean absolutedeviationdeviation (MADMAD)

n∑∑∑∑====

errorforecast MAD

Measures of Forecast Accuracy

� Using a naïvenaïve forecasting model

YEAR

ACTUAL SALES OF CD

PLAYERSFORECAST

SALES

ABSOLUTE VALUE OF ERRORS (DEVIATION),

| ACTUAL – FORECAST |

1 110 — —

2 100 110 |100 – 110| = 10

3 120 100 |120 – 100| = 20

5 – 18

3 120 100 |120 – 100| = 20

4 140 120 |140 – 120| = 20

5 170 140 |170 – 140| = 30

6 150 170 |150 – 170| = 20

7 160 150 |160 – 150| = 10

8 190 160 |190 – 160| = 30

9 200 190 |200 – 190| = 10

10 190 200 |190 – 200| = 10

11 — 190 —

Sum of |errors| = 160

MAD = 160/9 = 17.8

Table 5.2

Measures of Forecast Accuracy

� Using a naïvenaïve forecasting model

YEAR

ACTUAL SALES OF CD

PLAYERSFORECAST

SALES

ABSOLUTE VALUE OF ERRORS (DEVIATION), (ACTUAL – FORECAST)

1 110 — —

2 100 110 |100 – 110| = 10

3 120 100 |120 – 110| = 20

5 – 19

3 120 100 |120 – 110| = 20

4 140 120 |140 – 120| = 20

5 170 140 |170 – 140| = 30

6 150 170 |150 – 170| = 20

7 160 150 |160 – 150| = 10

8 190 160 |190 – 160| = 30

9 200 190 |200 – 190| = 10

10 190 200 |190 – 200| = 10

11 — 190 —

Sum of |errors| = 160

MAD = 160/9 = 17.8

Table 5.2

8179

160errorforecast .MAD ============ ∑∑∑∑

n

Measures of Forecast Accuracy

� There are other popular measures of forecast accuracy

� The mean squared errormean squared error

n∑∑∑∑====

2error )(MSE

5 – 20

n

� The mean absolute percent errormean absolute percent error

%MAPE 100actualerror

n

∑∑∑∑====

� And biasbias is the average error: – maybe positive or negative – negative errors can cancel positive errors

nerror

bias∑∑∑∑====

Page 6: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Hospital Days Forecast Error Example

Ms. Smith forecasted total hospital inpatient days last year. Now that the actual data are known, she is

Month Forecast ActualJAN 250 243

FEB 320 315

MAR 275 286

APR 260 256

5 – 21

known, she is reevaluating her forecasting model. Compute the MAD, MSE, and MAPE for her forecast.

APR 260 256

MAY 250 241

JUN 275 298

JUL 300 292

AUG 325 333

SEP 320 326

OCT 350 378

NOV 365 382

DEC 380 396

Hospital Days Forecast Error Example

Forecast Actual |error| error2 |error/actual|

JAN 250 243 7 49 0.03FEB 320 315 5 25 0.02MAR 275 286 11 121 0.04APR 260 256 4 16 0.02

5 – 22

MAY 250 241 9 81 0.04JUN 275 298 23 529 0.08JUL 300 292 8 64 0.03AUG 325 333 8 64 0.02SEP 320 326 6 36 0.02OCT 350 378 28 784 0.07NOV 365 382 17 289 0.04DEC 380 396 16 256 0.04

SUMAVERAGE

142MAD= 11.83

2314MSE=192.3

0.45MAPE=3.75%

Time-Series Forecasting Models

�� A time series is a sequence of evenly A time series is a sequence of evenly spaced events spaced events (weekly, monthly, quarterly, etc.)� Weekly sales of IBM personal computers

5 – 23

� Quarterly earnings report of a company

� Time-series forecasts predict the future based solely on the past values of the variable

� Other variables, no matter how potentially valuable, are ignored

Decomposition of a Time-Series

� Analysis of time series means breaking the past dat a into components and projecting them forward.

� A time series typically has four components1.1. TrendTrend (TT) is the gradual upward or downward

movement of the data over time

5 – 24

movement of the data over time2.2. SeasonalitySeasonality (SS) is a pattern of demand

fluctuations above or below trend line that repeats at regular intervals

3.3. CyclesCycles (CC) are patterns in annual data that occur every several years

4.4. Random variationsRandom variations (RR) are “blips” in the data caused by chance and unusual situations – they follow no discernible pattern

Page 7: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Decomposition of a Time-Series

Trend Component

Actual

Dem

and

for P

rodu

ct o

r S

ervi

ce

Seasonal Peaks

5 – 25

Average Demand over 4 Years

Actual Demand

Line

Time

Dem

and

for P

rodu

ct o

r S

ervi

ce

| | | |

Year Year Year Year1 2 3 4

Figure 5.3

Decomposition of a Time-Series

� There are two general forms of time-series models� The multiplicative model

Demand = T x S x C x R

� The additive model

5 – 26

� The additive model

Demand = T + S + C + R

� Models may be combinations of these two forms� Forecasters often assume the random variations

are averaged out over time� Random errors are often assumed to be

normally distributed with a mean of zero

Moving Averages

� We start forecasting time series by assuming that the trend (T), seasonal (S) and cyclical (C) components do not exist

�� Moving averagesMoving averages can be used when demand is relatively steady over time

5 – 27

is relatively steady over time� The next forecast is the average of the most

recent n data values from the time series � This methods tends to smooth out short-

term irregularities in the data series

nn periods previous in demands of Sum

forecast average Moving ====

Moving Averages

� Mathematically

nYYY

F ntttt

111

++++−−−−−−−−++++

++++++++++++==== ...

5 – 28

where= forecast for time period t + 1= actual value in time period t

n = number of periods to averagetY1++++tF

Page 8: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Wallace Garden Supply Example

� Wallace Garden Supply wants to forecast the monthly demand for its Storage Shed

� They have collected data for the past year (12 months)

5 – 29

� They are using a three-month moving average to forecast the demand ( n = 3)

� They calculated the forecasts to evaluate the accuracy of the model

� The forecast for next January using this technique is 16

Wallace Garden Supply Example

MONTH ACTUAL SHED SALES THREE-MONTH MOVING AVERAGE

January 10

February 12

March 13

April 16

May 19 (12 + 13 + 16)/3 = 13.67

(10 + 12 + 13)/3 = 11.67

5 – 30

Table 5.3

May 19

June 23

July 26

August 30

September 28

October 18

November 16

December 14

January —

(12 + 13 + 16)/3 = 13.67

(13 + 16 + 19)/3 = 16.00

(16 + 19 + 23)/3 = 19.33

(19 + 23 + 26)/3 = 22.67

(23 + 26 + 30)/3 = 26.33

(26 + 30 + 28)/3 = 28.00

(30 + 28 + 18)/3 = 25.33

(28 + 18 + 16)/3 = 20.67

(18 + 16 + 14)/3 = 16.00

Weighted Moving Averages

�� Weighted moving averagesWeighted moving averages use weights to put more emphasis on recent periods – more responsive to recent changes

� Often used when a trend or other pattern is emerging

5 – 31

∑∑∑∑∑∑∑∑====++++ )(

))((

Weights

period in value Actual period inWeight 1

iFt

� Mathematically

n

ntnttt www

YwYwYwF

++++++++++++++++++++++++==== ++++−−−−−−−−

++++ ......

21

11211

wherewi = weight for the ith observation

Wallace Garden Supply Example

� Wallace Garden Supply decides to try a weighted moving average model to forecast demand for its Storage Shed

� Deciding which weights to use requires some experience and a bit of luck – check MAD

5 – 32

� They decide on the following weighting scheme

WEIGHTS APPLIED PERIOD

3 Last month2 Two months ago1 Three months ago

6

3 x Sales last month + 2 x Sales two months ago + 1 X Sales three months ago

Sum of the weights

Page 9: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Wallace Garden Supply Example

MONTH ACTUAL SHED SALESTHREE-MONTH WEIGHTED

MOVING AVERAGE

January 10

February 12

March 13

April 16

May 19[(3 X 13) + (2 X 12) + (1 X 10)]/6 = 12.17

[(3 X 16) + (2 X 13) + (1 X 12)]/6 = 14.33

5 – 33

Table 5.4

May 19

June 23

July 26

August 30

September 28

October 18

November 16

December 14

January —

[(3 X 16) + (2 X 13) + (1 X 12)]/6 = 14.33

[(3 X 19) + (2 X 16) + (1 X 13)]/6 = 17.00

[(3 X 23) + (2 X 19) + (1 X 16)]/6 = 20.50

[(3 X 26) + (2 X 23) + (1 X 19)]/6 = 23.83

[(3 X 30) + (2 X 26) + (1 X 23)]/6 = 27.50

[(3 X 28) + (2 X 30) + (1 X 26)]/6 = 28.33

[(3 X 18) + (2 X 28) + (1 X 30)]/6 = 23.33

[(3 X 16) + (2 X 18) + (1 X 28)]/6 = 18.67

[(3 X 14) + (2 X 16) + (1 X 18)]/6 = 15.33

Wallace Garden Supply Example

5 – 34

Program 5.1A

Wallace Garden Supply Example

5 – 35

Program 5.1B

Weighted Moving Averages

� Both simple (non-weighted) and weighted averages are effective in smoothing out fluctuations in the demand pattern in order to provide stable estimates

� Two problems:

5 – 36

� Two problems:� Increasing the size of n smoothes out

fluctuations better but makes the method less sensitive to real changes in the data

� Moving averages can not pick up trends very well – they will always stay within past levels and will not predict a change to a higher or lower level

Page 10: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Exponential Smoothing

�� Exponential smoothingExponential smoothing is a type of moving average forecasting method that is easy to use and requires little record keeping of data – only the last period’s forecast and actual demand are needed

5 – 37

New forecast = Last period’s forecast+ αααα (Last period’s actual demand – Last period’s forecast)

Where αααα is a weight (or smoothing constantsmoothing constant ) with a value between 0 and 1 inclusive

Exponential Smoothing

� Mathematically

tttttt FYFYFF )1()(1 αααααααααααα −−−−++++====−−−−++++====++++where

Ft+1 = new forecast (for time period t + 1)F = pervious forecast (for time period t)

5 – 38

Ft = pervious forecast (for time period t)αααα = smoothing constant (0 ≤ αααα ≤ 1)Yt = pervious period’s actual demand

� The idea is simple – the new estimate is the old estimate plus some fraction of the error in the las t period

� αααα can be increased to give more weight to recent data or decreased to give more weight to past data

Exponential Smoothing Example

� In January, February’s demand for a certain car model was predicted to be 142

� Actual February demand was 153 autos� Using a smoothing constant of αααα = 0.20, what

is the forecast for March?

5 – 39

New forecast (for March demand) = 142 + 0.2(153 – 142 )= 144.2 or 144 autos

� If actual demand in March was 136 autos, the April forecast would be

New forecast (for April demand) = 144.2 + 0.2(136 – 1 44.2)= 142.6 or 143 autos

Selecting the Smoothing Constant

� Selecting the appropriate value for αααα is key to obtaining a good forecast

� The objective is always to generate an accurate forecast

5 – 40

accurate forecast� The general approach is to develop trial

forecasts with different values of αααα and select the αααα that results in the lowest MAD

Page 11: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Port of Baltimore Example

QUARTER

ACTUAL TONNAGE

UNLOADEDFORECAST

USING αααα =0.10FORECAST

USING αααα =0.50

1 180 175 175

2 168 175.5 = 175.00 + 0.10(180 – 175) 177.5

� Exponential smoothing forecast for two values of αααα

5 – 41

2 168 175.5 = 175.00 + 0.10(180 – 175) 177.5

3 159 174.75 = 175.50 + 0.10(168 – 175.50) 172.75

4 175 173.18 = 174.75 + 0.10(159 – 174.75) 165.88

5 190 173.36 = 173.18 + 0.10(175 – 173.18) 170.44

6 205 175.02 = 173.36 + 0.10(190 – 173.36) 180.22

7 180 178.02 = 175.02 + 0.10(205 – 175.02) 192.61

8 182 178.22 = 178.02 + 0.10(180 – 178.02) 186.30

9 ? 178.60 = 178.22 + 0.10(182 – 178.22) 184.15

Table 5.5: Assume the initial forecast is 175.

Selecting the Best Value of αααα

QUARTER

ACTUAL TONNAGE

UNLOADEDFORECAST

WITH αααα = 0.10

ABSOLUTEDEVIATIONS FOR αααα = 0.10

FORECAST WITH αααα = 0.50

ABSOLUTEDEVIATIONS FOR αααα = 0.50

1 180 175 5….. 175 5….

2 168 175.5 7.5.. 177.5 9.5..

3 159 174.75 15.75 172.75 13.75

4 175 173.18 1.82 165.88 9.12

5 – 42

5 190 173.36 16.64 170.44 19.56

6 205 175.02 29.98 180.22 24.78

7 180 178.02 1.98 192.61 12.61

8 182 178.22 3.78 186.30 4.3..

Sum of absolute deviations 82.45 98.63

MAD =Σ|deviations|

= 10.31 MAD = 12.33n

Table 5.6Best choiceBest choice

Port of Baltimore Example

5 – 43

Program 5.2A

Port of Baltimore Example

5 – 44

Program 5.2B

Page 12: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

PM Computer Example

� PM Computer assembles customized personal computers from generic parts

� The owners purchase generic computer parts in volume at a discount from a variety of sources whenever they see a

5 – 45

variety of sources whenever they see a good deal.

� It is important that they develop a good forecast of demand for their computers so they can purchase component parts efficiently.

PM Computer ExamplePeriod Month Actual Demand1 Jan 372 Feb 403 Mar 414 Apr 375 May 456 June 50

5 – 46

6 June 507 July 438 Aug 479 Sept 56

� Compute a 2-month moving average� Compute a 3-month weighted moving average using

weights of 4,2,1 for the past three months of data� Compute an exponential smoothing forecast using

αααα = 0.7, initial forecast of 40� Using MAD, what forecast is most accurate?

� 2 month moving average� Forecast for period 3 (March):

(37+40)/2 = 38.5

� 3 month weighted moving average (4, 2, 1)

PM Computer Example

5 – 47

� 3 month weighted moving average (4, 2, 1) � Forecast for period 4 (April):

(41××××4+40××××2+37××××1)/(4+2+1) = 40.14

� Exponential Smoothing ( αααα=0.7)� Forecast for period 2 (February):

40+0.7(37−−−−40) = 37.9

PM Computer Example

Actual Demand

2 Month MA

Abs. Dev.

3 Month WMA (4,2,1)

Abs. Dev.

Exp. Sm. (αααα=0.7)

Abs. Dev.

37 40.00 3.00

40 37.9 2.1

41 38.50 2.50 39.37 1.63

37 40.50 3.50 40.14 3.14 40.51 3.51

5 – 48Exponential smoothing resulted in the lowest MAD.Exponential smoothing resulted in the lowest MAD.

MAD

37 40.50 3.50 40.14 3.14 40.51 3.51

45 39.00 6.00 38.57 6.43 38.05 6.59

50 41.00 9.00 42.14 7.86 42.92 7.08

43 47.50 4.50 46.71 3.71 47.87 4.87

47 46.50 0.50 45.29 1.71 44.46 2.54

56 45.00 11.00 46.29 9.71 46.24 9.76

TOTAL 37 32.57 41.45

MAD 5.29 5.43 4.61

Page 13: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Exponential Smoothing with Trend Adjustment

� Like all averaging techniques, simple exponential smoothing does not respond well to trends

� So a more complex model can be used that adjusts for trends

� The basic approach is to develop a simple

5 – 49

� The basic approach is to develop a simple exponential smoothing forecast (unadjusted) then adjust for positive or negative lag in the trend

Forecast including trend ( FITt+1) ⁄⁄⁄⁄ Adjusted forecast

= Simple unadjusted forecast ( Ft+1) +

Trend correction ( Tt+1)

Exponential Smoothing with Trend Adjustment

� The equation for the trend correction uses a new smoothing constant ββββ , in a way similar to the simple exponential model uses αααα

� Tt+1 is computed by

)()1( FFTT −−−−++++−−−−==== ββββββββ

5 – 50

)()1( 11 tttt FFTT −−−−++++−−−−==== ++++++++ ββββββββwhere

Tt+1 = smoothed trend for period t + 1Tt = smoothed trend for preceding periodββββ = trend smooth constant that we select

Ft+1 = simple exponential smoothed forecast for period t + 1

Ft = simple exponential smoothed forecast for pervious period

Selecting a Smoothing Constant

� As with simple exponential smoothing, a high value of ββββ makes the forecast more responsive to recent changes in trend

� A low value of ββββ gives less weight to the recent trend and tends to smooth out the trend present

5 – 51

trend and tends to smooth out the trend present� Values of ββββ are generally selected using a trial-

and-error approach with the MAD used as a measure of comparison

� Simple exponential smoothing is often referred to as firstfirst--order smoothingorder smoothing

� Trend-adjusted smoothing is called secondsecond--orderorder , double smoothingdouble smoothing , or Holt’s methodHolt’s method

Exponential Smoothing with Trend Adjustment Example

� An electronics company is selling portable CD players and needed to forecast the next three periods’ demands using the Adjusted Exponential Smoothing model

� To start the forecast an initial estimate of 50

5 – 52

� To start the forecast an initial estimate of 50 players was used for the first period

� The actual demand for the first three periods are 54, 57 and 44 CD players

� β = 0.7 and α= 0.2� See Table 1

Page 14: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Exponential Smoothing with Trend Adjustment Example

PeriodDemand

Yt

UnadjustedForecast F t Trend T t

AdjustedForecast FIT t

1 54 50 - -

2 57 - - -

5 – 53

2 57 - - -

3 44 - - -

* α value is 0.2** β value is 0.7

Table 1

Step 1

� Create a table and enter the figures for the first period.

� Demand was 54.� Unadjusted Forecast for period 1 is any

5 – 54

� Unadjusted Forecast for period 1 is any reasonable starting figure to start the process, in this case 50 players.

� The initial trend is estimated to be 0.

PeriodDemand

Yt

UnadjustedForecast F t Trend T t

AdjustedForecast FIT t

1 54 50 0 -

Step 1

111

11

1

)()1(

)1()(

++++++++++++

++++++++

++++

++++====−−−−++++−−−−====

−−−−++++====−−−−++++====

ttt

tttt

tttttt

TFFIT

FFTT

FYFYFF

ββββββββαααααααααααα

Equations for calculating the adjusted forecasts:

5 – 55

Calculate FIT t+1 for period 1:

FITt+1 = Ft+1 + Tt+1

FIT1 = 50 + 0 = 50

111 ++++++++++++ ttt

PeriodDemand

Yt

UnadjustedForecast F t Trend T t

AdjustedForecast FIT t

1 54 50 0 50

Step 2

Calculate F t+1 for period 2:

Ft+1 = Ft + α(Yt – Ft) = αYt + (1 – α)Ft

F2 = 50 + 0.2(54 – 50) = 50.8

5 – 56

F2 = 50 + 0.2(54 – 50) = 50.8

PeriodDemand

Yt

UnadjustedForecast F t Trend T t

AdjustedForecast FIT t

1 54 50 0 502 57 50.8 - -

Page 15: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Step 3

The trend adjustment factor for period 2 is calculated as follows:

Tt+1 = (1 – β)Tt + β(Ft+1 – Ft)T = (1 – 0.7)××××0 + 0.7××××(50.8 – 50) = 0.56

5 – 57

T2 = (1 – 0.7)××××0 + 0.7××××(50.8 – 50) = 0.56

PeriodDemand

Yt

UnadjustedForecast F t Trend T t

AdjustedForecast FIT t

1 54 50 0 502 57 50.8 0.56 -

Step 4

Calculate the Adjusted Forecast FIT t:

FITt+1 = Ft+1 + Tt+1

FIT2 = 50.8 + 0.56 = 51.36

5 – 58

FIT2 = 50.8 + 0.56 = 51.36

PeriodDemand

Yt

UnadjustedForecast F t Trend T t

AdjustedForecast FIT t

1 54 50 0 502 57 50.8 0.56 51.36

Complete the Table

Now calculate the Adjusted Forecast forperiod 3.

5 – 59

PeriodDemand

Yt

UnadjustedForecast F t Trend T t

AdjustedForecast FIT t

1 54 50 0 50

2 57 50.8 0.56 51.36

3 44 - - -

Steps 1-4 Completed

F3 = 50.8 + 0.2××××(57−−−−50.8) = 52.04T3 = (1−−−−0.7)××××0.56 + 0.7××××(52.04−−−−50.8) = 1.036FIT3 = F3 + T3 = 53.076

5 – 60

PeriodDemand

Yt

UnadjustedForecast F t Trend T t

AdjustedForecast FIT t

1 54 50 0 50

2 57 50.8 0.56 51.36

3 44 52.04 1.036 53.076

Page 16: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Trend Projection

� Another method for forecasting time series with trend is trend projection

� Trend projection fits a trend line to a series of historical data pointsThe line is projected into the future for

5 – 61

� The line is projected into the future for medium- to long-range forecasts

� Several trend equations can be developed (e.g. exponential or quadratic models)

� The simplest is a linear model developed using regression analysis (Chp. 4) in which the independent variable (X) is the time period

Trend Projection

� The mathematical form is

XbbY 10 ++++====ˆ

where

5 – 62

where= predicted value

b0 = interceptb1 = slope of the lineX = time period (i.e., X = 1, 2, 3, …, n)

Y

� The regression line that minimizes the sum of squared errors (SSE) is used (Fig. 5.4)

Trend Projection

Val

ue o

f Dep

ende

nt V

aria

ble

**

*

*Dist 6

Dist 3

Dist 5

Dist 7

5 – 63

Val

ue o

f Dep

ende

nt V

aria

ble

Time

*

*

*

*

*Dist 2

Dist 4

Dist 1

Dist 3

Figure 5.4

Midwestern Manufacturing Company Example

� Midwestern Manufacturing Company has experienced the following demand for its electrical generators over the period of 2001 – 2007

YEAR ELECTRICAL GENERATORS SOLD

2001 74

5 – 64

2001 742002 792003 802004 902005 1052006 1422007 122

Table 5.7

Page 17: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Midwestern Manufacturing Company Example

����

����

Gen

erat

or D

eman

d

160 –

150 –

140 –

130 –

120 –

110 –

5 – 65

�������� ����

����

����

Gen

erat

or D

eman

d

Year

110 –

100 –

90 –

80 –

70 –

60 –

50 –| | | | | | | | |

2001 2002 2003 2004 2005 2006 2007 2008 2009

Scatter Diagram – Electrical Generators Sold From 20 01 ~ 2007

Midwestern Manufacturing Company Example

5 – 66

Program 5.3A

Notice code instead of

actual years

Midwestern Manufacturing Company Example

r2 says model predicts about 80% of the

5 – 67

Program 5.3B

about 80% of the variability in demand

Significance level for F-test indicates a

definite relationship

Midwestern Manufacturing Company Example

� The forecast equation is

XY 54107156 ..ˆ ++++====

� To project demand for 2008, we use the coding system to define X = 8

5 – 68

system to define X = 8

(sales in 2008) = 56.71 + 10.54(8)= 141.03, or 141 generators

� Likewise for X = 9

(sales in 2009) = 56.71 + 10.54(9)= 151.57, or 152 generators

Page 18: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Midwestern Manufacturing Company Example

����

����

Gen

erat

or D

eman

d

160 –

150 –

140 –

130 –

120 –

����

Trend LineXY 54107156 ..ˆ ++++====

5 – 69

�������� ����

����

����

Gen

erat

or D

eman

d

Year

110 –

100 –

90 –

80 –

70 –

60 –

50 –| | | | | | | | |

2001 2002 2003 2004 2005 2006 2007 2008 2009

Actual Demand Line

Figure 5.5: Electrical Generators and the Computed Trend Line

Midwestern Manufacturing Company Example

5 – 70

Program 5.4A: Excel QM’s Trend Projection Model, In put Dataand Formulas Using Midwestern’s Data

Midwestern Manufacturing Company Example

5 – 71

Program 5.4B: Output from Excel QM Trend Projection Model

Coefficient of Correlation ( r)

Seasonal Variations

� Now we consider forecasting time series with seasonal component

� Recurring variations over time may indicate the need for seasonal adjustments in the trend line

5 – 72

adjustments in the trend line� A seasonal index indicates how a

particular season compares with an average season

� When no trend is present, the seasonal index can be found by dividing the average value for a particular season by the average of all the data

Page 19: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Seasonal Variations

� Eichler Supplies sells telephone answering machines

� Data has been collected for the past two years’ sales of one particular model

5 – 73

years’ sales of one particular model� They want to create a forecast that

includes seasonality

Seasonal Variations

MONTH

SALES DEMAND AVERAGE TWO-YEAR DEMAND

AVERAGE MONTHLY DEMAND

AVERAGE SEASONAL

INDEXYEAR 1 YEAR 2

January 80 100 90 94 0.957

February 85 75 80 94 0.851

March 80 90 85 94 0.904

April 110 90 100 94 1.064

May 115 131 123 94 1.309

5 – 74

May 115 131 123 94 1.309

June 120 110 115 94 1.223

July 100 110 105 94 1.117

August 110 90 100 94 1.064

September 85 95 90 94 0.957

October 75 85 80 94 0.851

November 85 75 80 94 0.851

December 80 80 80 94 0.851

Total average demand = 1,128

Seasonal index =Average two-year demandAverage monthly demandAverage monthly demand = = 94

1,12812 months

Table 5.8

Seasonal Variations

� Suppose the third year’s annual demand is expected to be 1200 units (average 100 units/month)

� We forecast each month’s demand by adjusting the monthly average based on the seasonal indices

Jan. July960.957100 =× 1121.117100 =×

5 – 75

Jan. July960.957100 =×

Feb. Aug.

Mar. Sept.

Apr. Oct.

May Nov.

June Dec.

850.851100 =×

900.904100 =×

1061.064100 =×

1311.309100 =×

1221.223100 =×

1121.117100 =×

1061.064100 =×

960.957100 =×

850.851100 =×

850.851100 =×

850.851100 =×

Seasonal Variations with Trend

� When both trend and seasonal components are present, the forecasting task is more complex

� Changes in time series may be due to a trend, to a seasonal variation or simply

5 – 76

trend, to a seasonal variation or simply random fluctuations

� Seasonal indices should be computed relative to the trend not the overall average

�� Centered moving averageCentered moving average (CMACMA) is an approximation of the trend (see Fig. 5.6) and is used to find the seasonal indices

Page 20: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Turner IndustriesExample

� The following are Turner Industries’ sales figures for the past three years

QUARTER YEAR 1 YEAR 2 YEAR 3 AVERAGE

1 108 116 123 115.67

5 – 77

2 125 134 142 133.67

3 150 159 168 159.00

4 141 152 165 152.67

Average 131.00 140.25 149.50 140.25

Table 5.9

Definite trendSeasonal pattern

Turner IndustriesExample

� Scatter plot of Turner Industries data shows seasonality component

��������

��������

����

���� ����200 –

5 – 78

��������

����

����

����

�������� ����

��������

����

150 –

100 –

50 –

0 –

Sal

es

| | | | | | | | | | | |

1 2 3 4 5 6 7 8 9 10 11 12Time Period

Seasonal Variations with Trend

� There are four steps in computing seasonal indices using CMA method1. Compute the CMA for each observation

(where possible)2. Compute the seasonal ratio =

5 – 79

2. Compute the seasonal ratio = Observation/CMA for that observation

3. Average seasonal ratios to get seasonal indices

4. If seasonal indices do not add to the number of seasons, multiply each index by: (Number of seasons)/(Sum of indices)

Turner IndustriesExample

� To calculate the CMA for quarter 3 of year 1 we compare the actual sales with an average quarter centered on that time period

� We will use a one year CMA – 1.5 quarters before quarter 3 and 1.5 quarters after quarter 3 – that is we take quarters 2, 3, and 4 and one half of

5 – 80

we take quarters 2, 3, and 4 and one half of quarters 1, year 1 and quarter 1, year 2

� For quarter 2 of year 3:

CMA (q3, y1) = = 132.000.5(108) + 125 + 150 + 141 + 0.5(116)

4

CMA (q2, y3) = = 147.8750.5(152) + 123 + 142 + 168 + 0.5(165)

4

Page 21: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Turner IndustriesExample

� We compare the actual sales in Y1Q3 to the CMAto find the seasonal ratio

1.136132150 ============

CMAQSales in Y

atioSeasonal r31

5 – 81

� We see that sales in Y1Q3 are about 13.6% higher than an average quarter at this time

� For Y3Q2, the sales are about 4% lower that an average quarter centered at that time

0.960147.875

142 ============CMA

QSales in YatioSeasonal r

23

Turner IndustriesExample

YEAR QUARTER SALES CMA SEASONAL RATIO1 1 108

2 1253 150 132.000 1.1364 141 134.125 1.051

2 1 116 136.375 0.851

5 – 82

2 1 116 136.375 0.8512 134 138.875 0.9653 159 141.125 1.1274 152 143.000 1.063

3 1 123 145.125 0.8482 142 147.875 0.9603 1684 165

Table 5.10

Turner IndustriesExample

� There are two seasonal ratios for each quarter so these are averaged to get the seasonal index

Index for quarter 1 = I1 = (0.851 + 0.848)/2 = 0.85Index for quarter 2 = I2 = (0.965 + 0.960)/2 = 0.96

5 – 83

Index for quarter 2 = I2 = (0.965 + 0.960)/2 = 0.96Index for quarter 3 = I3 = (1.136 + 1.127)/2 = 1.13Index for quarter 4 = I4 = (1.051 + 1.063)/2 = 1.06

Notice: the sum of the indices should be 4. (0.85+0.96+1.13+1.06 = 4)

If not, an adjustment would be made.

Turner IndustriesExample

� Scatter plot of Turner Industries data and CMA s� CMA plot approximates the trend line

��������

��������

����

���� ����

CMA

200 –

5 – 84

��������

����

����

����

�������� ����

��������

����

Original Sales Figures

150 –

100 –

50 –

0 –

Sal

es

| | | | | | | | | | | |

1 2 3 4 5 6 7 8 9 10 11 12Time Period

Figure 5.6

Page 22: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

The Decomposition Method of Forecasting

�� DecompositionDecomposition (or multiplicative decompositionmultiplicative decomposition ) is the process of isolating 1) the seasonal factors and 2) the linear trend line to develop more accurate forecasts

� There are five steps to decomposition1. Compute CMA s and seasonal indices

5 – 85

1. Compute CMA s and seasonal indices2. Deseasonalize the data by dividing each

number by its seasonal index (deseasonalizeddata approximates the tread line)

3. Find the regression equation of a trend line using the deseasonalized data

4. Forecast for future periods using the trend line5. Multiply the trend line forecast by the

appropriate seasonal index

Turner Industries –Decomposition Method

YEAR QUARTER SALES ($1,000,000s)

SEASONAL INDEX

DESEASONALIZED SALES

($1,000,000s)1 1 108 0.85 127.059

2 125 0.96 130.2083 150 1.13 132.7434 141 1.06 133.019

5 – 86

4 141 1.06 133.0192 1 116 0.85 136.471

2 134 0.96 139.5833 159 1.13 140.7084 152 1.06 143.396

3 1 123 0.85 144.7062 142 0.96 147.9173 168 1.13 148.6734 165 1.06 155.660

Table 5.11

Turner Industries –Decomposition Method

� Using computer software to find a trend line using the deseasonalized data

b0 = 124.78 b1 = 2.34

� Develop a forecast for the first quarter of year four

5 – 87

� Develop a forecast for the first quarter of year four(X = 13) using this trend and multiply the forecastby the appropriate seasonal index ( I1 = 0.85)

Y = 124.78 + 2.34X= 124.78 + 2.34(13)= 155.2 (forecast before adjustment for

seasonality)

Y x I1 = 155.2 x 0.85 = 131.92

Turner Industries Example

5 – 88

Program 5.5A: QM for Windows Input for Turner Indus tries Example

Page 23: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Turner Industries Example

5 – 89

Program 5.5B: QM for Windows Output for Turner Indu stries Example

San Diego Hospital Example

� A San Diego hospital developed a decompositionforecasting model using 66 months of adultinpatient hospital days. They developed thefollowing seasonal indices

MONTH SEASONALITY INDEX MONTH SEASONALITY INDEX

5 – 90

MONTH SEASONALITY INDEX MONTH SEASONALITY INDEX

January 1.0436 July 1.0302

February 0.9669 August 1.0405

March 1.0203 September 0.9653

April 1.0087 October 1.0048

May 0.9935 November 0.9598

June 0.9906 December 0.9805

Table 5.12

San Diego Hospital Example

� Using the data they developed the following equation for the trend line

Y = 8,091 + 21.5Xwhere

Y = forecast of patient days

5 – 91

Y = forecast of patient daysX = time period in months

� Based on this model, the forecast for patient days for the next month (period 67 and January) is

Patient days = 8,091 + (21.5)(67) = 9,532 (trend on ly)

Patient days = (9,532)(1.0436) = 9,948 (trend and seasonal)

Regression with Trend and Seasonal Components

�� MultipleMultiple regressionregression (or additiveadditive decompositiondecompositionmodelmodel ) can be used to forecast both trend andseasonal components in a time series� One independent variable is time period� Dummy independent variables are used to represent t he

seasons – for 4 seasons 3 dummy variables are used

5 – 92

seasons – for 4 seasons 3 dummy variables are used

where X1 = time periodX2 = 1 if quarter 2, 0 otherwiseX3 = 1 if quarter 3, 0 otherwiseX4 = 1 if quarter 4, 0 otherwise

If X2=X3=X4=0, then the quarter would be quarter 1Which Xi is used for which season is chosen arbitrarily

44332211 XbXbXbXbaY ++++++++++++++++====ˆ

Page 24: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Regression with Trend and Seasonal Components

5 – 93

Program 5.6A

Regression with Trend and Seasonal Components

5 – 94

Program 5.6B (partial)

Regression with Trend and Seasonal Components

� The resulting regression equation is

4321 130738715321104 XXXXY .....ˆ ++++++++++++++++====

� Using the model to forecast sales for the first and second quarter of next year

5 – 95

second quarter of next year

� These are different from the results obtained using the multiplicative decomposition method

� Use MAD and MSE to determine the best model

13401300738071513321104 ====++++++++++++++++==== )(.)(.)(.)(..Y

15201300738171514321104 ====++++++++++++++++==== )(.)(.)(.)(..Y

Monitoring and Controlling Forecasts

�� Tracking signalsTracking signals can be used to monitor the performance of a forecast

� Tracking signals are computed as the running sum of the forecast errors divided by the mean absolute deviation

5 – 96

by the mean absolute deviation

MADerror) (forecast

MADRSFE

signal Tracking∑∑∑∑========

n∑∑∑∑====

errorforecast MAD

where

Page 25: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Monitoring and Controlling Forecasts

Acceptable

Signal Tripped

Upper Control Limit

0 s

+Tracking Signal

5 – 97

Acceptable Range

Lower Control Limit

0 MADs

Time

Figure 5.7

Monitoring and Controlling Forecasts

� Positive tracking signals indicate demand is greater than forecast

� Negative tracking signals indicate demand is less than forecast

� Some variation is expected, but a good forecast

5 – 98

� Some variation is expected, but a good forecast will have about as much positive error as negative error

� Problems are indicated when the signal trips either the upper or lower predetermined limits

� This indicates there has been an unacceptable amount of variation

� Limits should be reasonable and may vary from item to item (one suggested limits = ±±±±4 MADs)

Kimball’s Bakery Example

� Tracking signal for quarterly sales of croissants

TIME PERIOD

FORECAST DEMAND

ACTUAL DEMAND

FORECAST ERROR RSFE

|FORECAST || ERROR |

|CUMULATIVE| | ERROR | MAD

TRACKING SIGNAL

1 100 90 –10 –10 10 10 10.0 –1

2 100 95 –5 –15 5 15 7.5 –2

3 100 115 +15 0 15 30 10.0 0

5 – 99

3 100 115 +15 0 15 30 10.0 0

4 110 100 –10 –10 10 40 10.0 –1

5 110 125 +15 +5 15 55 11.0 +0.5

6 110 140 +30 +35 30 85 14.2 +2.5

2146

85errorforecast .MAD ============ ∑∑∑∑

n

sMAD..MAD

RSFE52

21435

signal Tracking ============

For period 6:

Adaptive Smoothing

�� Adaptive smoothingAdaptive smoothing is the computer monitoring of tracking signals and self-adjustment if a limit is tripped

� In exponential smoothing, the values of ααααand ββββ are adjusted when the computer

5 – 100

and ββββ are adjusted when the computer detects an excessive amount of variation

Page 26: RSH 10 Ch 05 - Brooklyn Collegedzhu/busn3430/Chapter05.pdfCausal Models Causal models use variables or factors that might influence the quantity being forecasted (may also include

Using The Computer to Forecast

� Spreadsheets ( Excel and Excel QM ) can be used by small and medium-sized forecasting problems

� More advanced programs ( SAS, SPSS, Minitab ) handle time -series and causal

5 – 101

Minitab ) handle time -series and causal models

� May automatically select best model parameters

� Dedicated forecasting packages may be fully automatic

� May be integrated with inventory planning and control

Homework Assignment

http://www.sci.brooklyn.cuny.edu/~dzhu/busn3430/

5 – 102