21
Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems [email protected] ADVANCING THE HUMAN FACTORS BUSINESS CASE: Maintenance Human Factors 14 th Symposium on Aviation Psychology Dayton, OH, April 25, 2007

Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems [email protected]

Embed Size (px)

Citation preview

Page 1: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

Federal AviationAdministration

William B. Johnson, Ph.D.

Chief Scientific and Technical Advisor

Human Factors in A/C Maintenance Systems

[email protected]

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors

14th Symposium on Aviation PsychologyDayton, OH,April 25, 2007

Page 2: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

2

Human Factors #1 Causal Factor

Human Factors

Maintenance

Page 3: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

3

Presentation Topics

Operator‘s Manual for HF in Aviation Maintenance (4)

ROI Discussion and Examples (12)

Discussion as Time Permits

Page 4: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

4

www.hf.faa.gov/opsmanual

Page 5: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

5

Page 6: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

6

Sample display from Op’s manual

Page 7: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

7

3 key references plus slides

Page 8: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

8

Presentation Topics

Operator‘s Manual for HF in Aviation Maintenance (4)

ROI Discussion and Examples (12)

Discussion as Time Permits

Page 9: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

9

Page 10: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

10

The Reality of Sustainment and Justification

• Continental Airlines had a HF program and does not now!

• US Airways had a HF program and does not now!

• Northwest had a HF program and does not now!

• Some airlines had an HF person , not now…….

WHY?

Page 11: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

11

• Assigning cost to a particular challenge/event

• Establishing cost of intervention

• Matching HF intervention to performance change

• Assigning value to what did not happen

• Add your reasons here……

ROI Challenges - What is it difficult?

Page 12: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

12

Here are Example ROI Approaches*

• Cost vs. Lost Product Production

• Costs of R&D and Returns – FAA Style

• Justification from Improved Work Performance

• “Trust Me”: A NonAnalytic Approach

* Described in paper

Page 13: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

13

Five steps to calculate ROI RATIO

1. Estimate annual cost of a specific event: COST

2. Estimate cost to address the contributing factors: COST TO FIX

3. Estimate the probability the COST TO FIX will be successful:

PROBABILITY OF SUCCESS

4. Multiply COST times PROBABILITY OF SUCCESS and then subtract

COST TO FIX: RETURN

5. Divide RETURN by COST TO FIX: ROI RATIO

Page 14: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

14

Example : Ground damage during towing

• 16 significant towing incidents at one hangar during 1999. (Average Year)

• Cost is $260K/year

• The organization conducted focus groups and event analysis to understand the contributing factors.

Page 15: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

15

Ground damage during towing: Prevention Measures

• Paint Centerlines, Clear zones, tail zones, etc.

• Standardize lights on hangar doors

• Modify work platforms

• Train personnel

• Audit performance and deliver feedback

• Total Cost to Fix: $52K

Page 16: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

16

ROI on Fixes for ground damage

1. COST $260K

2. COST TO FIX $52K

3. PROBABILITY OF SUCCESS 75% (.75)

4. RETURN ((.75x$260K)-$52) = $143K

5. RETURN ON INVESTMENT RATIO

($143K/$52K) = 2.75

Page 17: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

17

The Conference paper has 3 examples

• Ground Damage During Towing ROI = 2.75

• Damage in the Paint Hangar ROI = 5.5

• Technical Documentation ROI = .52

Page 18: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

18

Observations about ROI

• ROI calculation is not high enough priority.

• Organizations often don’t count the cost of error.

• Organizations don’t count error costs very well.

• Workers are not sensitive enough to the cost of error.

Page 19: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

19

Observations about ROI (Con’t.)

• When something breaks you fix it and don’t calculate it.

• When something is not safe you fix it and don’t

calculate it.

• When work conditions are not safe you fix it and don’t

calculate.

• You just don’t calculate it!

Page 20: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

20

Observations (Con’t.)

• Most interventions are seemingly intuitive and cost

justifiable.

• But the times are changing…

• ROI for HF interventions is in infancy.

• It does not have to be complicated to make the case!

• Numerous small justifications make a big point!

Page 21: Federal Aviation Administration William B. Johnson, Ph.D. Chief Scientific and Technical Advisor Human Factors in A/C Maintenance Systems bill.johnson-dr@faa.gov

ADVANCING THE HUMAN FACTORS BUSINESS CASE:Maintenance Human Factors14th Symposium on Aviation PsychologyDayton, April 25, 2007

Federal AviationAdministration

21

Presentation Topics - Summary

Operator‘s Manual for HF in Aviation Maintenance (4)

ROI Discussion and Examples (12)

Discussion as Time Permits

Thank you

For these slides and more: www.hfskyway.com