35
Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process Aerospace Technology Congress 11-12 October 2016, Solna, Stockholm Authors: Fabiana Cristina C. Gonçalves Teixeira Luís Gonzaga Trabasso

Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data EvaluationMethod Applied to Integrated ProductDevelopment Process

Aerospace Technology Congress11-12 October 2016, Solna, Stockholm

Authors:

Fabiana Cristina C. Gonçalves Teixeira

Luís Gonzaga Trabasso

Page 2: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 2 / 35 Agenda

Motivation;

Purpose;

Background – Context;

Method – Application;

Results Analysis;

Conclusion.

Page 3: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 3 / 35

o Preventive maintenance is placed as a regulation to assure airworthiness

condition (FAA, 1998);

o Initial Maintenance Review Board Report (MRBR) uses in service operation

experience as a reference to define maintenance tasks intervals;

o Regulatory authorities became more restricted while evaluating preventive

tasks interval changes to fleet in operation.

Motivation

Page 4: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 4 / 35

o Present a method to evaluate the schedule maintenance tasks

accomplishment database;

o Propose reviewed maintenance tasks intervals to systems similar to

aircrafts under development;

o Achieve Direct Maintenance Cost reduction; Influence Integrated

Product Development process.

Purpose

Page 5: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 5 / 35 Agenda

Introduction - Motivation;

Purpose;

Background – Context;

Method;

Method – Application;

Results Analysis;

Conclusion.

Page 6: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 6 / 35

Beginning: Aeronautic bulletin 7E dated on May 15th 1930.

Reason: Maintain the inherent safety and reliability levels of the aircraft and itscomponents.

Historic:

• 1936 - ATA was created by American Airlines in order to stablish standard rules;

• 1968 - Maintenance Steering Group 1 (MSG-1) applied to B-747;

• 1970s - Maintenance Steering Group 2 (MSG-2);

• 1980 - Maintenance Steering Group 3 (MSG-3);

References: FAA, 1997; Airworthy, 1930.

Background – Maintenance Review Board Report (MRBR)

Page 7: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 7 / 35

MSG-3: - Analytical methodology

- ATA property;

- Reviewed by Maintenance Programs Industry Group – MPIG and approvedthrough International MRB Policy Board - IMRBPB (EASA, 2010).

MRBPB (International Maintenance Review Board Policy Board):

- Policies development, procedures and guidelines to operators part of MRBprocess.

- Subjects related to MRB process through documents called Issue Papers(IP) (EASA, 2016).

Background – MRBR

Page 8: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 8 / 35

o IP-44 – allows commercial aviation manufacturers to

evaluate maintenance tasks intervals before EIS (Entry-Into-

Service) in accordance to the authorities’ viewpoint;

o Suggests statistical models use to evaluate tasks intervals.

Background – Issue Paper 44

Page 9: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 9 / 35Background – Integrated Product Development

NeedsConceptual

designProduct

evaluation

Manufactu-ring

Operations/ use

...

Requirements

Requirements

Maintenance Requirements

Page 10: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 10 / 35 Agenda

Introduction - Motivation;

Purpose;

Background – Context;

Method;

Method – Application;

Results Analysis;

Conclusion.

Page 11: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 11 / 35 Proposed Method

Select aircraftsystem

Selecttask

Collect taskaccomplishment

field data

Apply procedureto optimize task

interval from fleetin operation

Propose taskinterval to newaircraft underdevelopment

Page 12: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 12 / 35 Method – Procedure to optimize intervals

The method consists in:

• Select aircraft system and task;

• Compare system under development and in operation anddecide if it is feasible to use field data to apply procedure tooptimize task interval from fleet in operation;

• When applicable, use operational performance experience(based on preventive maintenance tasks accomplishment) to

define new maintenance tasks before fleet entry into service.

Page 13: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 13 / 35 Agenda

Introduction - Motivation;

Purpose;

Background – Context;

Method;

Method – Application;

Results Analysis;

Conclusion

Page 14: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 14 / 35

Selected System: pilot and co-pilot seats;

Task: detailed inspection;

Purpose: check for degradation, damageand wear;

Justification: mandatory tasks in allcommercial aircrafts

Method - Application

Select aircraftsystem

Select task

Page 15: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 15 / 35

Select System: pilot and co-pilot seats.

Analysis cconsiderations:

System operation type: regular. It is not expectedrelevant difference on the system in operation and underdevelopment in the same manufacturer.

Operation system maturity: mature, it is expectedregular performance.

Field data availability/ minimal sample available; Thereare more than 780 aircraft in operation with the samesystem and fleet leader has flown more than 20,000 flighthours.

Data collection feasibility. Field database containing taskaccomplishment available to manufacturer.

Method - Application

Select aircraftsystem

Select task

Page 16: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 16 / 35

Select Task:

<Detailed Inspection>;

Essential system to commercial fleet selected and withfield data available

Tarefa MRBR: 25-11-01-002

The task type selected is <Detailed Inspection> becausecollected data analysis is more objective and does notdemand complex analysts’ evaluation.

Method - Application

SelectSystem

Selecttask

Page 17: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 17 / 35

Collect field data related to maintenance task

accomplishment in order to optimize intervals:

o Aircraft serial number;

o Cumulative Flight Hours and Cycles;

o Aircraft delivery date;

o MRBR task number;

o Task accomplishment result.

Método Proposto - Aplicação

Collect taskaccomplishment

field data

Apply procedureto optimize task

interval from fleetin operation

Page 18: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 18 / 35 Method – Procedure to optimize intervals

o Collect interval recommendations from different sources;

o Classify information according to its degree of confidence:

Group 1: low confidence level;

Group 2: intermediate confidence level;

Group 3: high confidence level.

Page 19: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 19 / 35

Information Source Value Information Group

Recommended MTBF (Mean Time Between Failure) through theoretical data Group 1

Equivalent system’s (in operation in different fleets) CMM (not considering the

manufacturer)Group 1

Recommended MTBF by supplier for similar system Group 2

Field MTBUR (Mean Time Between Unscheduled Removal) for similar system Group 2

Supplier Recommendation for his own system Group 2

MTBF based on supplier tests for components under development Group 3

MTBUR of components of identical system in operation Group 3

Task interval of identical/ similar system stated in the MRBR or optimized

according to intervals optimization procedure.Group 3

Task Interval recommendation made by the Development Engineering Group 3

Task Intervals between tasks executions used in order to certify the system with

regulatory authoritiesGroup 3

Method– Procedure to define new intervals (necessaryresource)

Page 20: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 20 / 35 Method – Procedure to define new intervals

Start

Collect field dataavailable to systemunder evaluation.

Complete table withrecommended intervals.

Is task intervalpart of systemcertification

process?

Developmentengineer

requirementapproach not

applicable

Discard from tableintervals higher

than establishedby certification

process

A

Yes

No

Page 21: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 21 / 35

A

Is MSG-3 taskcategory 6, 7 or

9?

Accomplisheconomic

analysis

Is task applicableand effectiveaccording to

economicanalysis?

Maintenanceopportunityevaluation

Prepare taskcreation proposal

to present atWorking Group

End

No

Yes

Yes

No

Method – Procedure to define new intervals

Evident Safety (Category 5).Evident Operational (Category 6).Evident Economic (Category 7).Hidden Safety (Category 8).Hidden Non‐Safety (Category 9).

Failure Effect

Page 22: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 22 / 35

o Aircraft panels and access to be removed before task accomplishment;

o Task needs to be performed in line, overnight or only in heavy checks;

o Estimated labor hour to accomplish task. Consider if it is required

interior, engine, APU removal etc.;

o Verify multiple tasks intervals values and if it is possible to include task

in main packages.

Method – Economic Analysis

Page 23: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 23 / 35 Method - Application

Minimal sample to finite populationCollect task

accomplishmentfield data

Apply procedureto optimize task

interval from fleetin operation

where:

n= minimum sample size expected for finite population;

∝/�� critical value of the desired confidence level;

p=expected proportion of favorable results in the population;

q = (1-p) = (expected) proportion of unfavorable results in the population;

e = accepted error;

N = finite population size.

Page 24: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 24 / 35

Collect taskaccomplishment

field data

Apply procedureto optimize task

interval from fleetin operation

equivalent to confidence level of 95%);

p= 90%

q= 10%

e= 4% (for task category 8)

N=2487 (total expected task accomplishmentconsidering fleet operational data from beginning ofoperation until evaluation date).

Minimal sample to finite population

Method - Application

Page 25: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 25 / 35

Collect taskaccomplishment

field data

Apply procedureto optimize task

interval fromfleet in operation

Method - Application

MRBR Task 25-11-01-002

Page 26: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 26 / 35

Collect taskaccomplishment

field data

Apply procedureto optimize task

interval fromfleet in operation

Method - Application

Page 27: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 27 / 35

Statistical assumptions:o Normal distribution, n >=30.o Confidence interval = 95%.o Reliability adopted: 85%.o Action tool, a MS Excel™

supplement, was used.o The indicated value for the task, is

approximately 20,000 flight-hours

Collect taskaccomplishment

field data

Apply procedureto optimize task

interval fromfleet in operation

Method - Application

Page 28: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 28 / 35

Define proposalto define taskinterval to newaircraft underdevelopment

Information Source Value (FH) Information Group

Recommended MTBF (Mean Time Between Failure) through theoretical

dataGroup 1

Equivalent system’s (in operation in different fleets) CMM (not

considering the manufacturer)4,000 Group 1

Recommended MTBF by supplier for similar system Group 2

Field MTBUR (Mean Time Between Unscheduled Removal) for similar

systemGroup 2

Supplier Recommendation for his own system 5,000 Group 2

MTBF based on supplier tests for components under development Group 3

MTBUR of components of identical system in operation Group 3

Task interval of identical/ similar system stated in the MRBR or

optimized according to intervals optimization procedure.20,000 Group 3

Task Interval recommendation made by the Development Engineering Group 3

Task Intervals between tasks executions used in order to certify the

system with regulatory authoritiesGroup 3

Note: MTBF and MTBURrecommendations were notconsidered in this analysisbecause it is not expected pilotand co-pilot seat removals incommercial fleet in operation.

Method - Application

Page 29: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 29 / 35

Maintenancepackages:3,000 FlightHours ormultiple

Interval to beproposed toWorkingGroup:12,000 hours

Define proposalto define taskinterval to newaircraft underdevelopment

Method - Application

Page 30: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 30 / 35 Agenda

Introduction - Motivation;

Purpose;

Background – Contexto;

Method;

Method – Application;

Results Analysis;

Conclusion.

Page 31: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 31 / 35 Results Analysis

o Entry Into Service – field data statistical analysis;

o MSG-3 systems – similar systems established;

o Proposed Method x Industry practice;

o Out-of-phase tasks.

Page 32: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 32 / 35 Agenda

Introduction - Motivation;

Purpose;

Background – Contexto;

Method;

Method – Application;

Results Analysis;

Conclusion.

Page 33: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 33 / 35 Conclusions

• Procedures application: feasible and valid;

• Purpose reached: maintenance accomplishment

database structured, tasks intervals adequate

(DMC reduction), relevant information to IPD

process;

Page 34: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data Evaluation Method Applied to Integrated Product Development Process

no 34 / 35 Conclusion – cont.

o It was feasible to propose a task interval 100% higher

than the reference;

o Fleet entry-into-service with more accurate MRBR,

which means cost reduction to operator;

o Unscheduled interventions quantity reduction in the

beginning of fleet operation.

Page 35: Aircraft Maintenance Data Evaluation Method Applied to …ftfsweden.se/wp-content/uploads/2016/11/FT2016_M01_Teixe... · 2016-11-08 · Aircraft Maintenance Data Evaluation Method

Aircraft Maintenance Data EvaluationMethod Applied to Integrated ProductDevelopment Process

Aerospace Technology Congress11-12 October 2016, Solna, Stockholm

Authors:

Fabiana Cristina C. Gonçalves Teixeira: [email protected]

Luís Gonzaga Trabasso: [email protected]