Transcript
Page 1: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

1

www.cranfield.ac.uk

Harmonised MRO Work Task Definition for Automated Bid Generation

Yandy MA, Nakib Salman HOWLADER,

Yicong LIU, Domen SINKOVEC

Ip-Shing FAN, Jim ANGUS

5th September, 2017

Page 2: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

2

1. Introduction

2. Aims & Objectives

3. Current Situation

4. Methodology

5. Ontology

6. Dictionary

7. Coding

8. Testing

9. Conclusion and Future Work

Content

Page 3: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

3

© Cranfield University3

Introduction – MRO

AirlinesManufacturer

Manufacture

Design

MRO service providers

Passengers Jet

Cargo Business Jet

Maintenance, Repair and Overhaul (MRO)

Bidding Process

Line Maintenance

Base Maintenance

Page 4: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

4

© Cranfield University4

Introduction – Typical MRO Bid Response Process

Difficulties – External

• Different customer document formats

• Different task numbering systems

• Spelling mistakes in customer documents

• Differences in abbreviations

Difficulties – Internal

• Manually matching process is time consuming – potentially 4-6 weeks

• Even expert users of VLookup and HLookupin Excel struggle when text is not exact

Receive Customer Bid

Match maintenance

task manually

Compile Bid Package Task List

Takes around 4 - 6 weeks

Page 5: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

5

© Cranfield University5

Aim & Objectives

Aim

• Improve efficiency and reliability of bid generation by automated matching of maintenance task descriptions between airline information packages and MRO in-house data systems

Objectives

• Develop an MRO terminology dictionary

• Develop text matching logic appropriate for bid information matching

Scope

• Build a prototype of mapping tool based on A300-600 documents

Page 6: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

6

© Cranfield University6

Current Situation – MPD

Page 7: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

7

© Cranfield University7

Current Situation – Customer’s Request List – Example 1

Page 8: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

8

© Cranfield University8

Current Situation – Customer’s Request List – Example 2

Page 9: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

9

© Cranfield University9

Current Situation – Different Descriptions for the Same Task

MPD Task Number Task Description

281200-02-1

TANK VENTING SYSTEM

GENERAL VISUAL INSPECTION OF TRIM TANK NACA INTAKE FOR OBSTRUCTION

Clients Reference Task Description60C0307 WING & TRIM TANK VENTING SYSTEM - VISUAL CHECK

Task in MPD

Task in Customer Bid Request List

Page 10: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

10

© Cranfield University10

Research Project Methodology

Literature Review

Background Understanding Design Ontology and

Dictionary Building Coding Testing Deliver

Ontology

Words Similarity

Text Similarity

Current Situation

Difficulties of Bidding Process

Design Mapping

Tool’s Algorithms

Build Ontology

Build Dictionary

Code Mapping

Tool

Test Mapping

Tool

Ontology

Dictionary

Mapping Tool

Prototype

Bid Info Process

Page 11: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

11

© Cranfield University11

Bid Info Process

Page 12: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

12

© Cranfield University12

Matching algorithms

Word-to-Word Similarity

• 𝒔𝒊𝒎 𝒂, 𝒃 = 𝟏 − 𝒍𝒐𝒈𝟐 𝟏 +∅ 𝒂 ∖∅ 𝒃 |∅ 𝒃 ∖∅ 𝒂 |

∅ 𝒂 ∖∅ 𝒃 ∅ 𝒃 ∖∅ 𝒂 ∅ 𝒂 ∩∅ 𝒃

• Ontology and Dictionary based approach

Word Inverse Frequency

• 𝒊𝒕𝒇(𝒘) =𝑵

𝒏𝒘

• Higher frequency, lower weighting.

Text Similarity

•𝑺𝒊𝒎 𝑻𝟏, 𝑻𝟐 =𝟏

𝟐(∑ 𝐦𝐚𝐱𝐒𝐢𝐦 𝐰,𝑻𝟐 ×𝒊𝒕𝒇 𝒘𝒘∈ 𝑻𝟏

∑ 𝒊𝒕𝒇 𝒘𝒘∈ 𝑻𝟏

+∑ 𝐦𝐚𝐱𝐒𝐢𝐦 𝐰,𝑻𝟏 ×𝒊𝒕𝒇 𝒘𝒘∈ 𝑻𝟐

∑ 𝒊𝒕𝒇 𝒘𝒘∈ 𝑻𝟐

)

• Based on word similarity and word inverse frequency

MPD Task Number

Task Description

575155-01-1 RIGHT HAND WING FLAP TRACK NO. 2 GEARBOX AREA EWIS – GENERAL VISUAL INSPECTION

Clients Reference Task Description

60C0307 R/H ving flap track No. two gearbox area electric wiring system–general visual check

Words Unification Functions:

• Spelling Correction

• Numeral Standardisation

• Capitalisation

• Synonyms and Abbreviations Identification

Page 13: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

13

© Cranfield University13

Ontology – Relationships

Source: www.monarchaircraftengineering.com/

Page 14: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

14

© Cranfield University14

Ontology – Class Hierarchy

• Manually established with Protégé

• Built with Aerospace knowledge

• Presented concept of MRO

• Systemise maintenance tasks

sample MPD – 20 tasks

• Takes 1 day to build ontology

whole MPD >2,300 tasks

Page 15: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

15

© Cranfield University15

Page 16: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

16

© Cranfield University16

Dictionary

Word: Check

Meaning: an examination to make certain that something

is as it should be

Other PoS:

Checks, checked, checking

Abbreviation:

CHK

Synonyms: examine, inspect

• MRO specified dictionary

• Include comprehensive information of each aerospace/MRO related words

Sample MPD: 20 tasks

• Takes 1 day to build

Whole MPD: >2,300 tasks

Page 17: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

17

© Cranfield University17

Introduction of Mapping Tool

• Python Programming Language

• Algorithm divided into 4 main stages:

DataExtraction

Modifying Customer

Data

Fuzzy Match

Generationof Output

File

MAPPING TOOL

MPD & Customer Excel (Formatted)

Unmodified Customer Data

MPD and Modified Customer Data

Matched MPD Task Numbers

Customer Excel File Matched with MPD

Page 18: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

18

© Cranfield University18

Mapping Tool –5 steps

FORMATTING EXCEL FILES

SAVING RUNNING MAPPING

TOOLWAITING

READING GENERATED

FILE

Page 19: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

19

© Cranfield University19

Testing – Testing Cases

White Box Testing

• Testing by developer - debug

Black Box Testing

• Testing by user

Combined Scenarios

Spelling Correction

Character Capitalization

Numerals Transformation

Task Number Matching

Task Description Matching

Testing Scenarios

(27)

Page 20: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

20

© Cranfield University20

Testing

Verification & Validation

• Compare manual matched results and the mapping tool’s results

KPIs

• Percentage of matching accuracy

• Lead time of matching process

Results

• Average lead time to match 10 tasks: 1 mins

• Single result – all results matched correctly

• Multiple results – all included the correct results

• Interesting finding – some tasks should get no result,

but the mapping tool gives multiple results.

Page 21: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

21

© Cranfield University21

Conclusion

Completed Pilot

• Bid Information Process

• MRO Ontology

• MRO Dictionary

• Mapping Tool Prototype

Towards implementation

• Complete Ontology and Dictionary

• Industrialise software code

• Integration with existing systems

Page 22: +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG … · &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq &rpsduh pdqxdo pdwfkhg uhvxowv dqg wkh pdsslqj wrro¶v uhvxowv.3,v 3hufhqwdjh

15/09/2017

22

© Cranfield University22

www.cranfield.ac.uk

T: +44 (0)1234 750111


Recommended