15/09/2017
1
www.cranfield.ac.uk
Harmonised MRO Work Task Definition for Automated Bid Generation
Yandy MA, Nakib Salman HOWLADER,
Yicong LIU, Domen SINKOVEC
Ip-Shing FAN, Jim ANGUS
5th September, 2017
15/09/2017
2
1. Introduction
2. Aims & Objectives
3. Current Situation
4. Methodology
5. Ontology
6. Dictionary
7. Coding
8. Testing
9. Conclusion and Future Work
Content
15/09/2017
3
© Cranfield University3
Introduction – MRO
AirlinesManufacturer
Manufacture
Design
MRO service providers
Passengers Jet
Cargo Business Jet
Maintenance, Repair and Overhaul (MRO)
Bidding Process
Line Maintenance
Base Maintenance
15/09/2017
4
© Cranfield University4
Introduction – Typical MRO Bid Response Process
Difficulties – External
• Different customer document formats
• Different task numbering systems
• Spelling mistakes in customer documents
• Differences in abbreviations
Difficulties – Internal
• Manually matching process is time consuming – potentially 4-6 weeks
• Even expert users of VLookup and HLookupin Excel struggle when text is not exact
Receive Customer Bid
Match maintenance
task manually
Compile Bid Package Task List
Takes around 4 - 6 weeks
15/09/2017
5
© Cranfield University5
Aim & Objectives
Aim
• Improve efficiency and reliability of bid generation by automated matching of maintenance task descriptions between airline information packages and MRO in-house data systems
Objectives
• Develop an MRO terminology dictionary
• Develop text matching logic appropriate for bid information matching
Scope
• Build a prototype of mapping tool based on A300-600 documents
15/09/2017
6
© Cranfield University6
Current Situation – MPD
15/09/2017
7
© Cranfield University7
Current Situation – Customer’s Request List – Example 1
15/09/2017
8
© Cranfield University8
Current Situation – Customer’s Request List – Example 2
15/09/2017
9
© Cranfield University9
Current Situation – Different Descriptions for the Same Task
MPD Task Number Task Description
281200-02-1
TANK VENTING SYSTEM
GENERAL VISUAL INSPECTION OF TRIM TANK NACA INTAKE FOR OBSTRUCTION
Clients Reference Task Description60C0307 WING & TRIM TANK VENTING SYSTEM - VISUAL CHECK
Task in MPD
Task in Customer Bid Request List
15/09/2017
10
© Cranfield University10
Research Project Methodology
Literature Review
Background Understanding Design Ontology and
Dictionary Building Coding Testing Deliver
Ontology
Words Similarity
Text Similarity
Current Situation
Difficulties of Bidding Process
Design Mapping
Tool’s Algorithms
Build Ontology
Build Dictionary
Code Mapping
Tool
Test Mapping
Tool
Ontology
Dictionary
Mapping Tool
Prototype
Bid Info Process
15/09/2017
11
© Cranfield University11
Bid Info Process
15/09/2017
12
© Cranfield University12
Matching algorithms
Word-to-Word Similarity
• 𝒔𝒊𝒎 𝒂, 𝒃 = 𝟏 − 𝒍𝒐𝒈𝟐 𝟏 +∅ 𝒂 ∖∅ 𝒃 |∅ 𝒃 ∖∅ 𝒂 |
∅ 𝒂 ∖∅ 𝒃 ∅ 𝒃 ∖∅ 𝒂 ∅ 𝒂 ∩∅ 𝒃
• Ontology and Dictionary based approach
Word Inverse Frequency
• 𝒊𝒕𝒇(𝒘) =𝑵
𝒏𝒘
• Higher frequency, lower weighting.
Text Similarity
•𝑺𝒊𝒎 𝑻𝟏, 𝑻𝟐 =𝟏
𝟐(∑ 𝐦𝐚𝐱𝐒𝐢𝐦 𝐰,𝑻𝟐 ×𝒊𝒕𝒇 𝒘𝒘∈ 𝑻𝟏
∑ 𝒊𝒕𝒇 𝒘𝒘∈ 𝑻𝟏
+∑ 𝐦𝐚𝐱𝐒𝐢𝐦 𝐰,𝑻𝟏 ×𝒊𝒕𝒇 𝒘𝒘∈ 𝑻𝟐
∑ 𝒊𝒕𝒇 𝒘𝒘∈ 𝑻𝟐
)
• Based on word similarity and word inverse frequency
MPD Task Number
Task Description
575155-01-1 RIGHT HAND WING FLAP TRACK NO. 2 GEARBOX AREA EWIS – GENERAL VISUAL INSPECTION
Clients Reference Task Description
60C0307 R/H ving flap track No. two gearbox area electric wiring system–general visual check
Words Unification Functions:
• Spelling Correction
• Numeral Standardisation
• Capitalisation
• Synonyms and Abbreviations Identification
15/09/2017
13
© Cranfield University13
Ontology – Relationships
Source: www.monarchaircraftengineering.com/
15/09/2017
14
© Cranfield University14
Ontology – Class Hierarchy
• Manually established with Protégé
• Built with Aerospace knowledge
• Presented concept of MRO
• Systemise maintenance tasks
sample MPD – 20 tasks
• Takes 1 day to build ontology
whole MPD >2,300 tasks
15/09/2017
15
© Cranfield University15
15/09/2017
16
© Cranfield University16
Dictionary
Word: Check
Meaning: an examination to make certain that something
is as it should be
Other PoS:
Checks, checked, checking
Abbreviation:
CHK
Synonyms: examine, inspect
• MRO specified dictionary
• Include comprehensive information of each aerospace/MRO related words
Sample MPD: 20 tasks
• Takes 1 day to build
Whole MPD: >2,300 tasks
15/09/2017
17
© Cranfield University17
Introduction of Mapping Tool
• Python Programming Language
• Algorithm divided into 4 main stages:
DataExtraction
Modifying Customer
Data
Fuzzy Match
Generationof Output
File
MAPPING TOOL
MPD & Customer Excel (Formatted)
Unmodified Customer Data
MPD and Modified Customer Data
Matched MPD Task Numbers
Customer Excel File Matched with MPD
15/09/2017
18
© Cranfield University18
Mapping Tool –5 steps
FORMATTING EXCEL FILES
SAVING RUNNING MAPPING
TOOLWAITING
READING GENERATED
FILE
15/09/2017
19
© Cranfield University19
Testing – Testing Cases
White Box Testing
• Testing by developer - debug
Black Box Testing
• Testing by user
Combined Scenarios
Spelling Correction
Character Capitalization
Numerals Transformation
Task Number Matching
Task Description Matching
Testing Scenarios
(27)
15/09/2017
20
© Cranfield University20
Testing
Verification & Validation
• Compare manual matched results and the mapping tool’s results
KPIs
• Percentage of matching accuracy
• Lead time of matching process
Results
• Average lead time to match 10 tasks: 1 mins
• Single result – all results matched correctly
• Multiple results – all included the correct results
• Interesting finding – some tasks should get no result,
but the mapping tool gives multiple results.
15/09/2017
21
© Cranfield University21
Conclusion
Completed Pilot
• Bid Information Process
• MRO Ontology
• MRO Dictionary
• Mapping Tool Prototype
Towards implementation
• Complete Ontology and Dictionary
• Industrialise software code
• Integration with existing systems
15/09/2017
22
© Cranfield University22
www.cranfield.ac.uk
T: +44 (0)1234 750111