+DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq 9dolgdwlrq

  • View
    0

  • Download
    0

Embed Size (px)

Text of +DUPRQLVHG 052 :RUN 7DVN 'HILQLWLRQ IRU $XWRPDWHG &udqilhog 8qlyhuvlw\ 7hvwlqj 9hulilfdwlrq...

  • 15/09/2017

    1

    www.cranfield.ac.uk

    Harmonised MRO Work Task Definition for Automated Bid Generation

    Yandy MA, Nakib Salman HOWLADER,

    Yicong LIU, Domen SINKOVEC

    Ip-Shing FAN, Jim ANGUS

    5th September, 2017

  • 15/09/2017

    2

    1. Introduction

    2. Aims & Objectives

    3. Current Situation

    4. Methodology

    5. Ontology

    6. Dictionary

    7. Coding

    8. Testing

    9. Conclusion and Future Work

    Content

  • 15/09/2017

    3

    © Cranfield University3

    Introduction – MRO

    AirlinesManufacturer

    Manufacture

    Design

    MRO service providers

    Passengers Jet

    Cargo Business Jet

    Maintenance, Repair and Overhaul (MRO)

    Bidding Process

    Line Maintenance

    Base Maintenance

  • 15/09/2017

    4

    © Cranfield University4

    Introduction – Typical MRO Bid Response Process

    Difficulties – External

    • Different customer document formats

    • Different task numbering systems

    • Spelling mistakes in customer documents

    • Differences in abbreviations

    Difficulties – Internal

    • Manually matching process is time consuming – potentially 4-6 weeks

    • Even expert users of VLookup and HLookup in Excel struggle when text is not exact

    Receive Customer Bid

    Match maintenance

    task manually

    Compile Bid Package Task List

    Takes around 4 - 6 weeks

  • 15/09/2017

    5

    © Cranfield University5

    Aim & Objectives

    Aim

    • Improve efficiency and reliability of bid generation by automated matching of maintenance task descriptions between airline information packages and MRO in-house data systems

    Objectives

    • Develop an MRO terminology dictionary

    • Develop text matching logic appropriate for bid information matching

    Scope

    • Build a prototype of mapping tool based on A300-600 documents

  • 15/09/2017

    6

    © Cranfield University6

    Current Situation – MPD

  • 15/09/2017

    7

    © Cranfield University7

    Current Situation – Customer’s Request List – Example 1

  • 15/09/2017

    8

    © Cranfield University8

    Current Situation – Customer’s Request List – Example 2

  • 15/09/2017

    9

    © Cranfield University9

    Current Situation – Different Descriptions for the Same Task

    MPD Task Number Task Description

    281200-02-1

    TANK VENTING SYSTEM

    GENERAL VISUAL INSPECTION OF TRIM TANK NACA INTAKE FOR OBSTRUCTION

    Clients Reference Task Description 60C0307 WING & TRIM TANK VENTING SYSTEM - VISUAL CHECK

    Task in MPD

    Task in Customer Bid Request List

  • 15/09/2017

    10

    © Cranfield University10

    Research Project Methodology

    Literature Review

    Background Understanding Design

    Ontology and Dictionary Building Coding Testing Deliver

    Ontology

    Words Similarity

    Text Similarity

    Current Situation

    Difficulties of Bidding Process

    Design Mapping

    Tool’s Algorithms

    Build Ontology

    Build Dictionary

    Code Mapping

    Tool

    Test Mapping

    Tool

    Ontology

    Dictionary

    Mapping Tool

    Prototype

    Bid Info Process

  • 15/09/2017

    11

    © Cranfield University11

    Bid Info Process

  • 15/09/2017

    12

    © Cranfield University12

    Matching algorithms

    Word-to-Word Similarity

    • 𝒔𝒊𝒎 𝒂, 𝒃 = 𝟏 − 𝒍𝒐𝒈𝟐 𝟏 + ∅ 𝒂 ∖∅ 𝒃 |∅ 𝒃 ∖∅ 𝒂 |

    ∅ 𝒂 ∖∅ 𝒃 ∅ 𝒃 ∖∅ 𝒂 ∅ 𝒂 ∩∅ 𝒃

    • Ontology and Dictionary based approach

    Word Inverse Frequency

    • 𝒊𝒕𝒇(𝒘) = 𝑵

    𝒏𝒘

    • Higher frequency, lower weighting.

    Text Similarity

    •𝑺𝒊𝒎 𝑻𝟏, 𝑻𝟐 = 𝟏

    𝟐 ( ∑ 𝐦𝐚𝐱𝐒𝐢𝐦 𝐰,𝑻𝟐 ×𝒊𝒕𝒇 𝒘𝒘∈ 𝑻𝟏

    ∑ 𝒊𝒕𝒇 𝒘 𝒘∈ 𝑻𝟏

    + ∑ 𝐦𝐚𝐱𝐒𝐢𝐦 𝐰,𝑻𝟏 ×𝒊𝒕𝒇 𝒘𝒘∈ 𝑻𝟐

    ∑ 𝒊𝒕𝒇 𝒘 𝒘∈ 𝑻𝟐

    )

    • Based on word similarity and word inverse frequency

    MPD Task Number

    Task Description

    575155-01-1 RIGHT HAND WING FLAP TRACK NO. 2 GEARBOX AREA EWIS – GENERAL VISUAL INSPECTION

    Clients Reference Task Description

    60C0307 R/H ving flap track No. two gearbox area electric wiring system–general visual check

    Words Unification Functions:

    • Spelling Correction

    • Numeral Standardisation

    • Capitalisation

    • Synonyms and Abbreviations Identification

  • 15/09/2017

    13

    © Cranfield University13

    Ontology – Relationships

    Source: www.monarchaircraftengineering.com/

  • 15/09/2017

    14

    © Cranfield University14

    Ontology – Class Hierarchy

    • Manually established with Protégé

    • Built with Aerospace knowledge

    • Presented concept of MRO

    • Systemise maintenance tasks

    sample MPD – 20 tasks

    • Takes 1 day to build ontology

    whole MPD >2,300 tasks

  • 15/09/2017

    15

    © Cranfield University15

  • 15/09/2017

    16

    © Cranfield University16

    Dictionary

    Word: Check

    Meaning: an examination to make certain that something

    is as it should be

    Other PoS:

    Checks, checked, checking

    Abbreviation:

    CHK

    Synonyms: examine, inspect

    • MRO specified dictionary

    • Include comprehensive information of each aerospace/MRO related words

    Sample MPD: 20 tasks

    • Takes 1 day to build

    Whole MPD: >2,300 tasks

  • 15/09/2017

    17

    © Cranfield University17

    Introduction of Mapping Tool

    • Python Programming Language

    • Algorithm divided into 4 main stages:

    Data Extraction

    Modifying Customer

    Data

    Fuzzy Match

    Generation of Output

    File

    MAPPING TOOL

    MPD & Customer Excel (Formatted)

    Unmodified Customer Data

    MPD and Modified Customer Data

    Matched MPD Task Numbers

    Customer Excel File Matched with MPD

  • 15/09/2017

    18

    © Cranfield University18

    Mapping Tool –5 steps

    FORMATTING EXCEL FILES

    SAVING RUNNING MAPPING

    TOOL WAITING

    READING GENERATED

    FILE

  • 15/09/2017

    19

    © Cranfield University19

    Testing – Testing Cases

    White Box Testing

    • Testing by developer - debug

    Black Box Testing

    • Testing by user

    Combined Scenarios

    Spelling Correction

    Character Capitalization

    Numerals Transformation

    Task Number Matching

    Task Description Matching

    Testing Scenarios

    (27)

  • 15/09/2017

    20

    © Cranfield University20

    Testing

    Verification & Validation

    • Compare manual matched results and the mapping tool’s results

    KPIs

    • Percentage of matching accuracy

    • Lead time of matching process

    Results

    • Average lead time to match 10 tasks: 1 mins

    • Single result – all results matched correctly

    • Multiple results – all included the correct results

    • Interesting finding – some tasks should get no result,

    but the mapping tool gives multiple results.

  • 15/09/2017

    21

    © Cranfield University21

    Conclusion

    Completed Pilot

    • Bid Information Process

    • MRO Ontology

    • MRO Dictionary

    • Mapping Tool Prototype

    Towards implementation

    • Complete Ontology and Dictionary

    • Industrialise software code

    • Integration with existing systems

  • 15/09/2017

    22

    © Cranfield University22

    www.cranfield.ac.uk

    T: +44 (0)1234 750111