Upload
vivian-billock
View
224
Download
1
Tags:
Embed Size (px)
Citation preview
Lockheed Martin Simulation, Training & SupportLockheed Martin Simulation, Training & Support
ATML on LM-STARATML on LM-STAR®®
Michelle Harris407-306-6693
Alicia Helton407-306-1592
Steven O’Donnell407-306-4325
Steven.J.O’[email protected]
22
Lockheed Martin Simulation, Training & Support
IntroductionIntroductionImplemented a set of ATML schemas on LM-Implemented a set of ATML schemas on LM-STARSTAR®®
Schemas used –Schemas used –TestDescription ML (draft 5.0)TestDescription ML (draft 5.0)
TestResults ML (version 0.15)TestResults ML (version 0.15)
Diagnostic MLDiagnostic ML
BayesBayes
Common Element Model (CEM) Common Element Model (CEM)
Dynamic Context Model (DCM – version 0.07)Dynamic Context Model (DCM – version 0.07)
33
Lockheed Martin Simulation, Training & Support
Task DefinitionTask Definition
Convert a legacy CASS ATLAS TPS into ATML Convert a legacy CASS ATLAS TPS into ATML TestDescription.TestDescription.
Use TestDescription as input to the SELEX TPS Use TestDescription as input to the SELEX TPS Wizard™ and generate TestStandWizard™ and generate TestStand™™ sequences. sequences.
Execute the TestStandExecute the TestStand™™ sequences on the LM- sequences on the LM-STARSTAR®®..
Collect measured values using ATML TestResults.Collect measured values using ATML TestResults.
Interface with diagnostic reasoner to isolate to Interface with diagnostic reasoner to isolate to the fault more quickly and more accurately.the fault more quickly and more accurately.
44
Lockheed Martin Simulation, Training & Support
Initial ApproachInitial Approach
Use an externally developed tool to convert ATLAS to Use an externally developed tool to convert ATLAS to Intermediate XML Intermediate XML
Use XML tools to transform the Intermediate XML to Use XML tools to transform the Intermediate XML to TestDescriptionTestDescription
TestDescription will provide the “what” to do information for the TestDescription will provide the “what” to do information for the TPSTPS
Use the TPS Wizard™ to generate TestStandUse the TPS Wizard™ to generate TestStand™™ sequence files capable of being run on LM-STARsequence files capable of being run on LM-STAR®®..
ATLASIntermediate
XMLATML Test Description
TestStand Sequence Files
55
Lockheed Martin Simulation, Training & Support
IssuesIssues
Legacy ATLAS TPS was not designed to maximize Legacy ATLAS TPS was not designed to maximize portabilityportability
Intermediate XML generated from ATLAS was Intermediate XML generated from ATLAS was very flatvery flat
Difficult to understand test flow and translate into Difficult to understand test flow and translate into TestDescriptionTestDescription
Legacy ATLAS TPS didn’t adhere to style guide Legacy ATLAS TPS didn’t adhere to style guide which would have enforced specific design ruleswhich would have enforced specific design rules
Multiple fault callout permutations based on data Multiple fault callout permutations based on data evaluations made without test numbers created evaluations made without test numbers created problems in the diagnostic model developmentproblems in the diagnostic model development
66
Lockheed Martin Simulation, Training & Support
Revised ApproachRevised Approach
An application was An application was developed to extract the developed to extract the “what” to do information “what” to do information from the ATLAS and save it from the ATLAS and save it to a spreadsheet.to a spreadsheet.
Human intervention Human intervention verified the information verified the information and added missing values.and added missing values.
An application was written An application was written to convert the spreadsheet to convert the spreadsheet to TestDescription.to TestDescription.
TestTest 20002000
Test GroupTest Group 11
Next on FailNext on Fail DIAGNOSTIC1DIAGNOSTIC1
Next on PassNext on Pass 20102010
Callout on Callout on FailFail
A4A4
High LimitHigh Limit 2525
Low LimitLow Limit NANA
ComparisonComparison EQEQ
UnitsUnits OhmOhm
Entry PointEntry Point NoNo
77
Lockheed Martin Simulation, Training & Support
TestDescription Sample TestDescription Sample <Outcomes><Outcomes> <Outcome ID="0_1" value="Passed"/><Outcome ID="0_1" value="Passed"/> <Outcome ID="0_2" value="Failed"/><Outcome ID="0_2" value="Failed"/> <Outcome ID=" DIAGN1" value="Failed"><Outcome ID=" DIAGN1" value="Failed"> <ReplaceComponents><ReplaceComponents> <ReplaceComponent uutComponentId="UUT-0"/><ReplaceComponent uutComponentId="UUT-0"/> </ReplaceComponents></ReplaceComponents> </Outcome></Outcome> <Outcome ID="<Outcome ID=" DIAGN1" value="Failed">DIAGN1" value="Failed"> <ReplaceComponents><ReplaceComponents> <ReplaceComponent uutComponentId="UUT-1"/><ReplaceComponent uutComponentId="UUT-1"/> </ReplaceComponents></ReplaceComponents> </Outcome></Outcome>------snipped----------------snipped----------<Step xsi:type="Step_Test" ID="Step_2" testId="2000"><Step xsi:type="Step_Test" ID="Step_2" testId="2000"> <Results><Results> <Result xsi:type="Result_Test" testOutcomeId="2000A"><Result xsi:type="Result_Test" testOutcomeId="2000A"> <NextStep stepId="Step_3"/> <!-- 2020 --><NextStep stepId="Step_3"/> <!-- 2020 --> </Result></Result>
Using the information from TestDescription, the Selex TPS WizardUsing the information from TestDescription, the Selex TPS Wizard™™ builds the builds the frame of the new TPS with initiated variables, test criteria, simulation mode, pre frame of the new TPS with initiated variables, test criteria, simulation mode, pre and post conditions, and calls to “how-to” sequences. and post conditions, and calls to “how-to” sequences.
88
Lockheed Martin Simulation, Training & SupportTestDescription to LM-TestDescription to LM-STARSTAR®®
Needed to create the “how-to” TestStandNeeded to create the “how-to” TestStand™™ Sequences Sequences
Highly intensive manual taskHighly intensive manual taskSimplified through the use of Custom StepsSimplified through the use of Custom StepsGraphical interface to LM-STARGraphical interface to LM-STAR®® system software system software
99
Lockheed Martin Simulation, Training & Support
Diagnostic ModelDiagnostic Model
DescriptionDescriptionModel is based off the Bayesian and Common Element Model is based off the Bayesian and Common Element Models from the AI-ESTATE standardModels from the AI-ESTATE standard
Stored in XML format derived from the AI-ESTATE Stored in XML format derived from the AI-ESTATE modelsmodels
Development of ModelDevelopment of ModelStart with the fault tree of the TPSStart with the fault tree of the TPS
Use historical test results and maintenance data to add Use historical test results and maintenance data to add more intelligence to the Modelmore intelligence to the Model
Learning algorithms are used to continuously feed back Learning algorithms are used to continuously feed back newly discovered test results (in TestResults ML format) newly discovered test results (in TestResults ML format) and maintenance dataand maintenance data
1010
Lockheed Martin Simulation, Training & Support
Diagnostic ReasonerDiagnostic ReasonerProvides run-time environment for using the Provides run-time environment for using the diagnostic modelsdiagnostic models
Implements the AI-ESTATE interface to the diagnostic Implements the AI-ESTATE interface to the diagnostic modelsmodels
Uses the Dynamic Context Model to track session Uses the Dynamic Context Model to track session informationinformation
Allows for back-tracking through sessionAllows for back-tracking through session
Allows restart of Session from previous stopping pointAllows restart of Session from previous stopping point
Provides a set of “higher-order” interface functions to Provides a set of “higher-order” interface functions to minimize required calls for accessing model/reasoner dataminimize required calls for accessing model/reasoner data
Web-service based interface (using WSDL)Web-service based interface (using WSDL)
Utilizes a Bayesian Network Analyzer called SMILEUtilizes a Bayesian Network Analyzer called SMILE
By Decisions System Laboratory – Univ. of PittsburghBy Decisions System Laboratory – Univ. of Pittsburgh
1111
Lockheed Martin Simulation, Training & Support
Lessons LearnedLessons LearnedOur current process is still heavily dependent on manual Our current process is still heavily dependent on manual intervention. intervention.
Very time-consumingVery time-consuming
Current legacy TPSs are implemented with tight coupling making it Current legacy TPSs are implemented with tight coupling making it difficult to separate the “what” and “how” informationdifficult to separate the “what” and “how” information
Other ATML schemas such as UUT Description and TestAdapter Other ATML schemas such as UUT Description and TestAdapter could aid in the porting processcould aid in the porting process
They were not mature enough at the time the task startedThey were not mature enough at the time the task started
Would be more cost effective to implement UUT test Would be more cost effective to implement UUT test requirements on new systems as opposed to re-hosting the requirements on new systems as opposed to re-hosting the applicationapplication
Not always a one-to-one test mapping from TPS to Diagnostic Not always a one-to-one test mapping from TPS to Diagnostic ModelModel
1212
Lockheed Martin Simulation, Training & Support
ConclusionConclusionIndustry needs tools that can generate and Industry needs tools that can generate and consume ATML that could be exported to C, ATLAS consume ATML that could be exported to C, ATLAS etcetc
Using IEEE-1641 for Signal and Test Definition Using IEEE-1641 for Signal and Test Definition appears promising and further study by Lockheed appears promising and further study by Lockheed Martin is planned Martin is planned
Lockheed Martin is embracing ATMLLockheed Martin is embracing ATMLTestResults ML is deployed on LM-STARTestResults ML is deployed on LM-STAR®® systems systems supporting the JSF programsupporting the JSF program
As ATML matures, Lockheed Martin is prepared to As ATML matures, Lockheed Martin is prepared to implement this technology into our legacy and implement this technology into our legacy and future programsfuture programs
1313
Lockheed Martin Simulation, Training & Support
DEMONTSTRATIONDEMONTSTRATION
1414
Lockheed Martin Simulation, Training & Support
QuestionsQuestions
Alicia Helton407-306-1592
Michelle Harris407-306-6693
Steven O’Donnell407-306-4325
Steven.J.O’[email protected]