Embed Size (px)
DESCRIPTION
Talk about my phd proposal at the PhD symposium during the International Conference on Software Testing (ICST) in Paris 2010
Citation preview
Holistic Model-Based Testing for Business Information Systems
Michael Mlynarski
08.04.2010, Paris
Intro
Generating test cases? - theory -
We can generate test cases from models!
Model Test Cases
Weißleder
Pretschner et al.
Ostrand et al.
Güldali et al.
Vieira et al.
Hartmann et al.
Rumpe
Offutt et al.
Mingsong et al.
Bertolino et al.
Binder...
...
Generating test cases? - practice -
Requirements
SubsystemDesign
Code
Component Testing
System Testing
Acceptance Testing
Integration Testing
Component Design
Analysis
Requirements
SubsystemDesign
Code
Component Testing
System Testing
Acceptance Testing
Integration Testing
Component Design
Analysis
There are several types of models!
time order
validation
Activity Artifact
Legend:
MODELS
MODELS
MODELS
MODELS
Create course
Search course
Book attendee
Entrydata
Savedata
nametypedate
Coursenameageskill
Attendee
namemember
Customer
StartDialog
CourseDialog
AttendeeDialog
Behaviour
Structure
Interaction
TextTextTextText
TextText
Create course
Search course
Book attendee
Entrydata
Savedata
nametypedate
Coursenameageskill
Attendee
namemember
Customer
StartDialog
CourseDialog
AttendeeDialog
Behaviour
Structure
Interaction
TextTextTextText
TextText
Holistic view on analysis models is needed...
Holistic
view
What is the problem?
Problem decomposition
Question:
Justification:
How to use the holistic view on analysis models for test generation purposes?
Test-related information are spread accross several analysis models.
Holistic view in testing
Holistic view in testing
Subproblem #1 Subproblem #2
Reuse of analysis models
Test Model Test Cases
Güldali, B. and Mlynarski, M. and Sancar, Y. Effort Comparison for Model-Based Testing Scenarios, Quombat workshop, ICST 2010 (to be published)
Test CasesRequirementsCode
How to reuse analysis models for
test generation?
???
Subproblem #1
Analysis Models
Create course
Search course
Book attendee
Entrydata
Savedata
nametypedate
Coursenameageskill
Attendee
namemember
Customer
StartDialog
CourseDialog
AttendeeDialog
Behaviour
Structure
Interaction
TextTextTextText
TextText
∆test info
Create course
Search course
Book attendee
Entrydata
Savedata
nametypedate
Coursenameageskill
Attendee
namemember
Customer
StartDialog
CourseDialog
AttendeeDialog
Behaviour
Structure
Interaction
TextTextTextText
TextText
Create course
Search course
Book attendee
Entrydata
Savedata
nametypedate
Coursenameageskill
Attendee
namemember
Customer
StartDialog
CourseDialog
AttendeeDialog
Behaviour
Structure
Interaction
TextTextTextText
TextText
Model coverage measurement
Test Cases
generate
Subproblem #2
cover
cover
cover
How to measure the model coverage of several
models?
Problem decomposition
Question:
Justification:
How to reuse analysis models for test model creation?
Test designers need a separate model to model additional test information.
Question:
Justification:
How to measure the model coverage of several models?
Holistic view in testing
Reuse of analysis models
Model coverage measurement
Quality of a holistic approach test approach is measurable through model coverage.
High model coverage within the test case generation can be reached by using the holistic view of models created by business analysts.
Hypothesis
‘‘ ‚‚
Related work
Holistic view in testing
Reuse of analysis models
Model coverage measurement
Dias Neto, A. and Subramanyan, R. and Vieira, M. and Tracassos, G. A Survey on Model-based Testing Approaches: A Systematic Review Siemens Corporate Research, 2007
Briand, L. C. and Labiche, Y. A UML-Based Approach to System Testing UML' '01: Proceedings of the 4th International Conference on The Unified Modeling Language, Modeling Languages, Concepts, and Tools, Springer Berlin / Heidelberg, 2001, 194-208
Dai, Z. R. and Grabowski, J. and Neukirchen, H. and Pals, H. From Design to Test with UML -- Applied to a Roaming Algorithm for Bluetooth Devices Proceedings of the 16th IFIP International Conference on Testing of Communicating Systems LNCS 2978, Springer Verlag, 2004
Torres, A. and Escalona, M. and Mejias, M. and Gutiérrez, J. A MDA-Based Testing. A comparative study. Proceedings of 4th international conference on Software and Data Technologies ICSOFT, INSTICC Press, 2009
Mc Quillan, J. A. and Power, J. F. A Survey of UML-Based Coverage Criteria for Software Testing Department of Computer Science, 2005
Andrews, A. A. and France, R. B. and Ghosh, S. and Craig, G. Test adequacy criteria for UML design models Software Testing, Verification Reliability, 2003, 13, 95-127
no model relations
no test selection
no criteria combination
What is the solution?
Model-Based Test Specification Process
Mlynarski, M. and Güldali, B. and Späth, M. and Engels, G. From Design Models to Test Models by Means of Test Ideas, In Proceedings of the 6th International Workshop on Model-Driven Engineering, Verification and Validation, Springer, 2009, 1-10
Coverage
measurementTest
Selection
M2M
Analyze and annotatetest basis
Generate basictest model
Extend basictest model
Generate test cases
Analysis model
Basictest
model
Extendedtest
model
Process
Artifacts
is_transformed_to extends generated_from
instance of instance of Test cases
UMLUML
Testing
Profile
Analysis meta-model
Test meta-model
Current results
Results
Güldali, B. and Mlynarski, M. and Sancar, Y. Effort Comparison for Model-Based Testing Scenarios, Proceedings of the 1st Workshop on Quality of MBT Springer, 2010 (to be published)
Mlynarski, M. and Güldali, B. and Späth, M. and Engels, G. From Design Models to Test Models by Means of Test Ideas MoDeVVa '09: Proceedings of the 6th International Workshop on Model-Driven Engineering, Verification and Validation, Springer, 2009, pp. 1-10
Beulen, D. and Güldali, B.and Mlynarski, M. Vergleich von Prozessmodellen für MBT aus Managementsicht, Softwaretechnik-Trends, 3/2010 (to be published)
Güldali, B. and Wübbeke, A. and Mlynarski, M. and Engels, G. Model-Based Testing using Visual Contracts Proceedings of Euromicro SEAA Conference 2009, Special Session on “Model Driven Engineering” IEEE Computer Society, 2009, 121-124
Güldali, B. and Jungmayr, S. and Mlynarski, M. and Neumann, S. and Winter, M. Starterhilfe für modellbasiertes Testen: Entscheidungsunterstützung für Projekt- und Testmanager Objektspektrum, 3/2010, 2010 (to be published)
Coverage
measurementTest
Selection
M2M
Analyze and annotatetest basis
Generate basictest model
Extend basictest model
Generate test cases
Analysis model
Basictest
model
Extendedtest
model
Process
Artifacts
transform extend generate
Analysis meta-model
Test meta-model
instance of instance of
Summary & Outlook
Holistic view in testing
Reuse of analysis models
Model coverage measurement
Problem Solution
Evaluation @
✓✓
Discussion
Michael Mlynarski
Software Quality Lab Warbuger Str. 100 33098 Paderborn
E-Mail: [email protected] Mobile: 0176 24543671 Twitter: michalmm
EMDT Workshop 16.09.2010 Illmenau (DE) http://proinf.de/emdt2010/
