1
COMBINE TEST AUTOMATION CODE WITH PRODUCT CODE The Good, The Bad and The Lessons Learned May 5th 2016
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
• Who am I? • Who is Halogen? • The Framework • Why we did it? • The Good • The Bad • The Lessons Learned • QuesHons
Agenda
2
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
Who am I?
Our mission is to help you
Win with Talent!
3
Ranked #1 in customer saGsfacGon by every leading industry analyst.
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
• Key word driven • WriSen in Java • Using Selenium for UI • Rest Assured for API • Over 2000 tests • Over 22,000 validaHons • Run at least once daily – working towards conHnuous integraHon • Run is spread evenly over 30 VM’s • Retry on failure implemented • Used by MarkeHng to test corporate site
The Framework
4
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
A?er Before
The Framework
AutomaGon Resources
AutomaGon Core
Product Suite
Web AutomaGon
AutomaGon Regression
AutomaGon Services
File Compare
AutomaGon
Product Suite
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
The Framework
AutomaGon Resources
AutomaGon Core
Product 1
Web AutomaGon 1
AutomaGon Regression
AutomaGon Services
File Compare
Product 2
Web AutomaGon 2
Product 3
Web AutomaGon 3
5
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
• With the shi? to agile, quality became the priority • Development wanted to write Web Test Cases • Development wanted to include Web Tests as part of their smoke test for
the build − Become part of our CI build
• Wanted to share page classes • Common framework that everyone could use
− All talk the same language • Allow developers to run tests locally
− Bug X causes test Y to fail − Dev can reproduce on own machine
Why we put the code together?
The Good
6
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
One Stop Shop for all Code
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
Populators
7
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
Developers WriHng Tests!
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
ID’s and Locators – That’s right I said ID’s!!
8
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
AutomaHon developers fixed bugs!
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
CollaboraHon
9
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
Faith in the automaHon
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
• One Stop Shop For All Code • Populators • Developers wriHng tests! • ID’s and Locators • AutomaHon developers fixed bugs! • CollaboraHon • Faith in the automaHon
The Good
10
The Bad
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
One Stop Shop for all Code
11
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
Weren’t seSled before opening the flood gates
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
Ownership!
12
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
A lot more cooks in the kitchen!
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
Dependencies got entangled
13
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
• One Stop Shop For All Code • Weren’t seSled before opening the flood gates • Ownership • Too many cooks in the kitchen • Dependencies got entangled
The Bad
The Lessons Learned
14
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
My Baby is ugly!
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
More dialogue was needed
15
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
More complex than expected
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
Needed to set expectaHons
16
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
Increased value of automaHon
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
Improved Developer Mobility
17
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
We can work together!
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
• My Baby is ugly! • More dialogue was needed • More complex than expected • Needed to set expectaHons • Increased value of automaHon • Improved Developer Mobility • We can work together!
The Lessons Learned
18
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
What QA has to say…
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
What development has to say…
19
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
What management has to say…
Copyright © 2016, Halogen So?ware Inc. All rights Reserved. ConfidenHal.
QuesHons?