Emerging trends in test automation

I AM SRIRAM ANGAJALA – Eurostar Trains

I am here because I love AUTOMATION since 2003. Worked in Silk Test, Winrunner, QTP, Selenium RC….

Find me at “sriram.angajala” in Linkedin

3

I have a Question?

4

What Percentage of the tests are Automated in

your Company?X%

5

Similar conversation happened.

QA from Eurostar and QA from other company

6

“7

“8

“9

“10

“11

“12

“13

“14

“15

“16

“17

“18

“19

“20

What more can be automated apart from functional tests, load , Api???

Visual Automated Tests

Look and Feel across browsers, devices and

responsiveness - Automation.

Mock – the – Services – Test

Run automated tests while mocking the

services – and test every edge case.

Dev ops Automation(CI,CD)

Run automated test on every merge of code.

21

. Visual Regression Testing

If it doesn't break any functionality, but doesn't look the way it should, then that's a visual regression

22

Then Visual Regression testing … is taking the screen shots for every page and compare them with past...

Many of companies does this..

23

Then Visual Regression testing … is taking the screen shots for every page and compare them with past...

NO

Many of companies does this..

24

What to look in Visual Automated Tool ⬞ Adds extra pairs of eyes to our existing

tests⬞ Fit into BDD along with functional steps⬞ Focus on specific elements only – not on

dynamic content and take screen shots against baseline

⬞ Capable of fine tuning the results⬞ Run across browsers and mobile devices

25

What to look in Visual Automated Tool ▪ Feature: Eurostar’s direct Train’s Pages

⬞ Scenario: Traveller can buy a tickets through new responsive website

Given a Traveller is in the new booking magnetWhen he go to travel to “Paris” pageThen the user experience looks as expected on booking magnet sectionWhen he continues his bookingThen the print at home tickets looks great with new design and qr code is readable

26

Tools – Fits BDD ▪ PhantomCSS▪ Applitools – not open source▪ Webdrivercss – Works with

Webdriver.IO▪ Galen Framework

27

DEMO – How it works▪ WebdriverCSS▪ Mocha▪ Webdriver-Admin-Panel – Reports

▪ Meetup – Sriram Angajala – East london testers

28

Mock Services

our office

29

How Mock Services works

our office

30

What to look in mock service Automation▪ Feature: Loyal customer books tickets

⬞ Scenarios: Traveller with Loyalty card books ticketsGiven traveller selects his travel details with last name “lewis”Then his loyalty card shows 10000 points balanceWhen he buys ticket and current points add to loyaltyThen he can get 30% discount in his travel costAnd the loyalty system responds SYSTEM ERRORThen user receives a warning and can continue his booking

31

How to mockIntegrate mock service

tools to automation framework.

Java – Cucumber – Selenium - Wiremock

Set predefined rules and response

Eg. Always respond with 200

Filter Responses based in Requests.

Eg. If user name is “Lewis” then respond

with 10000 points

32

Error scenario simulation and

edgecase.Eg. If the user is

“lewis” fail a specific response with 400

Record and playback the real

requests and responses

System under tests is now fully tested

Tools– Wiremock – Used in Eurostar– Apiary– Mockable.IO– Soap UI– Charles

– Meet up – East london testers

33

Advantages of MockingReduce cost by not hitting external apiMinimize the downtime from external systems Emulated test conditions which cannot be tested in real services – Network down Emulate network delays and test how the system reactsDevelop Front end with out the apis. For POC etc

34

Continuous Integration – Deployment – Devops Automation Testing

Automation can help to make deployments faster by adding quality gates in GIT Flow – Tests - Part of Development Build

Test Automation should be embedded into Dev-ops automation process to enable Trash and Rebuild environment – Run Tests- Provide confidence on deployments

35

36

Future

▪Gesture controls▪Record play back SDK plugins for

mobile apps ▪Script less testing

▪Cucumber Pro

37

Summary / Conclusion

ConclusionAutomation tests can be extended

beyond what we think1. Visual testing2. Mock Services3. Dev-ops Automation4. And More…

Q&A Session

Questions

Thank You !

THANK YOU ALL!Search for “Sriram Angajala”