Android Native App & Web Test Strategy

Droidcon Dubai 2015 -

Android Native App &

Web Test Strategy

Matteo Doni – Test Engineer

April 15th 2015

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Outlier Analysis

Platform, OS, Screen Size,

Visit number, Conversion Rate

Crash Meta Data,

Preferred Network access, Carrier

Mix

Other Factors

Blended & Weighted Mobile

TE Strategy

Internal

Considerations

External

Considerations

Test

Configurations

Test Conditions

Device

Network

OS Version

Settings

Browser

Test

Configurations

Platforms, Devices,

Demographics, OS

Versions, Carriers

Interrupts, Battery,

Incoming, Transitions

Test Conditions

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Image Credit: Daniel Spiess,

Flickr http://goo.gl/FcnxEC

Image Credit: James Cridland,

Flickr http://goo.gl/Rnp3Qk

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Image Credit: James Cridland, Flickr http://goo.gl/Rnp3Qk

Cro

wd

Testing

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Crowdsourced Testing• Widens overall coverage of testing

• Testers are in different locales/network conditions

• Very useful for usability testing and localisation testing

• Device/OS/Network mix can be widened greatly

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Image Credit: Daniel Spiess,

Flickr http://goo.gl/FcnxEC

Image Credit: James Cridland,

Flickr http://goo.gl/Rnp3Qk

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Clo

ud

Testing

Image Credit: Daniel Spiess, Flickr http://goo.gl/FcnxEC

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Cloud Testing• Uses cloud infrastructure to simulate real world usage

• Can be a mix of emulators/simulators and real devices

• Feedback for analysis can be in stack trace, recorded

session, image and video

• Most often used for compatibility, stress, performance and

functional testing

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Image Credit: Daniel Spiess,

Flickr http://goo.gl/FcnxEC

Image Credit: James Cridland,

Flickr http://goo.gl/Rnp3Qk

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Inte

rna

l

Testing

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Automated Testing

From Unit to Functional

Manual Exploratory

Both Testers and users across the business

Acceptance Testing

Supporting product owners

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

In a Nutshell :

• Cyclic Data Driven Strategy

• Constant Quality Improvement

• Automation, Automation, Automation!

• Extended Reach with Cloud and Crowd

• In-house Exploratory Testing

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

Image Credit: Daniel Spiess,

Flickr http://goo.gl/FcnxEC

Image Credit: James Cridland,

Flickr http://goo.gl/Rnp3Qk

Droidcon Dubai 2015 – Android Native App & Web Test Strategy

QA ≠ Q&A

Droidcon Dubai 2015 – Android: More Than Google’s OS

+MatteoDoni

@Todoleo

Matteo Doni

Edinburgh • Glasgow • Singapore • Beijing • Miami • Barcelona • Shenzen • Sofia • Budapest

Thank you!

www.skyscanner.net/jobs