Embed Size (px)
Citation preview
Building an effective mobile testing strategy
Abhishek Kumar
October 20161
2
About me
• 7+ Years experience as developer and tester.
• 5+ Years experience in product management and business development.
• A Tester
• A Blogger
• A Consultant
• The Mobile App Market By 2017
• Device Coverage for Mobile Testing
• Mobile Testing Approaches
• Mobile Testing With Cloud Solution
• Demo
3
Agenda
4https://www.entrepreneur.com/article/236832
By 2017, the App Market
5https://www.entrepreneur.com/article/236832
By 2017, the App Market
6https://www.entrepreneur.com/article/236832
By 2017, the App Market
7
19K Unique android devices
are available on the market.
20 iPhone and iOS configuration
combinations on the market
8
So what all devices I should cover while testing on real mobile device?
Let's look at the device coverage
9
Device Coverage for Mobile Testing
10
Mobile Testing Approaches
• Emulators
• In-House Device
• Mobile Cloud
11
Emulators
Emulators: Pros
Price - Mobile emulators are free and provided as part of the SDK.
Simple - Just download the software, install on your PC and you're ready to go.
Fast – They have less latency than real devices connected to the local network or in the
cloud.
Emulators: Cons
Increased Risk - You cannot be 100% sure if it will actually work on a real device.
Hardware and Software Differences – Simulators typically doesn’t reflect specific hardware
and software features of each supported device.
No way to test network interoperability – It is important to test the impact of network-
related events (e.g., incoming call, text message, etc.) and different network technologies
(e.g., HSPDA, WCDMA, UMTS, LTE) on mobile app behavior.
12
In-House Devices
In-House Device: Pros
Real Device - You have the real devices as your customer using.
Risk Reduced – Better than testing on Simulator and higher success rate of your mobile
application.
In-House Device: Cons
Slower Feedback - Slow down the feedback process and your productivity.
Cost – In order to meet the device coverage and delivering a quality app, You have to keep
investing in the latest devices.
Maintenance– You will have to setup your device lab and maintain these devices.
Availability – If same device needed by multiple developers/testers at the same time then it
becomes a challenge and loss of productivity.
13
Mobile Cloud
Mobile Cloud Devices: Pros
Cost – No costs for device storage and maintenance
Accessibility- Access devices and test results from different locations at different times
Device Range- Wide range of testing devices at your disposal
Network Coverage- Access devices in different mobile networks
Infrastructure- Infrastructure is already there
Session Sharing- Share real time test session with the developer sitting at a different geo location
Testing on Cloud devices: Cons
Wait Time- Requesting an unavailable device in the cloud and wait for it to be available by the
cloud service provider.
In-House Devices- Utilizing your In-House devices with the cloud devices
14
Choosing a cloud service have more advantages than testing on simulator and In-
House devices.
15
Key consideration while choosing a mobile cloud service for your app testing needs?
16
• Maximum no. of devices(All OEMs, Market share)
• Real device located at different geo locations
• Supports widely used test frameworks, Ex: Appium, Cucumber, Calabash,
Espresso etc.
• Allowing enterprises to use their own device infrastructure
• Supporting seamless integration into your Continuous Integration (CI)
environment
• Devices at secured data centers worldwide
17
18
And a solution from Vietnam
APP TESTERS
ORG Devices
Device Farms
(public or private)
Personal DevicesIndividuals
SMBs
Enterprises
DEVICE OWNERS
19
20
Manual Testing Steps
Manual Testing
21
Automation Testing Steps
Automation Testing
22
In-House Devices Steps
In-House Device Management
23
Join Kobiton Beta Program
25
