Embed Size (px)
Citation preview
Rachel ObstlerVP Product
Chris KarnackiSolutions Director
Building a Complete, Multi-Stage Test Strategywith Keynote Mobile Testing
Mobile App Testing Best Practices
227BILLION
apps downloaded in 2015
16% are willing to give a poor quality app more than one attempt
24,000distinct Android devices in market
© 2016 Keynote by Dynatrace 3
Today’s users expect apps to just work on their device
1-2 releases per month
Access to Devices
Faster Release Cycles -> Agile Processes
Software Diversity
Hardware Diversity
Mobile and Agile Change the Test Process
Automation
Continuous Integration
Access to Real Devices
Collaboration
© 2016 Keynote by Dynatrace 4
300+ shared devices Thousands of Private devices
Enabling your agile process with automated and interactive access to hundreds of real devices, over the internet
Keynote Mobile Testing
Interactive access to real devices for exploratory or negative testing
Automation to speed the release cycle
Multiple scripting options to meet the needs of your agile team
Integrates with your CI process to automatically kick off tests
Supports all stages of the agile test process
© 2016 Keynote by Dynatrace 5
Building the Ideal Test Strategy
Unit testing
Exploratory or Negative Testing
Build Acceptance Testing
Regression Testing
© 2016 Keynote by Dynatrace 6
Building the Ideal Test Strategy
Different screen resolution / screen size
Unreadable text, blurred images, misalignment of screen elements, and items that fall off the screen.
Android Customizations
On-screen and physical controls that function differently across devices and emulators.
Memory / CPULow or insufficient memory or processing power. Impacts of other services running on the device.
+ Real DevicesUnit testing
Exploratory or Negative Testing
Build Acceptance Testing
Regression Testing
© 2016 Keynote by Dynatrace 7
Building the Ideal Test Strategy
Development Unit Tests on Real Devices
Cost of fixing bugs
Unit testing
Exploratory or Negative Testing
Build Acceptance Testing
Regression Testing
Development Testing Production
© 2016 Keynote by Dynatrace 8
Building the Ideal Test Strategy
Goal: Continuous Integration
Automated tests run for each build
On a small number of target devices
Unit testing
Exploratory or Negative Testing
Build Acceptance Testing
Regression Testing
© 2016 Keynote by Dynatrace 9
Building the Ideal Test Strategy
Unit testing
Exploratory or Negative Testing
Build Acceptance Testing
Regression Testing
Scripting
Results
© 2016 Keynote by Dynatrace 10
A. 0-25%B. 26-50%C. 51-75%D. 76-100%E. Not sure
Poll: Of your organizations mobile development projects, what % of regression testing is automated?
© 2016 Keynote by Dynatrace 11
Base: 155 professionals with knowledge of their firm’s Agile practices. Source: Forrester's Q2 2015 Global Agile Software Application Development Online Survey
“Using your best estimate, how much do you automate the following?”
How the Industry Prioritizes Automation
% Automation (mean across responses)
Unit tests 53%
Functional tests (GUI) 45%
Functional tests (Beyond GUI, e.g., APIs) 42%
We implement continuous testing – tests are kicked off at each code check in and integration (CI) 42%
We automate nonfunctional (performance) 38%
We automate nonfunctional (integration) 35%
We automate test environment provisioning 30%
© 2016 Keynote by Dynatrace 12
Building the Ideal Test Strategy
…but where possible, use real devices in the cloud
Unit testing
Exploratory or Negative Testing
Build Acceptance Testing
Regression Testing
Test on real devices…
© 2016 Keynote by Dynatrace 13
Building the Ideal Test Strategy
Unit testing
Exploratory or Negative Testing
Build Acceptance Testing
Regression Testing
© 2016 Keynote by Dynatrace 14
Building the Ideal Test Strategy with Keynote Mobile Testing
Unit testing
Exploratory or Negative Testing
Build Acceptance Testing
Regression Testing
Enable real device testing earlier in the process, lowering the cost of finding issues
Speed time to market with automation and integration with your CI process
Flexibly meet the needs of your entire agile team with various integrations and scripting options
Reduce the asset management headache of managing mobile devices
Enable remote teams with access to real devices, wherever they are
Schedule a demo of Keynote Mobile Testing Enterprise
www.keynote.com
GET STARTED TODAY!
