Upload
eddy-bruin
View
614
Download
4
Embed Size (px)
DESCRIPTION
Testing mobile apps is booming and it's importance will gain tremendously the coming years. This presentation gives a short introduction to what is different about mobile application testing compared to 'conventional' testing.
Citation preview
Madrid, 4th-7th of June 2012
Testing a new (mobile) world Testing ubiquitous computing, mobile applications & devices
Madrid, 4th-7th of June 2012
•Teaser: Plaatje evolutie (zonder ubiquitous)
The information
contained in this
presentation is 1
Madrid, 4th-7th of June 2012
Who am I?
Madrid, 4th-7th of June 2012
The web is dead! Long live the internet
Madrid, 4th-7th of June 2012
Source: Morgan Stanley Research
Madrid, 4th-7th of June 2012
Madrid, 4th-7th of June 2012
Madrid, 4th-7th of June 2012
•Teaser: Plaatje evolutie (zonder ubiquitous)
Madrid, 4th-7th of June 2012
Ubiquitous computing is a post-desktop model of human-computer
interaction in which information processing has been thoroughly integrated
into everyday objects and activities. In the course of ordinary activities,
someone "using" ubiquitous computing engages many computational
devices and systems simultaneously, and may not necessarily even
be aware that they are doing so. This model is usually considered an
advancement from the desktop paradigm.
What is ubiquitous computing?
Madrid, 4th-7th of June 2012
What’s in it for software testing?
Madrid, 4th-7th of June 2012
Error 3200
What’s in it for software testing?
Madrid, 4th-7th of June 2012
What’s in it for software testing?
Madrid, 4th-7th of June 2012
What is so different about mobile applications?
Madrid, 4th-7th of June 2012
Apps & New possibilities
Madrid, 4th-7th of June 2012
We use mobile devices anywhere and anytime
Madrid, 4th-7th of June 2012
Mobile OS development is fast
0.9 1.0 1.1 1.5 2.1 2.2 1.6 2.0 2.3 3.0 4.0
Aug Sep Mar Apr Sept Oct Jan May Dec May Oct
2008 2009 2010 2011
Nov 2006 Oct
Madrid, 4th-7th of June 2012
ISO 9126
Functionality
Reliability
Usability
Efficiency
Maintainability
Portability
Interoperability
Adaptability (Hardware)
Compliance
Adaptability (Software)
0.9 1.0 1.1 1.5 2.1 2.2 1.6 2.0 2.3 3.0 4.0
Aug 08 Sep 08 Mar 09 Apr 09 Sept 09 Oct 09 Jan 10 May 10 Dec 10 May 11 Oct 11
What is so different about mobile applications?
Madrid, 4th-7th of June 2012
How is testing mobile applications different?
Madrid, 4th-7th of June 2012
How is testing mobile applications different?
• What devices to test?
• What skills do I need to be a mobile tester?
• Is the process in a mobile project special?
• When is an app approved in a app store?
• What tools can I use?
• Use simulators or not?
• How do I test Usability?
• Is the cloud involved somewhere?
Madrid, 4th-7th of June 2012
How is testing mobile applications different?
Source: OurMobilePlanet.com
Madrid, 4th-7th of June 2012
What devices to test?
Madrid, 4th-7th of June 2012
What devices to test?
• Device Marketshare
• Pixel density
• OS Version
Madrid, 4th-7th of June 2012
What devices to test?
Madrid, 4th-7th of June 2012
What devices to test?
Madrid, 4th-7th of June 2012
What devices to test?
Madrid, 4th-7th of June 2012
What devices to test?
Madrid, 4th-7th of June 2012
• New (technical) skills
• Get to know different platforms • Dev Center (test tools)
• Android development kit
• Get to know (different) devices • Portrait/landscape
• 2G/3G/WiFi - Roaming
• GPS
• Gestures
• Check memory warnings
• Multi task
• Telephone functions
What skills do I test mobile applications?
Madrid, 4th-7th of June 2012
How is testing mobile applications different?
• Execute app store tests
• Extra requirements
• Release management
• Test in pre-production
Madrid, 4th-7th of June 2012
“If the user can’t use it. It doesn’t work”
Usability testing is a must!
How is testing mobile applications different?
Madrid, 4th-7th of June 2012
Using agile methods to develop mobile apps
Short iterations
Regression testing
Expensive and time
consuming
Automate what can be
repeated
Amount of test work
Madrid, 4th-7th of June 2012
How is testing mobile applications different?
• New test (automation) tools
• White, Grey or black box testing
• Real devices, simulator or cloud
…And
more
Madrid, 4th-7th of June 2012
iOS – UI Automation
Madrid, 4th-7th of June 2012
iOS – UI Automation
• Set up test automation
– Join iOS Developer Program
– Get xCode dev tools pkg
– Includes UI Automation
• UI Automation
– Executes test cases on device(s)
– Test scripts written in JavaScript
– Record and playback possible
Madrid, 4th-7th of June 2012
iOS – UI Automation
Madrid, 4th-7th of June 2012
iOS – UI Automation
Madrid, 4th-7th of June 2012
iOS – UI Automation
Madrid, 4th-7th of June 2012
• Testing using robotium
• Test with source code or APK
• Learn to script in Java or…
• Execute on simulator and real devices
• Record tests using Testdroid
– Record a lot of features
– Object recognition
– Executes test cases on one device…
– …or execute in the cloud
Android – Testdroid / Robotium
Object Recognition – Resource ID’s –Indexes – Names
Madrid, 4th-7th of June 2012
Android – Robotium
Madrid, 4th-7th of June 2012
Android – Testdroid
Madrid, 4th-7th of June 2012
Android – Testdroid
Madrid, 4th-7th of June 2012
iOS & Android – Calabash
• Write tests using Calabash
• Tests iOS and Android devices
• Source is needed
• Learn to script in ruby and…
• Use BDD scripting in
Madrid, 4th-7th of June 2012
How is testing mobile applications different?
Madrid, 4th-7th of June 2012
The way forward Plan for the PC to be overtaken as the primary
computing device used by customers and employees.
Redesign websites and portals for access from mobile
devices. – Gartner
Madrid, 4th-7th of June 2012
The way forward Plan for the PC to be overtaken as the primary
computing device used by customers and employees.
Redesign websites and portals for access from mobile
devices. – Gartner
Madrid, 4th-7th of June 2012
The way forward
Madrid, 4th-7th of June 2012
Madrid, 4th-7th of June 2012
Eddy Bruin
Senior Test Consultant
Financial services
Mobile +31 6 4520 6779
Madrid, 4th-7th of June 2012
Spread the word!
For the full license check this link