Testing a new mobile world - Eddy Bruin

Madrid, 4th-7th of June 2012

Testing a new (mobile) world Testing ubiquitous computing, mobile applications & devices

Madrid, 4th-7th of June 2012

•Teaser: Plaatje evolutie (zonder ubiquitous)

The information

contained in this

presentation is 1

Madrid, 4th-7th of June 2012

Who am I?

Madrid, 4th-7th of June 2012

The web is dead! Long live the internet

Madrid, 4th-7th of June 2012

Source: Morgan Stanley Research

Madrid, 4th-7th of June 2012

Madrid, 4th-7th of June 2012

Madrid, 4th-7th of June 2012

•Teaser: Plaatje evolutie (zonder ubiquitous)

Madrid, 4th-7th of June 2012

Ubiquitous computing is a post-desktop model of human-computer

interaction in which information processing has been thoroughly integrated

into everyday objects and activities. In the course of ordinary activities,

someone "using" ubiquitous computing engages many computational

devices and systems simultaneously, and may not necessarily even

be aware that they are doing so. This model is usually considered an

advancement from the desktop paradigm.

What is ubiquitous computing?

Madrid, 4th-7th of June 2012

What’s in it for software testing?

Madrid, 4th-7th of June 2012

Error 3200

What’s in it for software testing?

Madrid, 4th-7th of June 2012

What’s in it for software testing?

Madrid, 4th-7th of June 2012

What is so different about mobile applications?

Madrid, 4th-7th of June 2012

Apps & New possibilities

Madrid, 4th-7th of June 2012

We use mobile devices anywhere and anytime

Madrid, 4th-7th of June 2012

Mobile OS development is fast

0.9 1.0 1.1 1.5 2.1 2.2 1.6 2.0 2.3 3.0 4.0

Aug Sep Mar Apr Sept Oct Jan May Dec May Oct

2008 2009 2010 2011

Nov 2006 Oct

Madrid, 4th-7th of June 2012

ISO 9126

Functionality

Reliability

Usability

Efficiency

Maintainability

Portability

Interoperability

Adaptability (Hardware)

Compliance

Adaptability (Software)

0.9 1.0 1.1 1.5 2.1 2.2 1.6 2.0 2.3 3.0 4.0

Aug 08 Sep 08 Mar 09 Apr 09 Sept 09 Oct 09 Jan 10 May 10 Dec 10 May 11 Oct 11

What is so different about mobile applications?

Madrid, 4th-7th of June 2012

How is testing mobile applications different?

Madrid, 4th-7th of June 2012

How is testing mobile applications different?

• What devices to test?

• What skills do I need to be a mobile tester?

• Is the process in a mobile project special?

• When is an app approved in a app store?

• What tools can I use?

• Use simulators or not?

• How do I test Usability?

• Is the cloud involved somewhere?

Madrid, 4th-7th of June 2012

How is testing mobile applications different?

Source: OurMobilePlanet.com

Madrid, 4th-7th of June 2012

What devices to test?

Madrid, 4th-7th of June 2012

What devices to test?

• Device Marketshare

• Pixel density

• OS Version

Madrid, 4th-7th of June 2012

What devices to test?

Madrid, 4th-7th of June 2012

What devices to test?

Madrid, 4th-7th of June 2012

What devices to test?

Madrid, 4th-7th of June 2012

What devices to test?

Madrid, 4th-7th of June 2012

• New (technical) skills

• Get to know different platforms • Dev Center (test tools)

• Android development kit

• Get to know (different) devices • Portrait/landscape

• 2G/3G/WiFi - Roaming

• GPS

• Gestures

• Check memory warnings

• Multi task

• Telephone functions

What skills do I test mobile applications?

Madrid, 4th-7th of June 2012

How is testing mobile applications different?

• Execute app store tests

• Extra requirements

• Release management

• Test in pre-production

Madrid, 4th-7th of June 2012

“If the user can’t use it. It doesn’t work”

Usability testing is a must!

How is testing mobile applications different?

Madrid, 4th-7th of June 2012

Using agile methods to develop mobile apps

Short iterations

Regression testing

Expensive and time

consuming

Automate what can be

repeated

Amount of test work

Madrid, 4th-7th of June 2012

How is testing mobile applications different?

• New test (automation) tools

• White, Grey or black box testing

• Real devices, simulator or cloud

…And

more

Madrid, 4th-7th of June 2012

iOS – UI Automation

Madrid, 4th-7th of June 2012

iOS – UI Automation

• Set up test automation

– Join iOS Developer Program

– Get xCode dev tools pkg

– Includes UI Automation

• UI Automation

– Executes test cases on device(s)

– Test scripts written in JavaScript

– Record and playback possible

Madrid, 4th-7th of June 2012

iOS – UI Automation

Madrid, 4th-7th of June 2012

iOS – UI Automation

Madrid, 4th-7th of June 2012

iOS – UI Automation

Madrid, 4th-7th of June 2012

• Testing using robotium

• Test with source code or APK

• Learn to script in Java or…

• Execute on simulator and real devices

• Record tests using Testdroid

– Record a lot of features

– Object recognition

– Executes test cases on one device…

– …or execute in the cloud

Android – Testdroid / Robotium

Object Recognition – Resource ID’s –Indexes – Names

Madrid, 4th-7th of June 2012

Android – Robotium

Madrid, 4th-7th of June 2012

Android – Testdroid

Madrid, 4th-7th of June 2012

Android – Testdroid

Madrid, 4th-7th of June 2012

iOS & Android – Calabash

• Write tests using Calabash

• Tests iOS and Android devices

• Source is needed

• Learn to script in ruby and…

• Use BDD scripting in

Madrid, 4th-7th of June 2012

How is testing mobile applications different?

Madrid, 4th-7th of June 2012

The way forward Plan for the PC to be overtaken as the primary

computing device used by customers and employees.

Redesign websites and portals for access from mobile

devices. – Gartner

Madrid, 4th-7th of June 2012

The way forward Plan for the PC to be overtaken as the primary

computing device used by customers and employees.

Redesign websites and portals for access from mobile

devices. – Gartner

Madrid, 4th-7th of June 2012

The way forward

Madrid, 4th-7th of June 2012

Madrid, 4th-7th of June 2012

Eddy Bruin

Senior Test Consultant

Financial services

Mobile +31 6 4520 6779

eddy.bruin@capgemini.com

Madrid, 4th-7th of June 2012

Spread the word!

For the full license check this link