36
Cloud based Testing for Mobile Apps Dada Mote XORIANT Solutions Pvt. Ltd.

Cloud based Testing Mobile Apps

Embed Size (px)

DESCRIPTION

Session Presented at 2nd IndicThreads.com Conference On Software Quality held on 25-26 March 2011 in Pune, India. WEB: http://Q11.IndicThreads.com

Citation preview

Page 1: Cloud based Testing Mobile Apps

Cloud based Testing for Mobile Apps

Dada MoteXORIANT Solutions Pvt. Ltd.

Page 2: Cloud based Testing Mobile Apps

Agenda

• Testing Mobile Apps• Limitations• Emerging Trends • Cloud Based Testing for Mobile Apps• Clouds types for Mobile Apps Testing• Features of Cloud based Testing• Test Planning and Best Practices• Future Scope –Cloud Automation Engagement

Page 3: Cloud based Testing Mobile Apps

Mobile-Smart Phones Requests

Page 4: Cloud based Testing Mobile Apps

Introduction

• Growth of Mobile Platforms

• Growth of Vendors

• Types of Mobile Apps

• Biggest challenge:o ‘How to Test?’

Page 5: Cloud based Testing Mobile Apps

Testing Pre-Installed Mobile Apps

• Core data activities • Functionality & Usability• Automatic upgrades • Cannot be Un-installed • Testing on ‘Prototype device’

Page 6: Cloud based Testing Mobile Apps

Testing Installable Mobile Apps

• Downloading & Upgrading• Download through Wired /

Wireless Mediao AppStore, Online-URL, Transfer

via USB, BlueTooth, InfraRed• Installation and Un-Installation• Platform Specific

Page 7: Cloud based Testing Mobile Apps

Testing Browser Based Mobile Apps

• Supported Mobile Browserso Opera, Skyfire, Teashark, bolt,

Blazer

• Accessibility and security• Availability scenarios• Real Location

Page 8: Cloud based Testing Mobile Apps

Testing Performance/Functionality

• Various Network Strengths

• Various Network Speeds

• Various Network Types 2G, 3G & Wi-Fi

Page 9: Cloud based Testing Mobile Apps

Testing Performance/Functionality

• Availability of Free Memory

• Memory Usage Patterno Launched, Run, Exit, Run for long timeo Memory Consumption Pattern (RAM)

• Multi-applications run while AUT is Run

Page 10: Cloud based Testing Mobile Apps

Testing Performance/Functionality

• Continually Upgrading Devices & Apps

• Backward Compatibility

• MSP and Vendor Impact

• Battery Consumption Patterno Various Battery Strengths

Page 11: Cloud based Testing Mobile Apps

Testing Compatibility/Functionality

• Various Input Modes

• Different screen sizes and Resolutions

• Various Interruptions while AUT iso Launched, Run, Exit, Installed, Upgraded

Page 12: Cloud based Testing Mobile Apps

Traditional Apps Testing- Simulators

• Advantageso Finding issues in early stage, o Non-availability of device

• Disadvantageso Resemblance of the deviceo Test environment & i/o related issueso Actual end user scenarios o Network, location related scenarios

Page 13: Cloud based Testing Mobile Apps

Mobile Apps Testing - Challenges

• Testing is not straight forward• Simulators are not Reliable• Real Test Bed

o Real Devices Availability, Devices w/ limited resources, Versions

o Real Network Operators, Infrastructure, Location

Page 14: Cloud based Testing Mobile Apps

Requirement of Ideal Testing Platform

• Easy access & Full control to many phones• Enable all types of Testing • Integrate with existing MDLC/MDF • Generate Reports Easily• Enhance Collaboration among distributed

teams

Page 15: Cloud based Testing Mobile Apps

Emerging Trends

• Advanced Testing Process• Automation Testing

o Mobinium, Robotium, QTP w/ M-Eux

• Out-Sourcing to Real Test Bedo Beta Testing, Crowd-Sourced Testing

• Remote Real Devices• Cloud based Testing Approach

Page 16: Cloud based Testing Mobile Apps

General Cloud based Services

• Featureso Pay as you use o Any service any timeo Use of Virtualizationo Resources Availabilityo Scale-up and Scale-down o Adopt changing conditions

Page 17: Cloud based Testing Mobile Apps

General Cloud based Services- Types

• Cloud Serviceso SaaS, PaaS, IaaS, Taas

• Cloud Types o Private Cloud

Owned, Hosted, Dedicated o Public Cloud

Hosted, Shared

Page 18: Cloud based Testing Mobile Apps

Why Cloud based Approach for Mobile?

• Real Test Bed• Dynamic mobile landscape• Comprehensive Testing • Efficient Testing • Compatibility• Service Quality across devices

Page 19: Cloud based Testing Mobile Apps

Cloud based Testing for Mobile Apps

• Web based secure access • Control to Many Real/Actual

Devices• Testing in Live Networks• Different Geo-locations

globally

Page 20: Cloud based Testing Mobile Apps

Cloud based Testing for Mobile Apps

• Control on Testing process

• Agile Enterprises can control the Cloud to keep the Apps and services up-to-date with Newest Handsets

• Huge Revenue opportunities w/ gain in the market value

Page 21: Cloud based Testing Mobile Apps

Mobile Cloud Overview

• 100% Web based S-a-a-S Platform• Holding the handset• Install Application from PC to Device• Send numbers to the device using keyboard• Simulate handset events in single click• Capture screenshots and videos

Page 22: Cloud based Testing Mobile Apps
Page 23: Cloud based Testing Mobile Apps

M-Cloud Infra Elements

• Sync Engine• Web2.0 Portal• Device Management• Data Adapters• Push Notifications• Aggregation

Page 24: Cloud based Testing Mobile Apps

M-Cloud Infra Elements

• Rapid Development• Conflict Resolution• Core Apps• Privacy and Access• Scalability

Page 25: Cloud based Testing Mobile Apps

M-Cloud Connectivity

Page 26: Cloud based Testing Mobile Apps

Specific Types of M-Cloud

• Private M-Cloud o Owned, Dedicated, Hosted

• Public M-Cloudo Hosted, Shared

• Single Platform Cloud• Full Mobile Cloud

o Devices from All platforms

Page 27: Cloud based Testing Mobile Apps

M-Cloud -Public Shared Devices

• Book time slot for Specific Devices• Specify Mobile Networks, Geo-locations• Keep Updated the Test Plan• Complete testing activity within time• Security and Performance testing is crucial

Page 28: Cloud based Testing Mobile Apps

M-Cloud -Private Dedicated Devices

• Secured Devices• Change/upgrade of devices within cloud• Pool of Devices is part of Test strategy• Network should be part of test strategy• Choose betn hosted and on-premise devices

Page 29: Cloud based Testing Mobile Apps

Services by M-Cloud Owner

• Lab with Versions of devices

• Setup Frameworks• Mobile Cloud Switch• Connection Utilities • Generate the Reports

Page 30: Cloud based Testing Mobile Apps

Features of M-Cloud

• Highest level of Reliability• Device with Active Mobile plans

o Call, SMS, install apps, browse facility• Availability of Latest & upcoming Devices • 24x7 applications and performance monitoring• Reserve Devices whenever you need

Page 31: Cloud based Testing Mobile Apps

M-Cloud Future Scope

Page 32: Cloud based Testing Mobile Apps

Best Practices - Test Planning

o Setup the Test Bed Identify the Resources on M-Cloud

o Identify Test Cases for M-Cloudo Identify Test Data Regulations in advanceo Simulate the End User Experienceo Consider the Response Timeso Follow International Requirementso Identify Risk based scenarios

Page 33: Cloud based Testing Mobile Apps

Best Practices – Test Execution

• Select proper/specific M-Cloudo Location, platform, Device dependent

• Connect to Device on M-Cloud and • Port the Apps on the Device• Identify applicable Testing types• Test across Multiple devices• Testing skills for Test engineers• Execute specific Tests related to

o Performance, Security, Accessibility, Availability

Page 34: Cloud based Testing Mobile Apps

M-Cloud Implementation Challenges

• Firewall Exceptions & Remote configurations• Application Tuning• Storage and Bandwidth cost• Cross Cloud Alignment bottlenecks• Failover Testing for disaster recovery• Elasticity and scalability- False positives• Security and performance issues

Page 35: Cloud based Testing Mobile Apps

Xoriant Services For Mobile Apps• Multiplatform Mobile Apps Development

• Testing Framework for various platforms w/ M-Cloud services

• Trained M-Cloud Mobile Apps Test Experts

• Continuous Testing Improvement in M-Cloud Services

Page 36: Cloud based Testing Mobile Apps

THANK YOU!DADA MOTE

[email protected]

www.xoriant.com

VISIT www.xoriant.com/mobile-applications.html TO RECEIVE A PROMOTIONADVERTISING

CREDIT