28
Responsive Web Design: Testing to Deliver a Consistent User Experience April 2016 Adam Carmi Co-Founder, VP R&D – Applitools Eran Kinsbruner Dir. Technical Evangelist Perfecto Uzi Eilon Director of Technology Perfecto Adam Carmi Co-Founder, VP R&D Applitools

Responsive Web Design: Testing to Deliver a Consistent User Experience

Embed Size (px)

Citation preview

Page 1: Responsive Web Design: Testing to Deliver a Consistent User Experience

Responsive Web Design: Testing to Deliver a Consistent User ExperienceApril 2016

Adam CarmiCo-Founder, VP R&D –

Applitools

Eran KinsbrunerDir. Technical Evangelist

Perfecto

Uzi EilonDirector of Technology

Perfecto

Adam CarmiCo-Founder, VP R&D

Applitools

Page 2: Responsive Web Design: Testing to Deliver a Consistent User Experience

Agenda

05/03/2023 2© 2015, Perfecto Mobile Ltd. All Rights Reserved.

01 RWD Introduction

02 RWD Test Plan Building Blocks

03 Live Demonstrations

04 Q & A

Page 3: Responsive Web Design: Testing to Deliver a Consistent User Experience

Responsive Web Design (RWD) - Definition

05/03/2023 3© 2015, Perfecto Mobile Ltd. All Rights Reserved.

Responsive web design (RWD) is an approach to web design to provide an optimal viewing and interaction experience—easy reading and navigation with a minimum of resizing, panning, and scrolling—across a wide range of devices (from desktop computer monitors to mobile phones)

Page 4: Responsive Web Design: Testing to Deliver a Consistent User Experience

RWD vs Non RWD

https://github.com

vs

https://en.wikipedia.org

05/03/2023 4© 2015, Perfecto Mobile Ltd. All Rights Reserved.

Page 5: Responsive Web Design: Testing to Deliver a Consistent User Experience

Drivers & Benefits To Moving to RWD

05/03/2023 5© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Provide consistent DX and coverage across all

digital platforms

Support end user work flow across multi

screens

Consolidate resources & align business goals

across platformsBe ready for any new OS/Platform release

faster

Page 6: Responsive Web Design: Testing to Deliver a Consistent User Experience

Building Blocks for RWD Testing

05/03/2023 6© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Page 7: Responsive Web Design: Testing to Deliver a Consistent User Experience

© 2016, Perfecto Mobile Ltd. All Rights Reserved. 05/03/2023 7

Digital Test CoverageChoosing The Right

Platforms

Page 8: Responsive Web Design: Testing to Deliver a Consistent User Experience

Mobile Test Coverage Method

Page 9: Responsive Web Design: Testing to Deliver a Consistent User Experience

Web Test Coverage Method (cont’)

FireFoxTest on Latest,

Previous and Beta on 3 Major

Windows OS

ChromeTest on Latest and Previous against 3

major windows OS and 2 major

Mac OS. Add Beta testing on latest

Windows and latest Mac

SafariTest on latest

version against 3 Mac OS +

previous 2 on their reference OS

(e.g. Safari 9, El Capitan)

IE/EdgeTest IE 11 on

Windows 7, 8.1, 11 and Edge latest

on Windows 10

Page 10: Responsive Web Design: Testing to Deliver a Consistent User Experience

© 2016, Perfecto Mobile Ltd. All Rights Reserved. 05/03/2023 10

User Condition Testing for RWD Sites

Page 11: Responsive Web Design: Testing to Deliver a Consistent User Experience

• Locations & context• Playing Video across platforms, different screen orientations• Incoming events and interrupts • Mobile – Calls, SMS, BG apps pop ups• Web – ads, plugins

• Network conditions• Poor, good, no network

User Condition Testing

05/03/2023 11© 2015, Perfecto Mobile Ltd. All Rights Reserved.

Page 12: Responsive Web Design: Testing to Deliver a Consistent User Experience

© 2016, Perfecto Mobile Ltd. All Rights Reserved. 05/03/2023 12

Visual Testing

Page 13: Responsive Web Design: Testing to Deliver a Consistent User Experience

WHAT IS VISUAL TESTING?

A quality assurance activity to verify

that a Graphical User Interface

appears correctly to users

Page 14: Responsive Web Design: Testing to Deliver a Consistent User Experience
Page 15: Responsive Web Design: Testing to Deliver a Consistent User Experience
Page 16: Responsive Web Design: Testing to Deliver a Consistent User Experience

WHY AUTOMATE?

The test matrix is too big to cover manually

• Web browsers• Devices• Operating systems• Screen resolutions• Responsive design• L10n• 3rd Party upgrades

Page 17: Responsive Web Design: Testing to Deliver a Consistent User Experience

WHY AUTOMATE?

Release cycles keep getting shorter

Page 18: Responsive Web Design: Testing to Deliver a Consistent User Experience

HOW DOES IT WORK?

Drive the AUT and take screenshots

Compare screenshots with baseline images

Report differences

Update the baseline

Page 19: Responsive Web Design: Testing to Deliver a Consistent User Experience

+ +

+ +

DEMO

Page 20: Responsive Web Design: Testing to Deliver a Consistent User Experience

05/03/2023 20© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Visual Testing Is Critical For RWD!

The majority of RWD bugs are visual and can’t be detected using traditional functional test automation tools• Assure that Important page content is visible in all resolutions

and screen orientations• Test the Alignment, size, style and color of text, controls and images• Validate that Elements aren’t cut at the edges of the screen• Assure that Typed text (data entry) scrolls and displays properly

Page 21: Responsive Web Design: Testing to Deliver a Consistent User Experience

© 2016, Perfecto Mobile Ltd. All Rights Reserved. 05/03/2023 21

DemonstrationClient Side Performance and

Navigation Testing

Page 22: Responsive Web Design: Testing to Deliver a Consistent User Experience

Client Side Performance – Optimize for great UX

05/03/2023 22© 2016, Perfecto Mobile Ltd. All Rights Reserved.

• Relevant content and content compression• Size allocation• Load testing KPI’s across platforms and networks• Varying locations measurements• Measure UI rendering time

Source: HTTPArchive.org

Page 23: Responsive Web Design: Testing to Deliver a Consistent User Experience

05/03/2023 23© 2015, Perfecto Mobile Ltd. All Rights Reserved.

Client Side Performance Testing

Backend Web Server

Page 24: Responsive Web Design: Testing to Deliver a Consistent User Experience

05/03/2023 24© 2015, Perfecto Mobile Ltd. All Rights Reserved.

Demo Flow – Navigation Testing

Perfecto Digital Lab

reports

One script Resources selection

Side by side

Execution data

Page 25: Responsive Web Design: Testing to Deliver a Consistent User Experience

05/03/2023 25© 2015, Perfecto Mobile Ltd. All Rights Reserved.

Script Flow

Load time

Visual validation

Page 26: Responsive Web Design: Testing to Deliver a Consistent User Experience

05/03/2023 26© 2015, Perfecto Mobile Ltd. All Rights Reserved.

One Script for all Digital Platforms

Time Validation

Page selection

Objects locator

Data InputPage action

Page 27: Responsive Web Design: Testing to Deliver a Consistent User Experience

Special Offers to Webinar Attendees

05/03/2023 27© 2015, Perfecto Mobile Ltd. All Rights Reserved.

Free WhitepaperComplete Guide to Building a Responsive Web Testing Strategy

http://info.perfectomobile.com/responsive-web-design-testing-paper.html

Free “Visually Perfect” T-shirt(1) Open your Free Applitools Eyes account http://bit.ly/1s49J2X (2) Run your first visual test(3) Email test results to [email protected](4) Get your new “Visually Perfect” t-shirt

Page 28: Responsive Web Design: Testing to Deliver a Consistent User Experience

Thank You for Joining Us