29
Graphical User Interface Testing

Graphical User Interface Testing

  • Upload
    jonco

  • View
    319

  • Download
    23

Embed Size (px)

DESCRIPTION

Graphical User Interface Testing. Graphical User Interfaces. A graphical user interface ( GUI ) is composed of objects (buttons, menus) using metaphors familiar in real life. - PowerPoint PPT Presentation

Citation preview

Page 1: Graphical User Interface Testing

Graphical User Interface Testing

Page 2: Graphical User Interface Testing

Graphical User Interfaces A graphical user interface (GUI) is composed

of objects (buttons, menus) using metaphors familiar in real life.

The software user interacts with the GUI objects by performing events that manipulate the GUI objects as one would do with the real objects.

Events cause deterministic changes to the state of the software that may reflected by a change in the appearance of one or more GUI objects.

Page 3: Graphical User Interface Testing

GUI Hierarchy

GUIs, by their vary nature, are hierarchical. This hierarchy is reflected in the grouping of

events in windows, dialogs, and hierarchical menus that can be tested in isolation.

Since there are a large number of possible permutations of GUI events, this grouping of events decomposes GUI into manageable GUI components.

Page 4: Graphical User Interface Testing

A Formal Definition of GUI A GUI is a hierarchical, graphical front-end to

a software that accepts as input user-generated and system-generated events from a fixed set of events and produces deterministic graphical outputs.

A GUI contains graphical objects and each object has a fixed set of properties.

At any time during the execution of the GUI, these properties have discrete values, the set of which constitutes the state of the GUI.

Page 5: Graphical User Interface Testing

Modal Windows

A modal window is a GUI window that once invoked, monopolizes the GUI interaction, restricting the focus of the user to a specific range of events within the window, until the window is explicitly terminated.

The language selection window in MS Word is an example of a modal window.

Page 6: Graphical User Interface Testing

Modeless Windows

Other windows in the GUI are called modeless windows that do not restrict the user’s focus; they merely expand the set of GUI events available to the user.

In the MS Word, performing the event Replace opens a modeless window entitled Replace.

Page 7: Graphical User Interface Testing

GUI Components

At all times during interaction with the GUI, the user interacts with events within a modal dialog.

This modal dialog consists of a modal window X and a set of modeless windows that have been invoked, either directly or indirectly by X.

The modal dialog remains in place until X is explicitly terminated.

Intuitively, the events within the modal dialog form a GUI component.

Page 8: Graphical User Interface Testing

A Formal Definition of GUI Components A GUI component C is an ordered pair (RF, U

F), where RF represents a modal window in terms of its events and UF is a set whose elements represent modeless windows also in terms of their events. Each element of UF is invoked either by an event in UF or RF.

An example of a GUI component is the FileOpen modal window (and its associated modeless windows) found in most of today’s software.

Page 9: Graphical User Interface Testing

Event Interleaving

By definition, events within a component do not interleave with events in other components without the components being explicitly invoked or terminated.

Page 10: Graphical User Interface Testing

Classification of GUI Events

Restricted–focus events. Unrestricted–focus events. Termination events. Menu-open events. System-interaction events.

Page 11: Graphical User Interface Testing

Restricted-Focus Events

Restricted–focus events open modal windows.

The Set Language event in MS Word is an example.

Page 12: Graphical User Interface Testing

Unrestricted–Focus Events

Unrestricted–focus events open modeless windows.

The Replace event in MS Word is an example.

Modeless windows also need to be explicitly terminated.

Page 13: Graphical User Interface Testing

Termination Events

Termination events close modal windows. Common examples include the Ok and

Cancel events.

Page 14: Graphical User Interface Testing

Menu-Open Events

Menu-open events are used to open menus. They expand the set of events available to

the user. Menu-open events do not interact with the

underlying software. Common examples include the File and Edit

events.

Page 15: Graphical User Interface Testing

System-Interaction Events

System-interaction events interact with the underlying software to perform some action.

Common examples include the Copy event used for copying objects to the clipboard.

Page 16: Graphical User Interface Testing

An Example: MS WordPad

Component Menu System Restricted Unrestricted Termination SumName Open Interaction Focus Focus

Main 7 27 19 2 1 56FileOpen 0 8 0 0 2 10FileSave 0 8 0 0 2 10Print 0 9 1 0 2 12Properties 0 11 0 0 2 13PageSetup 0 8 1 0 2 11FormatFont 0 7 0 0 2 9

Sum 7 78 21 2 13 121

Page 17: Graphical User Interface Testing

Event-Flow Graphs

An event-flow graph for a GUI component C is a 4-tuple <V, E, B, I> where:

V is a set of vertices representing all the events in the components.

E V V is a set of directed edges between vertices. (vx, vy) E if vx immediately follows vy.

B V is the set of events that are available when C is first invoked.

I V is the set of restricted-focus events.

Page 18: Graphical User Interface Testing

An Example: MS WordPad

File

Edit

Help

SaveOpen

Copy PasteCut

About Contents

To File, Editand Help

To File, Editand Help

Page 19: Graphical User Interface Testing

Integration Trees

An integration tree is a 3-tuple <N, R, B>, where: N is the set of components in the GUI. R N is a designated component called the Ma

in component. We say that a component Cx invokes componen

t Cy if Cx contains a restricted-focus event ex that invokes Cy.

B N N is the set of directed edges showing the invoking relation between components.

Page 20: Graphical User Interface Testing

An Example: MS WordPad

Main

PageSetupFileOpenFileSave

Filenew

ViewOptions

FormatFont

Print

Properties

Page 21: Graphical User Interface Testing

Testing Coverage Criteria

Intra-component coverage Inter-component coverage

Page 22: Graphical User Interface Testing

Intra-Component Coverage Criteria Event coverage: each event (or vertex) in the

component is performed at least once. Event-interaction coverage: each edge (vx, vy)

in the component is performed at least once. Length-n event-sequence coverage: each ev

ent-sequence of length n is performed at least once.

Page 23: Graphical User Interface Testing

Inter-Component Coverage Criteria Invocation coverage: each restricted-focus eve

nt in the GUI is performed at least once. Invocation-termination coverage: each length

2 event sequence (ei, ej) in the GUI is performed at least once, where ei invokes component Cx and ej terminates component Cx.

Intercomponent length-n event-sequence coverage: each event-sequence of length n that starts with an event in one component and ends with an event in another component is performed at least once.

Page 24: Graphical User Interface Testing

Testing Coverage Criteria Hierarchy

invocation

event

event-interaction

length-n event-sequence

invocation-termination

intercomponentlength-n event-sequence

Page 25: Graphical User Interface Testing

Total Number of Event Sequences

Component Event-Sequence LengthName 1’ 2’ 1 2 3 4 5 6Main 56 791 14354 255720 4490626 78385288FileOpen 10 80 640 5120 40960 327680FileSave 10 80 640 5120 40960 327680Print 12 108 972 8748 78732 708588Properties 13 143 1573 17303 190333 2093663PageSetup 11 88 704 5632 45056 360448FormatFont 9 63 441 3087 21609 151263Print+Properties 1 2 13 260 3913 52520 663013Main+FileOpen 1 2 10 100 1180 17160 278760 Main+FileSave 1 2 10 100 1180 17160 278760 Main+PageSetup 1 2 11 110 1298 18876 306636 Main+FormatFont 1 2 9 81 909 13311 220509 Main+Print+Properties 12 145 1930 28987 466578

Page 26: Graphical User Interface Testing

GUI Testing Tools: GUITAR

GUITAR is a GUI Testing Framework that presents a unified solution to the GUI testing problem.

Our emphasis has been on developing new event-based tools and techniques for various phases of GUI testing.

http://www.cs.umd.edu/~atif/GUITARWeb/

Page 27: Graphical User Interface Testing

GUI Testing Tools: Abbot

Abbot helps you test your Java UI. It comprises Abbot, which lets you programm

atically drive UI components, and Costello (built on Abbot) which allows you to easily launch, explore and control an application.

The framework may be used with both scripts and compiled code.

http://abbot.sourceforge.net/doc/overview.shtml

Page 28: Graphical User Interface Testing

GUI Testing Tools: JFCUnit

An extension to the JUnit framework that enables you to execute unit tests against code that presents a Swing GUI based interface.

Recording and playback to/from XML allows novice GUI developers to generate and execute tests.

https://sourceforge.net/projects/jfcunit/

Page 29: Graphical User Interface Testing

GUI Testing Tools: UISpec4J

UISpec4J is an Open Source functional and/or unit testing library for Swing-based Java applications, built on top of the JUnit test harness.

http://www.uispec4j.org/index.html