11

Usability Test PlansUsability Test Plans

CSSE 376 Software Quality AssuranceCSSE 376 Software Quality Assurance

Rose-Hulman Institute of TechnologyRose-Hulman Institute of Technology

April 20, 2007April 20, 2007

22

OutlineOutline

Purpose of Test PlansPurpose of Test Plans Suggested FormatSuggested Format

33

Purpose of Test PlansPurpose of Test Plans

Blueprint for testBlueprint for test Communication with development teamCommunication with development team Describes needed resourcesDescribes needed resources Milestone for testingMilestone for testing

44

Suggested FormatSuggested Format

1.1. PurposePurpose

2.2. Problem StatementProblem Statement

3.3. User profileUser profile

4.4. MethodMethod

5.5. Task listTask list

6.6. Environment/Environment/equipmentequipment

7.7. Test monitor roleTest monitor role

8.8. Evaluation Evaluation measuresmeasures

9.9. Report contentsReport contents

55

Problem StatementProblem Statement

High-level reason for performing testHigh-level reason for performing test Describe what you expect to achieve Describe what you expect to achieve

from testingfrom testing don't be vaguedon't be vague make sure that objective can be measuredmake sure that objective can be measured

Example:Example: Is help easier to access via a shortcut key or Is help easier to access via a shortcut key or

the mouse?the mouse?

66

User ProfileUser Profile

Describe end users of productDescribe end users of product Cover all important attributesCover all important attributes Cover important rangesCover important ranges

77

Example User ProfileExample User ProfileAttributeAttribute RangeRange DistributionDistribution

Computer Computer experienceexperience

none to 10 none to 10 yearsyears

10% none10% none25% 1 year25% 1 year65% 1+ years65% 1+ years

AgeAge 18-55 years18-55 years 50% 18-2550% 18-2540% 25-5040% 25-5010% over 5010% over 50

GenderGender male/femalemale/female 85% male85% male

88

Cartoon of the DayCartoon of the Day

99

MethodMethod

Describe major steps of testingDescribe major steps of testing1.1. Participant greetingParticipant greeting

2.2. OrientationOrientation

3.3. Performance testPerformance test

4.4. Participant debriefingParticipant debriefing

1010

Task ListTask List

Tasks to be performed by participantsTasks to be performed by participants Describe Successful Completion Criteria Describe Successful Completion Criteria

(SCC)(SCC) Include Maximum Time to Complete Include Maximum Time to Complete

(MTC)(MTC)

1111

Task List ExampleTask List Example

TaskTask DescriptionDescription DetailDetail

11 Select region Select region of dataof data

SCC: Correct values SCC: Correct values selectedselectedMTC: 2.0 secMTC: 2.0 sec

22 Choose Choose chart typechart type

SCC: Correct type selectedSCC: Correct type selectedMTC: 2.0 secMTC: 2.0 sec

33 Assign labelsAssign labels SCC: Correct labels SCC: Correct labels assignedassignedMTC: 10.0 secMTC: 10.0 sec

1212

Environment/EquipmentEnvironment/Equipment

Describe environment that you are Describe environment that you are attempting to simulateattempting to simulate desk arrangementdesk arrangement availability of other materialsavailability of other materials lighting, noise levellighting, noise level

Equipment needed to perform testingEquipment needed to perform testing

1313

Test Monitor RoleTest Monitor Role

Explain how test monitor will interact with Explain how test monitor will interact with participantsparticipants

Describe tasks that the monitor will Describe tasks that the monitor will performperform

1414

Evaluation MeasuresEvaluation Measures

Data that will be collectedData that will be collected performanceperformance

time to complete taskstime to complete tasks number of errors by typenumber of errors by type

preferencepreference usefulness of productusefulness of product ease of learning/useease of learning/use

1515

Report ContentsReport Contents

What you will report at the conclusion of What you will report at the conclusion of testingtesting major sections of reportmajor sections of report schedule for disseminationschedule for dissemination

Does not include analysisDoes not include analysis