31
Users’ Quality Ratings of Handheld devices: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Investigating the Most Important Sense among Vision, Hearing and Touch Vision, Hearing and Touch issertation 2 Dissertation 2

Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

Embed Size (px)

Citation preview

Page 1: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

Users’ Quality Ratings of Handheld devices:Users’ Quality Ratings of Handheld devices:

Supervisor: Dr. Gary Burnett

Student: Hsin-Wei Chen

Investigating the Most Important Sense among Investigating the Most Important Sense among Vision, Hearing and TouchVision, Hearing and Touch

Disser

tation

2006

Disser

tation

2006

Page 2: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 2

AgendaAgenda

IntroductionResearch BackgroundResearch MotivesResearch PurposesResearch Process

Literature ReviewUser InterfaceHuman-computer InteractionHCI-HumanHCI-Technology

MethodologyField ExperimentParticipantsStudy Equipment

Analysis and DiscussionObjective ResultsSubjective Results

ConclusionConclusionLimitations and Future Study

Page 3: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 3

Research Background Research Background 11

The high-speed growth of technology The great increase in consumers’ needs

Mobility Portability

IntroductionBackground Motives Purposes Process

Handheld devices

Desktops

Mobile phonesPortabil

ity

LaptopsPalmtop

s

Handheld

devices

Source: Weiss (2002), pp. 3

Page 4: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 4

Research Background Research Background 22

The important information designers need

Designers shall try to understand users of products (Norman, 1988).

Humans perceives quality through three primary senses: visual, hearing and touch senses (Wickens et al., 1998).

IntroductionBackground Motives Purposes Process

Page 5: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 5

Research MotivesResearch Motives

In practice Human perception of quality A better design of product

In research Human senses: single and multi-sensory

modalities In car switches (Burnett and Irune, 2005) -->

Computing devices

IntroductionBackground Motives Purposes

Process

Visual issuesHearing issuesTouch issues

Page 6: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 6

Research PurposesResearch Purposes

Observe the current design of handheld devices (Mobile phones).

Investigate the relative contribution of three primary senses to the perception of quality.

Make suggestions to the manufacturers.

IntroductionBackground Motives Purposes Process

Page 7: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 7

Research Process Research Process 11

IntroductionBackground Motives Purposes Process

Literature Review

Observation

Literature Review

ObservationProblems DefinitionProblems Definition

Pilot Experiment Design

Pilot Experiment Design

Pilot Experiment Implementation

Pilot Experiment Implementation

Pilot Experiment Evaluation

Pilot Experiment Evaluation

2. Pilot Experiment Conduction

1. Problem Definition

Not Accepted

Accepted

Page 8: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 8

Research Process Research Process 22

IntroductionBackground Motives Purposes Process

User trialsUser trials QuestionnaireQuestionnaire

Statistical analysesStatistical analyses

ConclusionSuggestions

ConclusionSuggestions

Accepted

Experiment DesignExperiment Design

3. Experiment conduction

4. Analysis and Discussion

5. Conclusion

Page 9: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 9

LLiterature review frameworkiterature review framework

Literature ReviewUser Interface HCI HCI-Human HCI-Tech

Interface

Interaction-Perception

Interface

Interaction-Perception

Handheld devices

Handheld devicesUsersUsers

Input

Output

Humans Technology

PrimarySenses

QualityRating

Page 10: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 10

LLiterature review frameworkiterature review framework

Literature ReviewUser Interface HCI HCI-Human HCI-Tech

Handheld devices

Handheld devicesUsersUsers

Input

Output

Humans Technology

PrimarySenses

QualityRating

Page 11: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 11

LLiterature review frameworkiterature review framework

Literature ReviewUser Interface HCI HCI-Human HCI-Tech

Handheld devices

Handheld devicesUsersUsers

Input

Output

Humans Technology

PrimarySenses

QualityRating

Page 12: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 12

User Interface User Interface 11

Definition of user interface

NOT just today’s graphical user interfaces (GUIs)

User interface is the way that users achieve their goals with a product in relation to what you do and how a device responds. (Raskin, 2003; Hackos and Redish , 1998)

Literature ReviewUser Interface HCI HCI-Human HCI-Tech

Page 13: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 13

User Interface User Interface 22

Types of user interface (Lindholm et al., 2003)

Hardware User Interface (Hardware UI)The hardware UI contains the layout of control devices and display screens, snap-on cover mechanism and accessory connectors.

Software User Interface (Software UI)The software user interface contains the layout of the menu structures, interaction logic, control key combinations and other system design.

Literature ReviewUser Interface HCI HCI-Human HCI-Tech

Page 14: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 14

Human-Computer Interaction Human-Computer Interaction (HCI) (HCI) 11

Definition of HCI

The interaction between humans and computers includes not only the interface between them, but also all interactive objects (Hartson , 1998).

HCI is the study of interactions between users and handheld devices, such as mobile phones in this study.

Literature ReviewUser Interface HCI HCI-Human HCI-Tech

Page 15: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 15

Literature ReviewUser Interface HCI HCI-Human HCI-Tech

Human-Computer Interaction Human-Computer Interaction (HCI) (HCI) 22

Goals of HCI

High Usability

Definition of usabilityThe extent to which a product can be used by specified users with effectiveness, efficiency, and satisfaction in a specified context of use. (ISO 9241)

--> The scope of human-focued quality

High effectivenessHigh efficiencyHigh satisfaction

Page 16: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 16

Literature ReviewUser Interface HCI HCI-Human HCI-Tech

SENSORYREGISTER

SENSORYREGISTER

Perception

Perception

Attention Resource

Attention Resource

ThoughtDecision Making

ThoughtDecision Making

LONG-TERM MEMORYLONG-TERM MEMORY

WORKINGMEMORY

WORKINGMEMORY

ResponseSelectio

n

ResponseSelectio

n

ResponseExecutio

n

ResponseExecutio

n

Feedback

Stimul

i

Source: Raskin (2003), pp. 147; Eberts (1994), pp. 166

HCI-Human HCI-Human 11 Generic model of human information processing

Page 17: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 17

Literature ReviewUser Interface HCI HCI-Human HCI-Tech

HCI-Human HCI-Human 22

Three primary senses Vision

Vision is the dominant sense that users use when interacting with computers (Sutcliffe, 1995; Johnson et al., 2006).

HearingVision and touch, can easily dominate the sense of hearing, or even diminish it (Dix, 1998; Riederer, 2001; Guttman et al., 2005).

TouchTouch is the most important senses to the perception in in-car switches (Burnett and Irune, 2005).

Page 18: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 18

Literature ReviewUser Interface HCI HCI-Human HCI-Tech

Source: Steenkamp (1990), pp.323

Cues in the environment

Cues in the environment

Intrinsic quality cue beliefs

Intrinsic quality cue beliefs

Extrinsic quality cue beliefs

Extrinsic quality cue beliefs

Experience quality attribute beliefs

Experience quality attribute beliefs

Credence quality attribute beliefs

Credence quality attribute beliefs

Perceivedquality

Perceivedquality

Personal and situational factors

Personal and situational factors

HCI-Human HCI-Human 33 Quality Perception Process Conceptual Model

Page 19: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 19

HCI-TechnologyHCI-Technology

Handheld devices (Weiss, 2002) Handheld devices are computing and

communication devices. Handheld devices are usable and useful held

in one person’s hand.

Types of handheld devices Mobile phones Pages Personal Digital Assistants (PDAs)

Literature ReviewUser Interface HCI HCI-Human HCI-Tech

Page 20: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 20

ExperimentsExperiments

Pilot experiment To avoid unexpected variables affecting the

results of the actual experiment. Acquire all of the suggestions and information

from the pilot experiment participants.

Field experiment Unlike the laboratory experiment, a field

experiment would not control all o the other variables precisely.

A field experiment could be an effective form of research method for mobile HCI research (Love, 2005).

Field experiment Participants Study equipment

Methodology

Page 21: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 21

Participants Participants 11

Field experiment Participants Study equipment

Methodology

Nationalities of participants

5

9

7

4

3

11

1 1

BritishTaiwaneseChineseGreekTurkishGermanCypriotChileanBrazilian

Non-Asian

Asian

Page 22: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 22

Field experiment Participants Study equipment

Methodology

Non-Asian

Asian

Participants Participants 22

No. The order of conditions (mobiles in random orders)

1~8 Only hearing Only touch Only visionAll

9~16 Only touch Only hearing Only visionAll

17~24Hearing & Touch

Touch & VisionHearing & Vision

All

25~32Hearing & Touch

Hearing & Vision

Touch & VisionAll

Note: Males and females/ Non-Asian and Asian are distributed in the same ratio.

Page 23: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 23

Study Equipment Study Equipment 11

Only vision, only hearing, only touch and all senses

Field experiment Participants Study equipment

Methodology

Page 24: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 24

Study Equipment Study Equipment 22

No vision, no hearing, no touch and all senses

Field experiment Participants Study equipment

Methodology

Page 25: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 25

Objective Results Objective Results 11

Quality mean ratings / preference analysis Mobile phone D is most appealing to participants Vision and touch make most contributions and

hearing makes less contribution to the perception of quality.

Correlation analysis Vision is the most important sense Hearing is the less important sense

Objective results Subjective results

Analysis and Discussion

Page 26: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 26

Objective Results Objective Results 22

Regression analysis Mobile phone A

Only Vision make the most contribution to the perception of quality.

Mobile phone D Vision and touch make most contribution to the

perception of quality

Interesting topic: Why touch also plays important role on

perception of quality for mobile phone D?

Objective results Subjective results

Analysis and Discussion

Page 27: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 27

Objective Results Objective Results 33

Objective results Subjective results

Analysis and Discussion

The keypads

Page 28: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 28

Subjective ResultsSubjective Results

Why are the important senses for handheld devices (e.g. vision and touch) and for in-car switches (e.g. touch) are different?

Emotional issues Capability issues Social issues (Vincent,

2005)

Emotional values and capabilities Vision --> Emotional values Touch --> Capabilities

Objective results Subjective results

Analysis and Discussion

Page 29: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 29

ConclusionConclusion

Vision is the most important sense for perceiving the quality of handheld devices.

Touch is the second most important sense in the perception of quality.

Hearing contributes less to the perception of quality.

ConclusionConclusion Limitations and future study

Page 30: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

11/09/2006 Dissertation 2006 Hisin-Wei Chen 30

Limitations and Future StudyLimitations and Future Study

Observations The important characteristics of vision and

touch

Experimental design Laboratory experiment implemented Software user interface included Extrinsic quality cues/ Credence quality

attributes included

Entities selection Other devices selected (e.g. Pages, PDAs)

ConclusionConclusion Limitations and future study

Page 31: Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing

Thank you for your listening!Thank you for your listening!