ICT325 Human Computer Interaction Assignment 1-1

Using a contingent heuristic approach for the usability evaluation of web sites

A case study of Flash vs. HTML-based web sites

Pilun PiyasirivejDIT Candidate, Murdoch University

ICT325 Human Computer Interaction Assignment 1-2

Purpose of the research

• Contingent heuristic approach (WUCET) can be effectively used to evaluate the usability of web sites

• Usability of Flash vs. HTML-based web sites still in question

• Many web sites contain both Flash and HTML versions

• High maintenance costs, inconsistencies• WUCET generates relevant usability statements

for each web site that can be rated by the users

ICT325 Human Computer Interaction Assignment 1-3

Structure of the survey

• Two groups of participants: (a) Flash (b) HTML• Each participant visits six web sites, either all in Flash

or all in HTML (randomly assigned)• Find information from each web site to answer the

questions provided• Evaluate the usability of these web sites by rating

your agreement with the statements provided• For each statement, you can select: strongly

disagree, disagree, neutral, agree, and strongly agree• Option to provide your comments about the ease of

use of these web sites in your own words

ICT325 Human Computer Interaction Assignment 1-4

How to complete the survey

1. Complete the consent form and submit it to Andrew or Diana

2. Submit your name and e-mail at http://www.pilun.com/research/register.htm before 20 March

3. You will receive an e-mail from Pilun before 22 March, otherwise please contact Pilun (wus2004@pilun.com), Andrew, or Diana

4. Complete the survey before 1 April5. Complete the assignment and submit it (with

completed handout) by 7 April

ICT325 Human Computer Interaction Assignment 1-5

Procedures

• Click the link provided in the e-mail you received (or copy and paste the URL in your browser)

ICT325 Human Computer Interaction Assignment 1-6

Background information

ICT325 Human Computer Interaction Assignment 1-7

Procedures for each web site

• First, click the link provided, it will open a web site in a new window (you should maximize it)

• If and only if you cannot view the web site for any reason, select “no” to the question “Could you view…web site?” then state the reason and continue to the next web site

ICT325 Human Computer Interaction Assignment 1-8

Procedures for each web site (cont’d)

Start the timer at the top left of the window

Find information on the web site and answer the questions provided in the handoutStop the timer and write down the time you used on the space provided in the handout

ICT325 Human Computer Interaction Assignment 1-9

Procedures for each web site (cont’d)

• Rate the statements provided in the handout and write comments in your own words in the box at the bottom of the sheet

• Go back to the online survey and select “yes” to the question “Could you view… web site?” and copy your responses from the handout into the online survey

• Click “Next” to proceed to the next web site. When you finish all web sites, click the “Submit” button

ICT325 Human Computer Interaction Assignment 1-10

References

Dunstan, R. (2003). Towards a contingent approach to evaluation of WWW site usability: A comparative study. Unpublished honors thesis, Murdoch University, Australia.

Turk, A. (2000). A contingency approach to designing usability evaluation procedures for WWW sites. Proceedings of the 7th European Conference on IT Evaluation, Dublin, Ireland, 41-47. Reading, UK: MCIL.

Turk, A. (2001). Towards contingent usability evaluation of WWW sites. Proceedings of OZCHI 2001, Perth, Australia, 161-167.