Frets on Fire Usability Testing

7/31/2019 Frets on Fire Usability Testing

1/11

Frets on FireUsability Test

PurposeThe purpose of this test is to determine if the novice computer user can effectivelymake use of Frets on Fire game. This test should also determine how perceptive and

easy to learn the interface of the game.

Test Objective1. Can a first time user of the Frets on Fire game application identify commands

and understand its interface?2. Can the first time user complete the two songs of different levels of difficulty?3. Is the game interesting for the participants whose skills are in the intermediate

level?

User Profile1. Male or female2. 15-25 years old

3. Knows how to play guitar (Intermediate level)4. No prior experienced in using Frets on Fire5. Should be able to read and understand English instructions

MethodologyThe test will be given to one subject at a time. The subject will be provided with aworkstation containing the Frets on Fire game application. A manual shall also beprovided; other than that no other materials and software is needed to complete thetest. The group has the following roles during the test process.

1 Test Monitor

1 Timer

2 Data Logger 1 Observer

Test Process1. Screening

Possible participants will be asked to fill out a form to determine if thequalification of the participant fits the user profile.

2. OrientationThe participant will be briefed using an orientation script describing thetest and the basic tools and features of the game application.

3. Gathering of background informationThe group will ask the subject to elaborate his answers in the screening

form when necessary.4. Testing and data collectionThe test subjects shall be given printout manuals detailing the stepsfrom opening the application until finishing each of the tasks. Byfollowing the direction indicated in the manual, the participants shall beable to finish two songs of different levels of difficulty.

5. Post Testing


2/11

The participant shall answer a post-test questionnaire to gatherqualitative data regarding his/her experience in playing Frets on Firegame application.

6. DebriefingTo note down the participants experience, suggestions,

recommendations, and to elaborate on his answers base on the post-test.

Reporting of resultsTheir score will be summarized, analyzed, and reported. From the qualitative andquantitative data gathered, analysis, recommendations, and suggestions forimprovement will be made based on the results of the test.


3/11

Frets on FireScreening Questionnaire

Name:

Age:

Gender:

Email Address:

Do you play guitar? (Check one)

() Yes() No

Rate yourself

() Beginner() Intermediate() Advance

Highest Educational Attainment

( ) Grade School( ) High School( ) College( ) Graduate Degree

Please check which game applications you have used:

( ) Guitar Hero( ) JamLegend( ) Super Crazy Guitar Maniac

List other computer game applications you use:

____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________

Have you ever used Frets on Fire before? ______

Hobbies:


4/11

____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________

Frets on FireOrientation

Hello! My name is _________________________ and these are my teammates,________________________.

We have asked you to participate in this test to help us evaluate the effectivenessand efficiency of Frets on Fire game application to novice computer user such asyourself. Frets on Fire, abbreviated FoF is a free, open source music video game. Theplayers use the keyboard to play along with markers which appear on screen, with

the aim to score points, achieve a high point multiplier and complete a song. Thesetasks involve step-by-step instructions on how to play Frets and Fire. Knowing thatyou have no experience in using this application, wed like you to try it out and learnthe basic tools through the help of a manual we will provide. You have your ownworkstation with the Frets on Fire game application installed in it.

We have to observe you as you follow the instructions on the manual and how you goabout in the game to complete them. Feel free to express your frustrations andreactions in any way possible as long as you do not destroy the test materials. Fromtime to time, please tell us which part and what instructions are you following. Forhelp or clarification, just raise your hand and I or the test monitor assigned shallapproach you.


5/11

Ill give a brief explanation on the Frets on Fire environment. This is the Frets on Fireenvironment. First you will see a menu of options of whether youd like to start thegame or take the tutorial first.When you choose to play the game, you get to choose what fret board image youlike. After choosing the image, a list of songs will appear but we will just let youchoose a particular song with the corresponding guitar mode and level of difficulty.


6/11

The first song would be on a medium mode. In playing the game in this level, use thekeys F1 for the first string, F2 for the second, F3 for the third and F4 for the fourthstring. When keying-in the keys for the strings, the ENTER key must be pressedsimultaneously. After the first song, another song of a hard level of difficulty will beplayed, there would be five strings to manipulate and the key F5 will be the key forthe fifth string.

Do you have any questions at this point?

A more detailed explanation is shown on the manual that we will provide. Please feelfree to ask questions concerning the Frets on Fire game application.

If you dont have any questions, let me first ask some questions before we proceed.


7/11

Frets on FireBackground Information Questionnaire

Test Subject No.: _____ Test Subject Name:______________________________________

How long have you started playing guitar? What motivated you to learn play theguitar?

What do you think is your level of expertise? How often do you play the guitar?

Have you played any guitar game application before? If yes, what are those games?

Have you ever observed other people playing Frets on Fire before? Do you find itinteresting?


8/11

Frets on Fire

Test Document

1. Open the FRETS ON FIRE game application.

2. Select PLAY GAME from the options.

3. Choose a fret board image from the choices. And start the game.

4. Choose SWEET CHILD OF MINE from the list of songs. Next, select GUITAR

mode from the options given. Then, choose the MEDIUM level of difficulty

which manipulates four strings.

5. Start to play the game.

6. After completing the first song, click the Enter tab to proceed to the next page

where you have to enter your name for the game to record your score.

7. Click QUIT TO MAIN MENU option.

8. Choose the second song, CANON ROCKfrom the song list which is already in

a hard level of difficulty.

9. Start to play the game.

10.After completing the second song, click the Enter tab to proceed to the next

page where you have to enter your name for the game to record your score.

11.Click QUIT TO MAIN MENU to leave the current page.

12.In the main menu, CLICK QUIT to close the Frets on Fire game application.


9/11

Frets on FirePost-test

I found the layout/interface of the gameClear Strongly

AgreeAgree Neutral Disagree Strongly

Disagree

Organize StronglyAgree

Agree Neutral Disagree StronglyDisagree

Understandable

StronglyAgree


Easy StronglyAgree


I found the control keys and buttonsClear Strongly


Disagree

Organize StronglyAgree Agree Neutral Disagree StronglyDisagreeUnderstanda

bleStrongly


DisagreeEasy Strongly


Disagree

I found the navigation of the softwareClear Strongly


DisagreeOrganize Strongly

Agree

Agree Neutral Disagree Strongly

DisagreeUnderstanda

bleStrongly




Disagree

I found the manualClear Strongly




Disagree

Understandable

StronglyAgree


Easy StronglyAgree



10/11

I found the Visual Effects and Graphics to beClear Strongly




DisagreeUnderstanda

bleStrongly




Disagree

I found the Audio EffectsClear Strongly




DisagreeUnderstanda

ble

Strongly

Agree

Agree Neutral Disagree Strongly

DisagreeEasy StronglyAgree


Overall, I found the game to beClear Strongly




DisagreeUnderstanda

bleStrongly


Disagree

Easy StronglyAgree



11/11

Frets on FireDebriefing Questions

Test Subject No.: _____ Test Subject Name:______________________________________

How did you find the instructions?

How did you find the tasks?

What do you think of the game?

Do you think a first time user of Frets on Fire can easily understand the game?

As a whole, did you find it difficult to play?

Are you willing to play the game again?

Documents

Frets on Fire Usability Testing