26
A NEW METHOD FOR COLLECTING AND GATHERING DATA USING SMARTBOARD APPLICATION IN THE FIELD OF INTERACTION DESIGN AND CHILDREN (IDC) LAILI FARHANA BINTI MD IBHARIM M20092001236 SUPERVISOR: DR. –ING MAIZATUL HAYATI BINTI MOHAMAD YATIM FACULTY OF ART, COMPUTING AND CREATIVE INDUSTRY 1

Viva presentation3

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: Viva presentation3

1

A NEW METHOD FOR COLLECTING AND GATHERING DATAUSING SMARTBOARD APPLICATION IN THE FIELD OF

INTERACTION DESIGN AND CHILDREN (IDC)

LAILI FARHANA BINTI MD IBHARIMM20092001236

SUPERVISOR: DR. –ING MAIZATUL HAYATI BINTI MOHAMAD YATIMFACULTY OF ART, COMPUTING AND CREATIVE INDUSTRY

Page 2: Viva presentation3

2

This Presentation Will Tell Us About…

Research Introduction And Background Research Goal Research Objectives & Questions Research Framework Literature Review Development Of Application Research Methodology Instruments Used Results & Findings Discussion Main Research Contribution Future Work Summary

Page 3: Viva presentation3

3

INTRODUCTION

• Data collection and data gathering: To collect sufficient, accurate and relevant data so that, a set of stable requirements can be produced (Preece, Rogers & Sharp, 2006). (page 1)

• Smartboard: large physical display panel that can function as an ordinary whiteboard, a projector screen, an electronic copy board or as a computer projector screen on which the computer image can be controlled by touching or writing on the surface of the panel instead of using a mouse or keyboard (Barber, Cooper & Meeson, 2007). (page 17)

• Usability: Usability is a combination of the effectiveness, efficiency and satisfaction with which specified users achieve specified goals in a particular environment (Alan Dix et al, 2004). (page 29)

Page 4: Viva presentation3

4

RESEARCH PROBLEMS

• A method of collecting and gathering data is used by researchers in their studies especially with children is quite challenging and difficult.

• Smartboard is a new technology use in Malaysia education field. No specific research or findings to prove the effectiveness of Smartboard in order to collect and gather data.

• We cannot measure the usability and children acceptance with Smartboard as a new medium to learn without concrete research and findings.

* Dissertation page 4

Page 5: Viva presentation3

5

RESEARCH GOAL

To identify the usability of Smartboard application as a tool to collect and gather data

for usability testing with children

Page 6: Viva presentation3

6

RESEARCH OBJECTIVES & QUESTIONS

OBJ 1: To identify Smartboard’s features, functions and interactions that are suitable for the children’s activity to collect and gather data.1. What is the best feature and function in Smartboard that can be used to collect and gather data?2. How interaction between students, teachers and the Smartboard in collecting and gathering data session?

OBJ 2: To measure Smartboard’s usability and user acceptance for its effectiveness, efficiency andsatisfaction elements.3. What is the limitation and problem when using Smartboard?4. How usability in term of easy to use in Smartboard application can be measured?5. How children can express their satisfaction when using the Smartboard?

OBJ 3: To suggest a new method to collect and gather data using Smartboard.6. What is the best method and instrument to collect and gather data from children?7. Is children drawing on the Smartboard able to give information and easy to interpret?8. Is Smartboard suitable to be used as an instrument to collect and gather data from children?

* Dissertation page 5 & 6

Page 7: Viva presentation3

7

RESEARCH FRAMEWORK

• Theoretical Stage

• Methodology Stage

(Developed by Laili Farhana, 2011 & DDDE Model adapted from KS Ivers, 1998)

*Dissertation page 11-12

Page 8: Viva presentation3

8

LITERATURE REVIEW

IWB technologyEffectiveness of IWB in class

Learning theory applied Advantages of Smartboard as data collecting and gathering tool

List of methods used by other researchers that involved with childrenMethod and instrument guidelines for children

Child artifact

Usability aspects and requirementsUsability principle

Usability evaluation of SmartboardUsability testing with children using Smartboard

(page 17-22)

(page 35-40)

(page 29-35)

(page 23-29)

Page 9: Viva presentation3

9

APPLICATION DEVELOPMENT

(DDDE Model adapted from KS Ivers, 1998)

* Dissertation page 42

Page 10: Viva presentation3

10

APPLICATION DEVELOPMENT

PART PHASE DESCRIPTION

APPLICATION DESIGNING AND DEVELOPMENT

PHASE

Decide(page 43-47)

User: children aged 7 to 12 years old Method: 1) drill and practice 2) game.Hardware: Computer, projector, SmartboardSoftware: SMART Notebook 10Content: 'Introduction of Icon‘.

Design(page 48-52)

Storyboard and Flowchart

Develop(page 52-57)

5 Interaction Design Principles suggested by Don Norman (1988) : visibility, feedback, constraints, consistency & affordance.User Interface Guidelines (Hanna et al, 1998) : activity, instruction & screen layoutQuestionnaire on usability testing of icon by (Azhar, 2011)

EVALUATION Evaluate(page 57-59)

Tested on three children aged 8, 10 and 12 years oldResearcher observed on how the children play with all the activities.Researcher and children explored all the functions and features which have been provided together.Interview session (feeling and problems)Peers and experts reviews (suggestion for improvement)

Page 11: Viva presentation3

11

RESEARCH METHODOLOGY

PILOT STUDY USABILITY TESTING

Page 12: Viva presentation3

12

METHODOLOGY: PILOT STUDY

• Objective : To evaluate the understanding of the participants about the instrument items that have been used.

• Measurement : Validity (face, criterion, content & internal) and reliability (triangulation technique: theoretical, source & investigator) of the instruments.

• Participant : Children (5 girls and 4 boys) between ages five to eleven years old to learn about children's behavior, attitudes and perceptions, gender, ages and experience

• Instruments : Set of handout activity : i) drawing ii) mix-and-match and Interview

* Dissertation page 62&63

Page 13: Viva presentation3

13

METHODOLOGY: USABILITY TESTING

• Participant: 9 primary school children aged between 7 to 12 years old from Tanjung Malim area

• Location: animation lab at Universiti Pendidikan Sultan Idris • Method: Usability Testing Guidelines for Children (Hanna, Risden

& Alexender,1997) (page 65-66)• Instruments: 1) observation, 2) interview, 3) questionnaire, and

4) child’s artifacts

* Dissertation page 63-66

Page 14: Viva presentation3

14

INSTRUMENTS USED

INSTRUMENT DESCRIPTION

Observation(IMETC 2011)(page 67-69)

Intensive use, fun and creativity test (Masuch, Yatim & Gadegast, 2007)Observation framework (Colin Robson,2002) : Space, actor, activity, objects, acts, events, times, goals, feelingObservation criteria : Facial, speech, body language, movement & attitude

Interview(page 69-73)

Participant: children involved in Usability TestingPeer: post graduate students who have experiences in designing children multimedia products and conducting research with childrenExpert: lecturers of Multimedia Department, Faculty of Art, Computing and Creative Industry (MaCSS 2011)

Questionnaire(page 74)

To identify the background of the lecturers whose conduct research on computer applications for children. In addition, this questionnaire aims to look at the data collection methods and types of data are often being collected for research with children. This questionnaire consists of five items to be answered.

Child’s Artifact(page 74-75)

Children’s ability and experience to draw and write on the Smartboard about their ideas based on the task given (drawing icon on Smartboard)Drawing checklist : Creativity, message, shape & colour and perspective

Page 15: Viva presentation3

15

RESULTS & FINDINGS

OBJ1: To identify Smartboard’s features, functions and interactions that are suitable for the children’s activity to collect and gather data.

QUES INSTRUMENT SUMMARY

No 1 OBSERVATION: To identify the features and functions from most enjoyable activity (page 85-87)

The activities in the form of direct interaction are more fun and easier Skills and creativity factors would affect the ease or difficulty of this activity.

INTERVIEW (EXPERTS): Opinion about the most enjoyable and comfortable activity (page 87-90)

No 2 OBSERVATION: The interaction between the participants with the Smartboard(page 91-92)

Simple functions and easy tools for effective interaction. In addition, it should have closure and engagement elements will make children feel more comfortable, secure and confident with what they do.INTERVIEW (EXPERTS): Suggestion about

types of interaction apply on Smartboard(page 92-93)

Page 16: Viva presentation3

16

RESULTS & FINDINGS

OBJ2: To measure the Smartboard’s usability and user acceptance for its effectiveness, efficiency and satisfaction elements.

QUES INSTRUMENT SUMMARY

No. 3 INTERVIEW (PARTICIPANTS) : Problem and difficulties they faced when using the application. (page 94-95)

The main limitation is the use of tools on the Smartboard.

INTERVIEW (PEERS): Suggestions about the things that are needed to put on highly attention while using Smartboard (page 95-96)

7 tips for Smartboart application

INTERVIEW (EXPERTS): Opinions about things that we have to avoid when using the Smartboard. (page 96-98)

Avoid complicated activity and tool uses.

No. 4 OBSERVATION (EFFICIENCY): Measured based on the time taken for each participant to finish the activities. (page 99)

Six participants have completed each activity were below from the researchers estimated time (7 minutes).

Page 17: Viva presentation3

17

RESULTS & FINDINGS

OBJ2: To measure the Smartboard’s usability and user acceptance for its effectiveness, efficiency and satisfaction elements.

QUES INSTRUMENT SUMMARY

No. 4 OBSERVATION (EFFECTIVENESS): Measured based on marks or scores for each participant.(page 100)

Matching: All participants got full marks (Very good)Drag & Drop: 6 participants got full marks and none got 0 (Good)Pairing : All participants got score above 5 (Very good)

No. 5 OBSERVATION (SATISFACTION): To see their levels of satisfaction when handling the activities in the Smartboard(page 101-102)

Positive form of expression that was dominating the participants

INTERVIEW (PARTICIPANTS): Their feelings when they are handling the activities in the Smartboard application.(page 102-103)

Almost all of the participants are satisfied and happy. They also never give up easily.

Page 18: Viva presentation3

18

RESULTS & FINDINGS

OBJ3: To suggest a new method to collect and gather data by using the Smartboard

QUES INSTRUMENT SUMMARY

No. 6 QUESTIONNAIRES (EXPERTS):1. The number of lecturers who are using

several of methods in research2. The number of lecturers who are using

various types of data collected in research(page 104-105)

Highest : ObservationLowest : Experiment

Highest : Video recording

INTERVIEW (EXPERTS): How to identify their past experience while conducting research with the children. (page 106-110)

The exact selection of method is very important to obtain the necessary data. For children, the suitable data collected is more in an artifacts form

OBSERVATION: Types of method and types of data prefer by participants according to activity in the Smartboard application. (page 110-111)

All participants prefer Pairing activity which use test and observation method that produce data in score form.

Page 19: Viva presentation3

19

RESULTS & FINDINGS

OBJ3: To suggest a new method to collect and gather data by using the Smartboard

QUES INSTRUMENT SUMMARY

No. 7 OBSERVATION: Comparison between paper based and Smartboard based drawing for the ‘Exit’ icon(page 112-114)

4 categories in drawing checklist identified.

No. 8 INTERVIEW (EXPERTS): Their personal opinions on the usability of the Smartboard to replace the conventional methods (page 115-117)

Smartboard technology can be accepted as an alternative method to collect and gather data.

Page 20: Viva presentation3

20

DISCUSSION

1. Scoring Calculator has the best feature and function in Smartboard that we can use to collect and gather data. (page 119)

2. Using the tools in the wrong way is a major limitation in the use of Smartboard application. (page 120)

3. Direct interaction makes children feel enjoyable and comfortable (MaCCS 2011) (page 121)

4. Similarity and familiarity of Smartboard application with real world makes it well functioned. (IMETC 2011) (page 122)

5. Collecting and gathering data from children can be easy by using Smartboard application. (IMETC 2011) (MaCCS 2011) (page 123)

6. Children show good behaviour and attitude while using Smrtboard application. (IMETC 2011) (page 124)

7. Children feel satisfied and excited while using Smartboard application (page 125)8. Smartboard meets the needs of researchers in conducting research (MaCCS

2011) (page 126-127)9. Digital drawing gives less information rather than paper-based drawing (page

127-128)

Page 21: Viva presentation3

21

MAIN RESEARCH CONTRIBUTION

An analysis of children's needs in understanding their attitudes towards the learning environment including the appropriate forms of interaction involving children and the Smartboard. (page 47)

A list of guidelines of using Smartboard to collect and gather data for research in the field of children. (Appendix D)

A list of methods and instruments to be used with Smartboard technology to collect and gather data from children (page 130)

Page 22: Viva presentation3

22

FUTURE WORK

• Further research on efficiently and comfortably factors in using Smartboard technology with a proper guidance and training

• Extend the scope of this method and test it with different types of users and devices

* Dissertation page 131

Page 23: Viva presentation3

23

SUMMARY

This study has successfully introduced a new method that can be applied in the study of interaction design

with children (IDC)

• able to meet the requirements in a study and remains accurate and reliable in providing the relevant data.

• encourage children to be active in disseminating information. • expected to meet the nature of research setting for

collecting and gathering data from children (who have curiosity in bringing new technology) for education and entertainment research purposes.

* Dissertation page 132-133

Page 24: Viva presentation3

24

MAIN REFERENCES

• Ackermann, E. (2004). Constructing Knowledge and Transforming the World. M. Tokoro and L. Steels (Eds.). A Learning Zone of One’s Own: Sharing Representations and Flow in Collaborative Learning Environments. Amsterdam: IOS Press, Pt. 1, Ch. 2, pp. 15-37.

• Barber, D., Cooper,L., & Meeson, G. (2007). Learning and Teaching with Interactive Whiteboard: Primary and early year . UK: Learning Matters Ltd.• Chamber, M. (2007). Usability, Usability Requirement & User Experience Goal. Retrieved May 1, 2011, from

http://www.articlesbase.com/internet-articles/usability-usability-requirements-and-user-experience-goals-89539.html• Cooper, A. & Reiman, R. (2003). About Face 2.0: The Essential of Interaction Design . New York: John Wiley & Sons.• Cuthell, J. P. (2005). The Impact of Interactive Whiteboards on Teaching, Learning And Attainmen. In Proceedings of SITE 2005 (pp. 1353 – 1355) AACE Phoenix , Arizona. Retrieved May 1, 2011 from

http://www.virtuallearning.org.uk/changemanage/iwb/Impact%20of%20IWB.pdf • Diaper, D. (1989). Task observation for human-computer interaction. In Diaper, D. & Stanton, N. A. (Eds.), Task Analysis for Human-Computer Interaction (pp. 210-237). New Jersey: Lawrance Erlbaum

Associates Inc.• Dix, A., Finlay, J., Abowd, G. D. & Baele, R. (2004). Human –Computer Interaction (3rd Ed). UK: Prentice Hall. • Donker, A., & Markopoulos, P. (2001). Assessing the effectiveness of usability evaluation methods for children. PC-HCI2001, Patras, Greece.• Dumas, J. S. & Redish, J. C. (1999). A Practical Guide to Usability Testing (Revised Edition). England: Intellect Ltd.• Druin, A., Bederson, B., Boltman, A., Miura, A., Knotts-Callaghan, D., & Platt, M. (2007). Children as our technology design partners. In A. Druin (Ed.), The Design of Children's technology (pp. 51 - 72). San

Francisco, CA: Morgan Kaufmann.• Edwards, H. & Benedyk, R. (2007). A Comparison of Usability Evaluation Methods for Child Participants in A School Setting. In proceeding of The 6th International Conference for Interaction Design and Children

(pp. 9-15) Aalborg, Denmark.• Gage, J. (2005). How to Use An Interactive Whiteboard Really Effectively in Your Primary Classroom. London: David Fulton Publishers Ltd. • Hanna, L., Risden, K., Czerwinski, M., Alexander, K.J. (1998). The Role of Usability Research in Designing Children’s Computer Products. In: The Design of Children’s Technology. Druin, A. (Ed.), San Francisco, CA,

USA: Morgan Kaufmann Publishers.• Institut Pendidikan Guru. (2010). Modul Perkembangan Kreativiti dalam Pendidikan Prasekolah . Kementerian Pelajaran Malaysia.• Kersten-Tsilkalkina, M., & Bekker, M. (2001). Evaluating usability and pleasure of children's products. International Conference on Affective Human Factors Design, Singapore.• Landay, J. A. & Myer, B. A. (1995). Interactive sketching for the early stages of user interface design. Pennsylvania, USA: Carnegie Mellon University, School of Computer Science. • Masuch, M., Maizatul H.M.Y. & Gadegast, P. (2007). Developing Software for Children:Experiences from Creating a 3D Drawing Application. Germany: University of Magdeburg.• Markopoulos, P. & Bekker, M. M. (2002). How To Compare Usability Testing Methods With Children Participants. Netherlands: Technical University of Eindhoven. • Moussouri, T. (2004). Kids in Evaluation. Retrieved April 23, 2011 from http://www.visitors.org.uk/files/Kids%20in%20Evaluation%20-%20T%20Moussouri.pdf • Piaw, C.Y. (2006). Asas Statistik Penyelidikan. Kuala Lumpur: McGraw-Hill.• Preece, J., Rogers, Y. & Sharp, H. (2006). Interaction Design Beyond Human-Computer Interaction (2nd ed.). USA : John Wiley & Sons, Ltd.• Read, J., MacFarlane, S., & Casey, C. (2001). Measuring the usability of text input methods for children. In People and Computers XV Interaction without Frontiers: Joint proceedings of IHM 2001 and HCI 2001 ,

pp. 559 - 572. • Robson, C.(2002) Real World Research (2nd Ed). Oxtford: Blackwell Publishing.• Rubin, J. & Chisnell, D. (2008). Handbook of Usability Testing: How to Plan, Design and Conduct Effectiveness Tests (2nd Ed.). Indianapolis: Wiley Publishing.• Shneiderman, B., & Plaisant, C., (2010) Designing the User Interface: Strategies for Effective Human-Computer Interaction (5th Ed.) Pearson Higher Education.• SMART Technology Inc (2006). Interactive Whiteboards and Learning Improving Student Learning Outcomes And Streamlining Lesson Planning . Retrieved May 1, 2011, from

http://www2.smarttech.com/NR/rdonlyres/2C729F6E-0A8D42B89B32F90BE0A746D8/0/Int_Whiteboard_Research_Whitepaper_Update . pdf • User-Centered Design: Testing And Evaluation .(n.d). Retrieved May 1, 2011, from http://ergotmc.gtri.gatech.edu/ddt/UsernCentered_Design/UCD_TestEvaluatin _TE_T.htm• Zaharias, P., & Poylymenakou, A. (2009). Developing a usability evaluation method for e-learning applications: beyond functional usability . International Journal of Human-Computer Interaction, 25(1), 75–98.

Page 25: Viva presentation3

25

RESEARCH PAPER PUBLICATION

Chapter in bookLaili Farhana, M.I. & Maizatul, H.M.Y. (in press). A Usability Study With Children And Smartboard Technology: Improving

Our Methods In Data Collecting And Gathering Technique. In M.I. Rozhan (Eds.), Open education: Towards a ubiquitous learning environment. Malaysia: Pearson Custom Publishing.

International Proceedings• PresentedLaili Farhana, M.I. & Maizatul, H.M.Y. (2011). A Usability Study With Children And Smartboard Technology: Improving

Our Methods In Data Collecting And Gathering Technique. In: Proceedings of 5th International Malaysian Educational Technology Convention 2011. Kuantan, Malaysia

• AcceptedLaili Farhana, M.I. & Maizatul, H.M.Y. (2011). A New Method For Collecting And Gathering Data Using Smartboard

Application In The Field Of Interaction Design And Children (IDC). In: Proceedings of International Educational Technology Conference 2011. Istanbul, Turkey.

Laili Farhana, M.I. & Maizatul, H.M.Y. (2011). A New Method For Collecting And Gathering Data Using Smartboard Application In The Field Of Interaction Design And Children (IDC). In: Proceedings of International Conference on Education and New Learning Technologies 2011. Bercelona, Spain.

National ProceedingsLaili Farhana, M.I. & Maizatul, H.M.Y. (2011). A Usability Study With Children And Smartboard Technology For Data

Collecting And Gathering Technique From Expert Point Of View. In: Proceedings of 1st Multimedia & Creative Content Symposium 2011. Tg. Malim: UPSI.

Maizatul, H. M. Y. , Amily, S. S., Nur Saadah, F., Nadia, A. A. Z., Laili Farhana, M. I., Azhar, A. & Suhairun, N. S. (2010). Managing Icon Presentation In Children Software: Interpretation From Children Perspectives. In: Proceedings of Seminar Sehari Penyelidikan, pp. 1-10,Tg. Malim : FPE.

Page 26: Viva presentation3

26

THANK YOUQ & A SESSION