24
IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

Embed Size (px)

Citation preview

Page 1: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia 

Mohammad Noor Nawaz and Andrea BuntUniversity of Manitoba

1

Page 2: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

2

User Generated Content

Page 3: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

Voluntary Contribution

3

Image Courtesy: Wikimedia Commons

Page 4: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

Typical Contribution Rates

4

Stuckman et al., WikiSym 2009Nielsen

Contributors(9%)

Consumers(90%)

Creators (1%)

Page 5: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

Increasing Contribution Rates

Make it easier!

5

Wilkinson, EC 2008Hoffmann et al., CHI 2009

Nielsen

Page 6: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

State of the Art

6

Page 7: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

Our Contributions

Novel approach to facilitating Wikipedia contributions to free-form text

─ resource recommendations

Prototype illustrating approach

Proof-of-concept empirical evaluation

7

Page 8: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

8

Our Approach

Page 9: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

IntelWiki Prototype: Framework

ResourceRanker

ResourceFetcher

ResourcePresenter

9

IntelWiki

Page 10: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

IntelWiki - Demo

10

• For demonstration video see:

http://hci.cs.umanitoba.ca/projects-and-research/details/intelwiki

Page 11: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

Evaluation

Conditions

1. IntelWiki

2. Default

16 participants

Within subjects

11

Page 12: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

12

Tasks

Page 13: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

13

Perceived Workload (NASA TLX)

IntelWiki Default0

20

40

60

80

Mean

Overa

ll W

ork

load

F1,14 = 11.653; p = 0.004

Page 14: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

14

Word Count

F1,14 = 5.302; p = 0.037

IntelWiki Default185

190

195

200

205

210

215

220

225

230

235

Mean

Nu

mb

er

of

Word

s

Page 15: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

15

Fact Count

F1,14 = 7.304; p = 0.017

IntelWiki Default12

16

20

Mean

Fact

Cou

nt

Page 16: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

16

Fact Count

IntelWiki_First IntelWiki_Second12

14

16

18

20IntelWiki

Default

Mean

Fact

Cou

nt

Page 17: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

17

Preference

IntelWiki Default0

4

8

12

16

# P

art

icip

an

ts

Page 18: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

Integrated Editing

[I preferred IntelWiki] because it gives me everything in one window.

18

Page 19: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

Easier Resource Inspection

The keywords in the tooltip helped me understand which article will be more suitable for geography.

[Keyword highlighting] was very helpful; didn't have to read the whole page, or even the paragraph, only the lines containing the highlighted words.

19

Page 20: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

Replacing Manual Search

[IntelWiki] eliminated any need for [additional searches] because, virtually anything that's needed I think was provided in the [recommended resources]

20

Page 21: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

Lack of Trust

I don't usually trust the highlight and these things. I prefer to study by myself.

I preferred the [Default interface] because I can get more facts -- I don't really have to base my knowledge on a limited set of resources. It makes me more elaborate in my research. - P10

21

Page 22: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

Summary

Resource recommendations as an way to facilitate Wikipedia contributions

IntelWiki prototype

Improved editing quantity and quality, and cognitive load

22

Page 23: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

23

Future Work

Page 24: IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt University of Manitoba 1

24

IntelWiki: Recommending Resources to Help Users Contribute to Wikipedia Mohammad Noor Nawaz and Andrea Bunt

University of Manitoba

[email protected]

hci.cs.umanitoba.ca