13
Understanding What Users Need to Understand Us (and Our Data): Crowdsourcing Metadata Edward Benoit, III School of Library & Information Science, LSU

Crowdsourcing Metadata

Embed Size (px)

Citation preview

Page 1: Crowdsourcing Metadata

Understanding What Users Need to Understand Us (and Our Data):

Crowdsourcing MetadataEdward Benoit, III

School of Library & Information Science, LSU

Page 2: Crowdsourcing Metadata

Previous Research & Focus

• Tagging studies main focus on still images or text

• User-generated content as time saving mechanism

• Challenges and opportunities of moving images • Initial research question: What effect does

online video length have on crowdsourced metadata/user-generated tags?

Page 3: Crowdsourcing Metadata

Methodology• Mixed methods, quasi-experimental

two-group design• 40 participants randomly assigned to 2

groups and tag:– One 30 minute video -OR-– Three 10 minute videos

• Analysis:– Open coding– Descriptive statistics

Page 4: Crowdsourcing Metadata

Sample Video(s):LDMA

http://www.ladigitalmedia.org/

Page 5: Crowdsourcing Metadata
Page 6: Crowdsourcing Metadata

Participants• Gender: 22.5% Male, 77.5%Female• Age: 19-65; 30.9 Mean• Location: 65% Louisiana• Race:

– 77.5% White– 10% Black– 5% Hispanic– 5% Asian– 2.5% Other

Page 7: Crowdsourcing Metadata

Number of Tags: Short Videos

S1 S2 S3 S4 S5 S6 S7 S8 S9 S10 S11 S12 S13 S14 S15 S16 S17 S18 S19 S200

5

10

15

20

25

30

Video 1 Video 2 Video 3

Page 8: Crowdsourcing Metadata

Sample Video(s):LDMA

Long Video Short VideosTotal Tags 322 555

Avg Tags/User 16.1 27.75

Total Unique Tags (by users)

322 496

Avg Unique Tags/User 16.1 24.8

Total Unique Tags 175 281

Statistically significant difference between the number of tags generated for the long video (M=16.1, SD=22.6) and the short videos (M=27.75, SD=12.1); t(38)=-3.11, p=0.004.

Page 9: Crowdsourcing Metadata

Top Tags

Long Video• Christmas (14)• Papa Noel (13)• cajun (10)• Louisiana (9)• Cajun Night Before Christmas

(6)• Lafayette (6)• Natchitoches (6)• Bayou (5)• Cajun Christmas (5)• Fireworks (5)

Short Videos• Cajun Christmas (19)• Louisiana (17)• Christmas (16)• Papa Noel (16)• Cajun (12)• Bayou (11)• Bayou Parade (11)• Cajun Night Before Christmas

(10)• Food (9)

Page 10: Crowdsourcing Metadata

Metadata Comparison

• Compiled list of metadata words• Post-stop list removal, 89 words• Compared with generated tags:

– Full Video: 41.6% matching– Short Videos: 48.3% matching

Page 11: Crowdsourcing Metadata

Main Types of Tags• Content description

• Identification (persons, places, music)

• Emotional responses

Page 12: Crowdsourcing Metadata

Future Directions

• Comparison of amateur and professional online videos

• Tagging enticement techniques

Page 13: Crowdsourcing Metadata

Thank you!Questions?