90
Shared Desires, Conflicting Agendas, and Lessons Learned On Collaborating to Create Educational Games Theresa Devine Assistant Professor Arizona State University [email protected] http://studio4gaminginnovation.com/ http ://theresadevine.com / http://zamtox.com / July 22-24 2014 2014 Serious Play Conference @Studio4Games #LessonsLearned

Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Embed Size (px)

DESCRIPTION

Any professor who develops games will inevitably be asked to work in partnership to make an educational game. As a new professor, I was very open to the idea of collaborative research because I felt an affinity with my colleagues and thought that we shared desires that developing games satisfied. The requests from my colleagues to make educational games were numerous. I attempted to join forces with these professors and every one of these endeavors failed. The shared desires, conflicting agendas and lessons learned from these failures are the subject of this talk.

Citation preview

Page 1: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Shared Desires, Conflicting Agendas, and Lessons LearnedOn Collaborating to Create Educational Games

Theresa DevineAssistant ProfessorArizona State University

[email protected]://studio4gaminginnovation.com/http://theresadevine.com/http://zamtox.com/

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 2: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Desires

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 3: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

My Backstory

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 4: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

I am an artist.I was trained as a painter and printmaker. MFA 1994

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 5: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

The enlightened one….

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 6: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

No audience participation = preaching

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 7: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Political and Social Art

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 8: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Barrier between artist and audience.

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 9: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

2 miles per hour

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 10: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

My Desire: What if?

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 11: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

1995: I will make games and engage the fine art audience through play

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 12: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Note: Day Job 1998-2010(this is important later in the story)

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 13: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Their Backstory

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 14: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Their desire: beyond boredom

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 15: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

!!!!!!!!

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 16: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Anti-Critical Thinking

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 17: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

*sigh*

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 18: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Assembly Line Learning

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 19: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

First comes instruction, then practice, then work on comprehension skills

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 20: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Break free

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 21: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

And everyone read it….

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 22: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

And decided games would SAVE education

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 23: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Reinforcement

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 24: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Seduced

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 25: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Shared Desires

Page 26: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Wishing and wondering

• Can the interface disappear? • Can the artist/educator become one with the

audience/students? • Can our message become embedded in the

delivery so as to make the communication intuitive?

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 27: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Rapture

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 28: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

And so we set out on our journey…

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 29: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Conflicting Agendas

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 30: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

My Agenda

• To make fun, engaging, meaningful, well designed toys and games that are works of art.

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 31: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Their Agenda

• To make a game that will engage an audience in their research.

• To enhance their teaching.

Page 32: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Conflicting Agenda #1: Pedagogical Confusion

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 33: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Fields I Encountered: Cases #1 and #2

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 34: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Case #1: Chemistry two pervasive pedagogical approaches

Lecture to present CONTENT Learn by doing: CONTEXT

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 35: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Content vs. Context

Content• Students usually enjoy this

type of approach• Hard to motivate non

majors• Difficult for non majors to

see relevance

Context• Fosters a more positive

attitude to school science over conventional courses

• Helps students make links to their lived experiences

• Seems to engage non majors

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 36: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Collaborator for this game…

• Unable to choose an approach• “Just use the book”• Result: a content driven pedagogical approach

wrapped in a story and gameplay• Goal: give the students the same feelings of

positivity and relevance that a context approach would

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 37: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

The Hope

• To motivate students to learn an admittedly difficult subject; and

• Improve retention

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 38: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Fail: Motivation

+

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 39: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Fail: Good Game Design

+

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 40: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Why didn’t I push back?

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

+

Page 41: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

What happened when I did push back?

What I said What they heard

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 42: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Hmmmm...

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 43: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Case #2: First Year Composition

Teaching skills• Identifying, categorizing,

studying, and replicating approaches to writing.

• Emphasis on “Form”

Covering content• Anchored in specific content

but approached from multiple disciplinary perspectives

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 44: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Game Design Stumbling Blocks: FYC

Teaching skills• To reproduce the professor

feedback loop in a game would require duplication of the human ability to discern and critique the student's writing

• This type of artificial intelligence capability is beyond what is currently technically available.

Covering content• Adds layer of game design

as it requires that a disciplinary context be created on top of the writing lessons.

• Expected degree of flexibility of discipline is difficult to achieve.

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 45: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Irony

• it has been found that neither methodology produces the systematic and wholesale improvements in writing skills desired

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 46: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Since 1968

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Stumbling Block:Eliminate FYC

Page 47: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Writing Lab as Game?

+

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 48: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

What FYC is to English Departments

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 49: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Hmmmm...

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 50: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Conflicting Agenda #2: Technology Wars

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 51: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

The BattlesTechnology Battle #1: Purchase “out of the box” solution

Technology Battle #2: Choose a digital environment based solely on novelty

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 52: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Seduced at a Conference

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 53: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Tech Battle #1: Purchase an “out of the box” solution

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 54: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Age Old Software Question…Build or Buy?

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 55: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

“No Silver Bullet” – Fred Brooks

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 56: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Level One Assessment Criteria

1. What does the software do?2. Does the software fill the need of the

project?3. Does the software do what it does well?4. Who are the competitors? 5. What are the differences and similarities of

the competitors’ products with the software being assessed?

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 57: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Level Two Assessment Criteria:Total Cost of Ownership (TOC)

• initial license fees, • hardware, • developers, • time, • training, • maintenance, • and feature development

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 58: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Level Three Assessment: What is the best value?

• The least expensive isn't necessarily the best value.

• The best value is determined by the long term plan of the software.

• Clear requirements that explain how the software is going to support the research are needed to determine the long term plan.

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 59: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

If

• There are clear requirements• And a long term plan

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 60: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Then

this is the point at which the – build, – buy, – or build and buy

decision can be made

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 61: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

But…

• The assessment process was never allowed by my collaborators.

• It was seen as “extra work” and “a waste of time.”

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 62: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Hmmmm...

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 63: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Tech Battle #2: Choose a digital environment based solely on novelty

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 64: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Why?

• Collaborator thought – It was cool and cutting edge.– The NSF would fund the project because of the

choice of technology.– The students would respond to this technology.– It was a readily available consumer product

(one that every student already owned).

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 65: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Problems

• Inaccessible to people with limited mobility.• Financial burden to students. – my students struggle to buy their books.

• Caters to a kinesthetic learning style.

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 66: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 67: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Hmmmm...

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 68: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Conflicting Agenda #3: Bait and Switch

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 69: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

I thought I was wiser…Contract establishing rolesStakeholder Requirements DocumentGame Design DocumentAgreement to make Board Game to transfer

research informationAgreement to make Board Game as a

prototype Agreement to create Video Game

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 70: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Dead EndContract establishing rolesStakeholder Requirements DocumentGame Design DocumentAgreement to make Board Game to transfer

research informationAgreement to make Board Game as a

prototype Agreement to create Video Game

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 71: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Board Game to transfer research information

• Was used to alpha test collaborator’s research• Had some success and some interesting data

was collected

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 72: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Bait and Switch

• Once the transfer of research was complete and the collaborator saw a “working” game

• And had some data collected• The project was ended by the collaborator

because he/she had what was needed for his/her own research

• Did not care if I had what I needed for my research

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 73: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

What happened when I pushed back?

What I said What they heard

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 74: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Hmmmm...

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 75: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Conflicting Agenda #4:Disappearing Act

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 76: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

#1: Unwillingness to share research data

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 77: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Why?

• Your guess is as good as mine.• Fear?

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 78: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

#2: Orphan Textbook Syndrome

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 79: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

I took the class….

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 80: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

What these Disappearing Acts have in common.

• Lack of commitment from collaborator

(manifested in their failure to show up for meetings)

• Unspoken: “Do my research for me.”

• Unspoken: “My time has more value than yours.”

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 81: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Hmmmm...

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 82: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Lessons Learned

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 83: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Know Your Limits andHave a Plan

Page 84: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Phase 1: Inception

• Pre-meeting research for game developer– Ask for teaching philosophy– Research pedagogy - look for opposing camps and assess degree

of emotional involvement in your collaborator and in your director.

• Meeting with collaborator:– Introduce process– Explain the difference between work for hire and collaborative

research– Collaborative research agreement– Collaborator homework: Stakeholder Questionnaire

• research data for game

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 85: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Phase 2: Expectations

• Meeting with Collaborator: – Contract establishing roles– Technology Lead Agreement– Stakeholder Definition Document

• Collaborator homework– Stakeholder Requirements Document

• Meeting with Collaborator to discuss Stakeholder Requirements

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 86: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Phase 3: Collaborative Elaboration

• Collaborator homework: First Board Game– The point is to transfer research and data needed

for the game– It is not a prototype

• No field testing or data collection allowed

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 87: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Phase 4: Elaboration

• Developer homework– Initial Game Design Document• Set limitations on the project

– Project Plan Overview• Make it simple

• Meeting with Collaborator

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 88: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Phase 5: Prototype

• IRB – Homework for Collaborator and Developer

• Developer Homework: – Board Game 2• Actual game design begins

• Field testing and Data collection allowed

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 89: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

Phase 6: Construction

• Developer Homework – Video Game • Promise only one game mechanic

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned

Page 90: Theresa Devine - Shared Desires, Conflicting Agendas and Lessons Learned

More information

• http://studio4gaminginnovation.com/projects.aspx

July 22-24 20142014 Serious Play Conference

@Studio4Games #LessonsLearned