66
Mobile Teaching and Learning: Engaging Students and Measuring Impact Veronica Diaz, PhD Associate Director EDUCAUSE Learning IniBaBve

Mobile Teaching And Learning: Engaging Students And Measuring Impact

Embed Size (px)

DESCRIPTION

The ELI’s research on mobile learning brings together a collection of best practices, case studies, and research on mobile technologies’ potential to engage students and enhance learning. Using your own local mobile learning initiatives or pilots, we’ll review and apply strategies and methodologies to help measure the impact of mobile tools on teaching and learning. As we review these approaches and measurement frameworks, participants will consider their challenges/opportunities in these areas and what research might be useful to advance their mobility work. This talk is part of the BNN Future of the Academy Speaker Series co-sponsored by NERCOMP, the National Institute for Technology in Liberal Education (NITLE), and the Boston Library Consortium (BLC).

Citation preview

Page 1: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Mobile   Teaching   and   Learning:  E n g a g i n g   S t u d e n t s   a n d  M e a s u r i n g   I m p a c t  

 Veronica  Diaz,  PhD  Associate  Director  EDUCAUSE  Learning  IniBaBve  

Page 2: Mobile Teaching And Learning: Engaging Students And Measuring Impact
Page 3: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Agenda    

•  Mobility  and  teaching  and  learning    •  Strategies  and  methodologies  to  help  measure  the  impact  of  mobile  tools  on  teaching  and  learning  

Page 4: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Resources    

hGp://Bnyurl.com/mecar      

hGps://sites.google.com/site/nercomp12/    

Page 5: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Got  mobility?  

Page 6: Mobile Teaching And Learning: Engaging Students And Measuring Impact
Page 7: Mobile Teaching And Learning: Engaging Students And Measuring Impact
Page 8: Mobile Teaching And Learning: Engaging Students And Measuring Impact
Page 9: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Pushing  mobile  content  (registrar,  library,  tram)    

Generic  mobile  instrucBonal  funcBons  (clickers,  twiGer,  LMS)    

Discipline-­‐specific  customized  mLearning    

Page 10: Mobile Teaching And Learning: Engaging Students And Measuring Impact

BEHAVIORIST    acBviBes  that  promote  learning  as  a  change  in  observable  acBons  

Source:  hGp://www2.futurelab.org.uk/resources/documents/lit_reviews/Mobile_Review.pdf.  

Page 11: Mobile Teaching And Learning: Engaging Students And Measuring Impact

CONSTRUCTIVIST  learning  as  an  acBve  

process  in  which  learners  construct  new  

ideas  or  concepts  based  on  both  their  

current  and  past  knowledge  

Source:  hGp://www2.futurelab.org.uk/resources/documents/lit_reviews/Mobile_Review.pdf.  

Page 12: Mobile Teaching And Learning: Engaging Students And Measuring Impact

SITUATED    acBviBes  that  promote  learning  within  an  authenBc  context  and  culture  

Source:  hGp://www2.futurelab.org.uk/resources/documents/lit_reviews/Mobile_Review.pdf.  

Page 13: Mobile Teaching And Learning: Engaging Students And Measuring Impact

COLLABORATIVE  acBviBes  that  promote  learning  through  social  

interacBon  

Source:  hGp://www2.futurelab.org.uk/resources/documents/lit_reviews/Mobile_Review.pdf.  

Page 14: Mobile Teaching And Learning: Engaging Students And Measuring Impact

LEARNING  SUPPORT  acBviBes  that  assist  in  the  coordinaBon  of  learners  and  resources  for  learning  acBviBes  

Source:  hGp://www2.futurelab.org.uk/resources/documents/lit_reviews/Mobile_Review.pdf.  

Page 15: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Behaviorist  (e.g.,  clickers)    ConstrucBvist  (e.g.,  simulaBons)  

Situated  (e.g.,  PBL)  CollaboraBve  (e.g.,  TBL)  

Learning  Support  (e.g.,  PLE)  

Page 16: Mobile Teaching And Learning: Engaging Students And Measuring Impact

YOUR  MOBILE  INITIATIVE  ACTIVITY,  PART  1  

The  mobile  device  (tablet,  smart  phone,  etc.)  The  mobile  applicaBons  (apps,  cloud,  etc.)  The  goals  (engagement,  content  delivery,  etc.)    …………  

Page 17: Mobile Teaching And Learning: Engaging Students And Measuring Impact

The  Thing(s)  To  Measure    

vs  How  To  Measure    

Page 18: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Measuring    the  Impact:  5  Studies  

Page 19: Mobile Teaching And Learning: Engaging Students And Measuring Impact

CASE  STUDY:  MOBILE  LEARNING    IN  A  BLENDED  COURSE  Source:  hGp://www.docstoc.com/docs/38964563/Assessing-­‐the-­‐EffecBveness-­‐of-­‐Mobile-­‐Learning-­‐in-­‐Large-­‐HybridBlended      

Page 20: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Focus  Areas  

if  student  enjoyed  the  learning  

experience  

how  students  feel  about  

interacBng  with  fellow  learners  

how  students  felt  about  their  

relaBonship  to  their  instructors  in  the  mobile  blended  

learning  environment  

mobile  blended  classroom’s  effects  on  

students’  study  habits  

Page 21: Mobile Teaching And Learning: Engaging Students And Measuring Impact
Page 22: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Overall  SaBsfacBon    

Course  OrganizaBon  

Page 23: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Course  AcBviBes    

Student  InteracBon  

Page 24: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Instructor  InteracBon    

RelaBonship  to  Content  

Page 25: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Sustainability    

Page 26: Mobile Teaching And Learning: Engaging Students And Measuring Impact

MOBILE  RESEARCH:    CHALLENGES  AND  GOALS  Source:  hGps://lra.le.ac.uk/bitstream/2381/8162/3/%5B14%5DVavoulaSharples-­‐mlearn2008%5B1%5D.pdf    

Page 27: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Capturing  learning  context  and  learning  across  contexts  

Challenge  1  

Page 28: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Has  anyone  learned    anything  yet?  

Challenge  2  

Page 29: Mobile Teaching And Learning: Engaging Students And Measuring Impact

An  ethical  quesBon  

Challenge  3  

Page 30: Mobile Teaching And Learning: Engaging Students And Measuring Impact

The  technology  itself  

Challenge  4  

Page 31: Mobile Teaching And Learning: Engaging Students And Measuring Impact

The  big  picture  

Challenge  5  

Page 32: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Formal  vs  informal  

Challenge  6  

Page 33: Mobile Teaching And Learning: Engaging Students And Measuring Impact

5  recommendaBons  •  Capture  and  analyze  

learning  in  context  with  consideraBon  of  learner  privacy  

•  Assess  the  usability  of  the  technology  and  how  it  affects  the  learning  experience  (PLE)    

•  Look  beyond  measurable  cogniBve  gains  into  changes  in  the  learning  process  and  pracBce  

•  Consider  organizaBonal  issues  in  the  adopBon  of  mobile  learning  pracBce  and  its  integraBon  with  exisBng  pracBces  

•  Span  the  lifecycle  of  the  mobile  learning  innovaBon  that  is  evaluated,  from  concepBon  to  full  deployment  and  beyond  

Page 34: Mobile Teaching And Learning: Engaging Students And Measuring Impact

BUILDING  A  SUCCESSFUL  MLEARNING  FRAMEWORK  

Source:  hGp://www.irrodl.org/index.php/irrodl/arBcle/view/346/875    

Page 35: Mobile Teaching And Learning: Engaging Students And Measuring Impact

ProporBonate  

Page 36: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Appropriate  to  the  specific  learning  technologies,  to  the  learners,  and  to  

the  ethos  of  the  learning      

–  ideally  built  in,  not  bolted  on      

Page 37: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Alignment  between  learning  goals  and  technology  

Page 38: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Unintended  results  

Page 39: Mobile Teaching And Learning: Engaging Students And Measuring Impact

YOUR  MOBILE  INITIATIVE    ACTIVITY,  PART  2  

How  and  what  will  you  measure?  

What  would  success  look  like?      …………  

Page 40: Mobile Teaching And Learning: Engaging Students And Measuring Impact

CASE  STUDY:  MOBILE  LEARNING    IN  MEDICAL  SCHOOL  Source:  hGp://www.biomedcentral.com/1472-­‐6920/10/57    

Page 41: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Context    •  57  students  in  cohort  •  4-­‐year    

–  Bachelor  of  Medicine    –  Bachelor  of  Surgery  

•  2  online  tools  –  Blackboard    –  Interlearn    

•  Access  to    –  Internet  –  Customized  sokware    –  Info  repositories  

•  Sharing  info  within  and  between  cohorts  

•  2  RQs  –  In  what  ways  does  mobility  support  learning?  

–  What  areas  need  further  development?  

Page 42: Mobile Teaching And Learning: Engaging Students And Measuring Impact
Page 43: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Student  Improvement  SuggesBons    

•  BeGer  and  more  electronic  learning  resources    –  more  materials,  especially  audiovisual  resources  

–  more  flexibility  in  accessing  materials  

•  Guidelines/support  on  managing  the  VLE  

•  Improvements  to  VLE  –  Streamlining  organizaBon  of  informaBon    

–  Reduced  the  number  of  clicks  to  access  resources    

–  OrientaBon  for  students    

Page 44: Mobile Teaching And Learning: Engaging Students And Measuring Impact

EVALUATING    MOBILE  APPLICATIONS    

Johns  Hopkins  University  10/18/2010  

Page 45: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Curriculum  ConnecBon  AuthenBcity    

Feedback  DifferenBaBon  User  Friendliness  

Student  MoBvaBon  

Page 46: Mobile Teaching And Learning: Engaging Students And Measuring Impact
Page 47: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Review  your  plan  and  ask…  

•  What  would  be  the  ramificaBons  and  opportuniBes  for  learning  if  this  technology  were  adopted?  

•  What  kinds  of  teaching  and  learning  engagements  might  this  technology:  make  beGer  or  enable?  

•  If  we  decide  to  do  a  pilot,  what  kind  of  evaluaBon  methodology  can  we  overlay  on  the  project  to  assess  outcomes?  

•  What  kind  of  addiBonal  research  needs  to  be  done  concerning  this  technology  (student)?  

Page 48: Mobile Teaching And Learning: Engaging Students And Measuring Impact

The  Thing(s)  To  Measure    vs  

How  To  Measure    

Page 49: Mobile Teaching And Learning: Engaging Students And Measuring Impact

How  do  I  ask?  

•  QuesBonnaires  –  Paper  –  Online  

•  Interviews  –  Individual  –  Focus  Group  

•  ObservaBons  –  Classroom  –  Online  

•  Focus  groups  •  Surveys  •  Tracking  tools  •  Journaling    •  Pre  post  tests    •  Debriefs    

Page 50: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Types  of  QuesBonnaires  

Paper  distributed  in  class  Mail  E-­‐mail  

Online,  e.g.,  SurveyMonkey  TwiGer  poll  Facebook  

Page 51: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Types  of  Interviews  

Face-­‐to-­‐face  Telephone  or  Skype  Teleconference  

Synchronous  Chat  Asynchronous  forum  

Focus  group  TwiGer  poll  Facebook    

Page 52: Mobile Teaching And Learning: Engaging Students And Measuring Impact

ObservaBon  OpBons  

Onlooker

Overt

Fully-explained

Once or limited

Narrow focus

Participant

Covert

Unexplained

On-going

Broad focus

Source:  hGp://www.amazon.com/ConducBng-­‐EducaBonal-­‐Design-­‐Research-­‐McKenney/dp/0415618045/ref=sr_1_1?s=books&ie=UTF8&qid=1329938445&sr=1-­‐1    

Page 53: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Triangulate  to  Tell  the  Full  Story  

Q

I

 

Full  Story  

OSource:  hGp://www.amazon.com/ConducBng-­‐EducaBonal-­‐Design-­‐Research-­‐McKenney/dp/0415618045/ref=sr_1_1?s=books&ie=UTF8&qid=1329938445&sr=1-­‐1    

Page 54: Mobile Teaching And Learning: Engaging Students And Measuring Impact

QUESTIONS  

Page 55: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Lunch    

Page 56: Mobile Teaching And Learning: Engaging Students And Measuring Impact

YOUR  MOBILE  INITIATIVE    ACTIVITY,  PART  3  

Measuring  the  iniBaBve  …………  

Page 57: Mobile Teaching And Learning: Engaging Students And Measuring Impact

YOUR  MOBILE  INITIATIVE    ACTIVITY,  PART  4  

Challenges  and  unintended  consequences.    …………  

Page 58: Mobile Teaching And Learning: Engaging Students And Measuring Impact

QUESTIONS  

Page 59: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Empowering  Students  and  Instructors:  ReflecBons  on  the  EffecBveness  of  iPads  for  Teaching  and  Learning,  Morrone,  Anastasia  S.  

hGp://www.educause.edu/Resources/EmpoweringStudentsandInstructo/250105      

Page 60: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Empowering  Students  and  Instructors:  ReflecBons  on  the  EffecBveness  of  iPads  for  Teaching  and  Learning,  Morrone,  Anastasia  S.  

hGp://www.educause.edu/Resources/EmpoweringStudentsandInstructo/250105  

Device    Apps/Sokware    

Goals    Methods    Outcomes    

Page 61: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Launching  a  University  Tablet  IniBaBve:  RecommendaBons  from  Stanford  University’s  

iPad  ImplementaBon,  Brian  Tobin.  hGp://www.educause.edu/Resources/LaunchingaUniversityTabletInit/250812    

Page 62: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Launching  a  University  Tablet  IniBaBve:  RecommendaBons  from  Stanford  University’s  

iPad  ImplementaBon,  Brian  Tobin.    hGp://www.educause.edu/Resources/LaunchingaUniversityTabletInit/250812  

Device    Apps/Sokware    

Goals    Methods    Outcomes    

Page 63: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Closing  in  on  Vocabulary  AcquisiBon  TesBng  the  Use  of  iPods  and  Flashcard  Sokware  to  

Eliminate  Performance  Gaps,  Andrea  L.  Nixon.  hGp://www.educause.edu/Resources/ClosinginonVocabularyAcquisiB/248520    

Page 64: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Closing  in  on  Vocabulary  AcquisiBon  TesBng  the  Use  of  iPods  and  Flashcard  Sokware  to  

Eliminate  Performance  Gaps,  Andrea  L.  Nixon.  hGp://www.educause.edu/Resources/ClosinginonVocabularyAcquisiB/248520  

Device    Apps/Sokware    

Goals    Methods    Outcomes    

Page 65: Mobile Teaching And Learning: Engaging Students And Measuring Impact

DISCUSSION/QUESTIONS  

Page 66: Mobile Teaching And Learning: Engaging Students And Measuring Impact

Veronica  Diaz,  PhD  Associate  Director  

EDUCAUSE  Learning  Initiative      

[email protected]  http://www.educause.edu/eli    

 Resources  

http://tinyurl.com/mecar