A Framework for Measuring

M-Learning Success A Research in Progress

Michelle Lac

CRICOS 00111D TOID 3059

Who is Michelle Lac?

https://au.linkedin.com/in/michellelac

+++

What is M-Learning?

• Personalised learning

• Learning while mobile

• Ubiquitous learning

• Anytime/anywhere learning

• Handheld learning

• +++

Ability to use mobile devices to support teaching and learning anywhere and anytime (Crescente and Lee, 2011)

List above source: Mehdipur, Y. and Zerehkafi H. 2013. “Mobile Learning for Education: Benefits and Challenges”, International Journal of Computational Engineering Research (3:6), pp93-101

Crescente, M. L., and Lee, D. 2011. “Critical issues of M-Learning: design models, adoption processes, and future trends”, Journal of the Chinese Institute of Industrial Engineers (28:2), pp111-123

Why is M-Learning Important?

Research and Markets. 2015. "Mobile Learning Market by Solution, by Applications, by User Type, & by Region - Global Forecast to 2020." Retrieved 27 May 2015, 2015, from http://www.researchandmarkets.com/research/vbbfmn/mobile_learning

M-Learning market forecasted to reach

USD$37.6 billion by 2020 (Research and Markets, 2015)

What are the Benefits? Why now?

M-Learning market forecasted to reach

USD$37.6 billion by 2020 (Research and Markets, 2015)

• Get up-to-date information to the learner

• Accelerates reinforcement and follow-up

• Is efficient

• Increased productivity & revenue

• Ability to use the mobile devices’...

But... How do you measure success? Brink, J. 2011. "M-Learning: The Future of Training Technology," T+D (65:2), pp. 27-29. Genzic, J., Grgic, I., and Gujic, M. 2014. "Education and Knowledge Management by Using an E-Learning and M-Learning Education," Varazdin: Varazdin Development and Entrepreneurship Agency (VADEA), pp. 548-560. Kahle-Piasecki, L., Miao, C., and Ariss, S. 2012. "Managers and the Mobile Device: M-Learning and M-Business-Implications for the United States and China," Journal of Marketing Development and Competitiveness (6:1), pp. 56-68. Macdonald, I., and Chiu, J. 2011. "Evaluating the Viability of Mobile Learning to Enhance Management Training," Canadian Journal of Learning and Technology (37:1), p. 12. Stober, D. R., and Putter, S. 2013. "Going Mobile & Micro: The New Frontier of Safety Training," Professional Safety (58:2), pp. 41-43. Tucker, J. S. 2010. "Mobile Learning Approaches for U.S. Army Training." Retrieved 7 August 2015, 2015, from http://www.dtic.mil/dtic/tr/fulltext/u2/a528742.pdf Woodill, G. 2013. "The Unique Affordances of Mobile Learning." Retrieved 24 July, 2015, from http://floatlearning.com/2013/11/the-unique-affordances-of-mobile-learning/

Camera

Geolocation

Microphone & audio recording

Notifications & alerts

Touch screens

Ubiquity

Voice/phone communications

Wearability

Portability/mobility

What has been published so far?

M-Learning market forecasted to reach

USD$37.6 billion by 2020 (Research and Markets, 2015)

• Not that much relating to the workforce

• Limited research found in:

– Design guidelines

– Efficacy evaluations

– Quantitative research

– Wider technological implications

• Literature focuses on some aspects of m-learning

Therefore, current PhD project was established…

M-Learning more holistically

Nasiri, A. and D. G. Shi (2014). "Mobile Learning Business Model Framework." Information Management and Business Review 6(2): 72-87.

Focus of this Research

Nasiri, A. and D. G. Shi (2014). "Mobile Learning Business Model Framework." Information Management and Business Review 6(2): 72-87.

Core Research Focus

Develop a Framework that includes:

• Guidelines for m-learning implementations

• Model explaining causal-relationships between factors

...for organisations to predict, measure and influence m-

learning success

... planning of initiatives to optimise desired outcomes

...measure and track ongoing success during & post

implementations

Models used

M-Learning market forecasted to reach

USD$37.6 billion by 2020 (Research and Markets, 2015)

Unified Theory of Acceptance and Use of Technology (UTAUT) model (Venkatesh et al. 2003)

1. The Theory of Reasoned Action (TRA)

2. The Technology Acceptance Model (TAM)

3. The Motivational Model (MM)

4. The Theory of Planned Behaviour (TPB)

5. A Combined Technology Acceptance Model/Theory of Planned Behaviour (C-TAM-TPB)

6. The Model of PC Utilisation (MPCU)

7. Innovation Diffusion Theory (IDT)

8. Social Cognitive Theory (SCT)

DeLone and McLean’s Information Systems (IS) success model (DeLone & McLean, 2003)

DeLone, W. H., and McLean, E. R. 2003. "The Delone and Mclean Model of Information Systems Success: A Ten-Year Update," Journal of Management Information Systems (19:4), pp. 9-30. Venkatesh, V., Morris, M. G., Davis, G. B., and Davis, F. D. 2003. "User Acceptance of Information Technology: Toward a Unified View," MIS Quarterly (27:3), pp. 425-478.

Models used

DeLone, W. H., and McLean, E. R. 2003. "The Delone and Mclean Model of Information Systems Success: A Ten-Year Update," Journal of Management Information Systems (19:4), pp. 9-30. Venkatesh, V., Morris, M. G., Davis, G. B., and Davis, F. D. 2003. "User Acceptance of Information Technology: Toward a Unified View," MIS Quarterly (27:3), pp. 425-478.

INFORMATION QUALITY

SYSTEM QUALITY

SERVICE QUALITY

INTENTION TO USE

USER SATISFACTION

NET BENEFITS

USE

Behavioural Intent to Use

Performance Expectancy

Social Influence & Facilitating Conditions

Effort Expectancy

Organisations

M-learning implemented

M-learning NOT implemented

Data collected ‘Likert’ scale Quantitative data

Open ended questions Qualitative data

Users Training (learning & development) managers

Online survey Face to face questionnaires

Online survey Face to face questionnaires

Research instruments

Research methodology

Phase 1

Oct 2015 to Mar 2016

Phase 2

Apr to Sep 2016

Phase 3

Oct to Dec 2016

Phase 4

Jan to May 2017

Establish Research Project

Design, test, rollout

survey and questionnaires

Identify companies to

participate

Conduct in-depth interview and focus groups

Publish interim findings

Finalise m-learning

framework

Today

Develop framework iteratively

Next steps

M-Learning market forecasted to reach

USD$37.6 billion by 2020 (Research and Markets, 2015)

Contact me if you (or

others) would like to participate

Spread the word and let others know about this Research

Questions?

Contact Details

Michelle Lac

mlac@swin.edu.au

0403 576 929

CRICOS 00111D TOID 3059