Taking Measurement Mobile: Assessing mLearning

Taking Measurement Mobile: Assessing mLearning

Donna WellsCEO, Mindflash.comTwitter: @donnawells

http://www.mindflash.com/

Twitter: @donnawells


Analyzed results from nearly 250,000 courses delivered on Mindflash LMS in past 6 weeks.

• Only courses with more than 100 completions or more• Courses with completions both via Desktop and Mobile channels

Key is tying training results to key business metrics

Training Metrics analyzed• Course Completion Rates• Average Scores• Time Required to Complete • Likelihood to Reference

Business results used by our Customers• Sales by trained/untrained employees, resellers, franchisees, etc.• Cost savings from moving live training partly or fully online• Speed or Scale achieved at same cost

3

Mobile small but growing...especially over the weekend

Mobile 12%

Mon Tues Weds Thurs Fri Sat Sun0%

5%

10%

15%

20%

25%

Course Views

Desktop Mobile

Desktop 88%


Mobile Learners as likely to Complete and Comprehend

Desktop Mobile

90%84%

Completion Rateof those Starting Course

Desktop Mobile

94% 94%

Average Score


But Mobile learners completing course in half the time ...

Desktop Mobile

100

50

Average Time to Complete (Index)

Desktop Mobile

100

120

Reviewed Later(Index)

... and 20% more likely to reference again


Mobile Learners less active during “Office Hours”...

... more active from close of business to Midnight

0.25 7 8 9 10 11 0.5 1 2 3 4 5 6 7 8 9 10 11 0 1 2 3 4 50%

1%

2%

3%

4%

5%

6%

7%

8%

9%

Desktop

Mobile


Completion Rates can vary significantly with Mobile vs. Desktop course-taking ... on SAME course

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 6920%

30%

40%

50%

60%

70%

80%

90%

100%

Completion Rate by ChannelDesktop Mobile

Courses

Rates differed 15% on average, but as much as 80%


Primary Driver of Mobile Course Completion Rates is Course Size/Length

1 to 10 11 to 20 21 to 30 31 to 40 41 to 50 >5175%

80%

85%

90%

95%

100%

Course Completion Rates by Size of CourseSize = Number of “Slides”

Desktop

Mobile


Completion Rates can also be influenced by the types of Content formats used

PDF PPT Video YouTube Video

Word Narration SCORM, Other

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

Frequency of Content TypeSame Course, More Successful on Desktop vs. on Mobile

Desktop Completion Higher Mobile Completion Higher

Courses with more PowerPoint got higher completion rates on Desktop

Courses with more YouTube and Word content got higher completion rates on Mobile


10

Tying Course Outcomes to Business Results

More Case Studies: https://www.mindflash.com/customers/

Innovative, premium priced products

Training mobile, distributed sales team

5,000+ online course completions by remote sales staff

Daily sales up 4X since iPad–delivered training introduced

Software company selling via resellers

Delivering in-person did not scale with rapid company growth

Over 12,000 reseller course completions

Resellers completing series of 3 courses selling 400% more


https://www.mindflash.com/customers/

https://www.mindflash.com/customers/

11

Five Best Practices Summary

1. Learners showing equal success on same course whether desktop or mobile. Mobile learners achieving same outcomes in half the time.

2. Providing mobile course access likely to increase percent of learners who reference course content after initial course completion

3. Shorter! Mobile learners much more sensitive to Course length vs. Desktop. Break into a Series of shorter Courses, requiring sequential passing.

4. Consider swapping PowerPoint for Word and increasing usage of Video to improve experience and success among Mobile learners

5. Correlate Training outcomes with Business outcomes. Integrate LMS data with CRM or Financial Systems data, ideally.

Caveat: Your results may vary. Analyze your learners’ results on Mobile vs. Desktop... (e.g. Ask at time of course registration or via and end-of-course survey. Or provided in reporting.)


12


Donna WellsCEO, Mindflash.comTwitter: @donnawells

http://www.mindflash.com/