25
BMJ Portfolio – the early years Helen Morant

BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

Embed Size (px)

Citation preview

Page 1: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

BMJ Portfolio – the early yearsHelen Morant

Page 2: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

• context for BMJ Portfolio

• features of BMJ Portfolio

• our research

• usage

• analytics

• conclusions

Outline

Page 3: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

Section title (60%)

Full page bullet slide title

Page 4: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

BMJ Portfolio Development

Work (read, watch, attend, answer questions)

Record

Organise (calculate points, subject, format)

Report

Page 5: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline
Page 6: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline
Page 7: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline
Page 8: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline
Page 9: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline
Page 10: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline
Page 11: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline
Page 12: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

• Portfolio usage statistics• Google analytics• Qualitative survey

Our research

Page 13: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

There are 230932 distinct users with a portfolio containing at least one item.

13829 users have added at least one item in the last month (6%)

Only 1088 users have added at least on non learning module (0.5%)

Portfolio usage stats

Page 14: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline
Page 15: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

Profession85% Doctors<1% Medical students6% Nurses3% Other healthcare

professionals

Specialty34% General medicine5% Emergency medicine4% Family medicine4% Internal medicine3% OB/GYN3% Pediatrics2% Public Health2% Rheumatology

Survey – demographics

144 respondents – non compulsory answer.

Country of Residence44% United Kingdom4% - India3% - United States

Mobile Phone22% iPhone48% Other smartphone24% Basic mobile phone

Page 16: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

Survey – what could we improve? 58 respondents

Comment group Percentage

Don’t change a thing 14

Provide more help to users (I’m a luddite)

39 (17)

New feature suggestions 10

Improve interoperability 10

Make it free 7

Don’t use it enough to comment / other

20

Page 17: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

• By the looks of it I 'm only using it in a very limited way at present. It works for me like that just now so thank you. (GP, UK)

• Keep doing what your doing as it works fine (for me anyway) (GP, UK)

• Allow enhance 2 to link to bmj portfolio and earn 2 points for each completed module (GP, NZ)

• its very complicated with too many add ons and tags and fancy features (GP, UK)

• I have exported the portfolio onto the exel and put my scores I got on the modules GP, Japan

Survey – comments from users

Page 18: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

40% used BMJ portfolio and another ePortfolio

46% ONLY used BMJ portfolio

10% had never used an ePortfolio

4% ONLY used another ePortfolio

Survey – use of ePortfolios

Page 19: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

BMJ Portfolio Survey

Downloading reports

No49%

Yes51%

Page 20: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

Adding

item

s fro

m th

e TRIP

dat

abas

e

Using

the

brow

ser b

ookm

arkle

t fun

ction

Adding

item

s fro

m P

ortfo

lio m

obile

app

Adding

item

s fro

m O

nExa

mina

tion

Adding

item

s fro

m B

MJ

spec

ialist

jour

nals

Follow

ing a

cur

riculu

m u

sing

tags

ets

Chang

ing y

our a

ccre

ditor

Adding

item

s Fro

m B

MJ.

com

Custo

mizi

ng y

our p

ortfo

lio v

iew

Taggin

g ite

ms

in Por

tfolio

Adding

new

item

s in

Portfo

lio0

102030405060708090

100

Users unaware of available fea-tures

# o

f P

eop

le

Page 21: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

Event Unique Events

show details 5287

site settings 1827

Outbound 1764

new item 1220

export report 1070

delete resource 895

filter by date 601

clear filter 536filter by completion 529

show tags 388

Page 22: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

Export Report Behaviour

Export report start

1070

Export report pdf

63%

Export report cancel

14%

Show details

10%

Export report CSV

8%

Filters

4%

Page 23: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

BMJ Portfolio Development

Work (read, watch, attend, answer questions)

Record

Organise (calculate points, subject, format)

Report

Page 24: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

BMJ Portfolio development

Generic User Focussed Exportable

Page 25: BMJ Portfolio – the early years Helen Morant. context for BMJ Portfolio features of BMJ Portfolio our research usage analytics conclusions Outline

Few people use it as a standalone product

Simple features work and are used

Choice of portfolio may be influenced by extrinsic factors

Adoption doesn’t happen without either carrots or sticks

CONCLUSIONS