58
Heather Piwowar @researchremix cofounder of @ImpactStory EdFuture 2012 #CFHE12 Impact beyond the Impact Factor some photos NC, SA

Impact beyond the Impact Factor

Embed Size (px)

DESCRIPTION

Presentation by Heather Piwowar on Nov 15, 2012 in a webinar hosted by EdFuture 2012 #CFHE12

Citation preview

Page 1: Impact beyond the Impact Factor

Heather  Piwowar  @researchremix  cofounder  of  @ImpactStory

EdFuture  2012    #CFHE12

Impactbeyond the

Impact Factor

some photos NC, SA

Page 2: Impact beyond the Impact Factor

Research evaluation matters

Page 3: Impact beyond the Impact Factor

who gets hired

who gets grants

which journals succeed

which journal innovations succeed

whether we publish in journals at all

whether we actually write articles

the whole structure of scientific communication

Page 4: Impact beyond the Impact Factor

right now, impact factor

Page 5: Impact beyond the Impact Factor

evaluated based on the container that publishes the research

Page 6: Impact beyond the Impact Factor

impact factor is

the average number of citations received by an article in that journal

within first 2 years of publication

Page 7: Impact beyond the Impact Factor

rewards impact based on a journal pecking order

Page 8: Impact beyond the Impact Factor

right now, evaluation looks like this

Page 9: Impact beyond the Impact Factor

problems!

prefiltered

run-away hits

decision of 4 anonymous people

only one type of impact

favours established venues

expensive

closed

Page 10: Impact beyond the Impact Factor

Impactbeyond the

Impact Factor

pause for Qs (h:mute)

Page 11: Impact beyond the Impact Factor

what can the world look like

Page 12: Impact beyond the Impact Factor

beyond the Impact Factor

Page 13: Impact beyond the Impact Factor
Page 15: Impact beyond the Impact Factor
Page 16: Impact beyond the Impact Factor
Page 17: Impact beyond the Impact Factor
Page 18: Impact beyond the Impact Factor
Page 19: Impact beyond the Impact Factor
Page 20: Impact beyond the Impact Factor

right now, evaluation looks like this

Page 21: Impact beyond the Impact Factor

it can look like this

Page 22: Impact beyond the Impact Factor
Page 23: Impact beyond the Impact Factor

even better, it can look like this

Page 24: Impact beyond the Impact Factor

not just for articles

Page 25: Impact beyond the Impact Factor

not just two years from now

http://arxiv.org/html/1203.4745

Page 26: Impact beyond the Impact Factor

not just on a website

Page 27: Impact beyond the Impact Factor

CC-BY-NC by maniacyak on flickrhttp://www.flickr.com/photos/maniacyak/3432589472

not just winners and losersimpact flavors!

Page 28: Impact beyond the Impact Factor

#altmetrics

fastflavourfulopenwith contextbeyond the article

Page 29: Impact beyond the Impact Factor

altmetrics.org/tools

Altmetric.comImpactStoryPLOS article-level metricsPlum AnalyticsReader MeterScience Card

Page 30: Impact beyond the Impact Factor
Page 31: Impact beyond the Impact Factor

Impactbeyond the

Impact Factor

pause for Qs (h:mute)

Page 32: Impact beyond the Impact Factor
Page 33: Impact beyond the Impact Factor

Tell the full story of research impact.

ImpactStory.org

Page 34: Impact beyond the Impact Factor

born as total-impact

Nonprofit

Board: Cameron Neylon, John Wilbanks

Page 35: Impact beyond the Impact Factor
Page 36: Impact beyond the Impact Factor
Page 37: Impact beyond the Impact Factor
Page 38: Impact beyond the Impact Factor
Page 39: Impact beyond the Impact Factor
Page 40: Impact beyond the Impact Factor
Page 41: Impact beyond the Impact Factor
Page 42: Impact beyond the Impact Factor
Page 43: Impact beyond the Impact Factor
Page 45: Impact beyond the Impact Factor
Page 46: Impact beyond the Impact Factor

embedding in journals

rOpenSciPlum demo

Ubiquity PressPeerEv

dissertationsIR experiments

...

Page 47: Impact beyond the Impact Factor
Page 48: Impact beyond the Impact Factor
Page 49: Impact beyond the Impact Factor

barrier-based $$

Page 50: Impact beyond the Impact Factor
Page 51: Impact beyond the Impact Factor

barrier-based pond

Page 53: Impact beyond the Impact Factor

ImpactStory.org

altmetrics.org/tools

Page 54: Impact beyond the Impact Factor

Changes are happening in scholarly communication.

http://www.flickr.com/photos/myklroventine/892446624/

Page 56: Impact beyond the Impact Factor

Tell the full story of our research impact.

Page 57: Impact beyond the Impact Factor

thank you!Jason Priem: cofounder of ImpactStory

Also: Todd Vision, Mike Whitlock, the open science community, and those who release their articles, datasets and photos openly.

[email protected]

@ImpactStory

ImpactStory.org

Page 58: Impact beyond the Impact Factor