27
Peerage of Science Janne-Tuomas Seppänen, PhD #crossref14 @JanneSeppanen, @peeragescience

2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Embed Size (px)

Citation preview

Page 1: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Peerage of Science

Janne-Tuomas Seppänen, PhD

#crossref14

@JanneSeppanen, @peeragescience

Page 2: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

"Provide ships or sails adapted to the heavenly breezes, and there will be some who will brave even that void."

@JanneSeppanen, @peeragescience

Page 3: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Andrzej Mirecki

@JanneSeppanen, @peeragescience

Page 4: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

@JanneSeppanen, @peeragescience

Page 5: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

@JanneSeppanen, @peeragescience

Page 6: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

@JanneSeppanen, @peeragescience

Page 7: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

@JanneSeppanen, @peeragescience

Page 8: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Peer Review!

@JanneSeppanen, @peeragescience

Page 9: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Peer Review!

@JanneSeppanen, @peeragescience

Exclusive submission

Page 10: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Peer Review!

@JanneSeppanen, @peeragescience

Exclusive submission

Exclusive nomination of peers

Page 11: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Peer Review!

@JanneSeppanen, @peeragescience

Exclusive submission

Exclusive nomination of peers

Exclusive use of reviews

S T A P

S T E M

F A I L

Page 12: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Richard HortonEditor of Lancet

“peer review is biased, unjust,

unaccountable, incomplete, easily

fixed, often insulting, usually ignorant,

occasionally foolish, and frequently

wrong”

Richard Smith

ex-Editor of BMJ

“A woeful tale of the uselessness of

peer review”

“Peer review: a flawed process at the

heart of science and journals”

@JanneSeppanen, @peeragescience

Page 13: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

WHY?

- Peer reviewers feel they are doing housework?

- Appointed authority (editor) nominates just two

or three judges

- What is the consequence of failing as peer

reviewer?

- What is the consequence of excelling as peer

reviewer?

@JanneSeppanen, @peeragescience

Page 14: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Peerage of Science

@JanneSeppanen, @peeragescience

Give authors some ownership

Give reviewers some ownership

Let everybody (incl. Editor) choice on anonymity

Judge the peer reviewers, maker it matter to them!

Allow concurrent consideration across journals, or…

at least share the peer reviews

Page 15: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Old Henry’s Peerage of Science

Method comparison - duration

unpredictable, long

@JanneSeppanen, @peeragescience

Page 16: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Peerage of ScienceAuthor decides,

enforced

Method comparison - duration

@JanneSeppanen, @peeragescience

Page 17: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

20 days...... 2.5 peer reviews

Peerage of ScienceAuthor decides,

enforced

Method comparison - duration

@JanneSeppanen, @peeragescience

Page 18: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Old Henry’s Peerage of Science

Method comparison – who reviews

Editor solicitsreviews

@JanneSeppanen, @peeragescience

Page 19: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Peerage of Science

Editor may solicitreviews

Method comparison – who reviews

@JanneSeppanen, @peeragescience

Page 20: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Peerage of Science

Editor may solicitreviews + Peers can

engage freely

Method comparison – who reviews

@JanneSeppanen, @peeragescience

Page 21: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Old Henry’s Peerage of Science

Method comparison – quality control

Editor knowsreviewers

@JanneSeppanen, @peeragescience

Page 22: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Peerage of ScienceEditor knowsreviewers

Alfred R. Wallace ([email protected])

Method comparison – who reviews

@JanneSeppanen, @peeragescience

Page 23: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Alfred R. Wallace ([email protected])

Peerage of Science

+ peer reviews arepeer-reviewed

Editor knowsreviewers

Method comparison – who reviews

@JanneSeppanen, @peeragescience

Page 24: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Old Henry’s Peerage of Science

Method comparison – submissions

sequential

@JanneSeppanen, @peeragescience

Page 25: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Peerage of Science

first concurrent, thensequential

@JanneSeppanen, @peeragescience

Page 26: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Peerage of Science

first concurrent, thensequential

@JanneSeppanen, @peeragescience

Page 27: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions

Thank you!

Janne-Tuomas Seppänen, PhD

#crossref14

@JanneSeppanen, @peeragescience