Upload
whitby
View
61
Download
1
Tags:
Embed Size (px)
DESCRIPTION
Last edited 2013-06-27. Bibliometrics and Publishing. Peter Sjögårde & Staffan Karlsson, Bibliometric analysts KTH Royal Institute of Technology, ECE School of Education and Communication in Engineering Sciences (ECE), Unit for Publication Infrastructure. - PowerPoint PPT Presentation
Citation preview
Bibliometrics and PublishingPeter Sjögårde & Staffan Karlsson, Bibliometric analystsKTH Royal Institute of Technology, ECE School of Education and Communication in Engineering Sciences (ECE), Unit for Publication Infrastructure
Last edited 2013-06-27
What is bibliometrics and why bother about it?
Is someone reading and building on your results?Statistics on publications and citationsMeasuring Impact on research societyUsed for evaluation of research• Publication level• Individual level• Organizational level
Use of bibliometrics Research assessment at KTH
University rankings
Funding allocation(part of future peer assessment?) Research funders
Recruitment of researchers
Bibliometric indicators
Field normalized citation rateH-indexJournal Impact Factor
Photo - http://www.flickr.com/photos/tysonneil/179407461/
Field normalized citation rate
For a publication:
Same research field same yearsame document type
Average = 1
Field normalized citation rate
Used at different levels• Rankings (university level)• Funding allocation (university level)• Assessment (research groups)
2004 2005 2006 2007 2008 2009 20100.000.200.400.600.801.001.201.401.601.802.00
RAE2012 - Time series of average field normalized citation rate for KTH (full counts, 3 year sliding averages,
KI)
Year
Field
nor
mali
sed
citat
ion ra
te
H-index
H-indexUsed at individual level
• Recruitment• Research fundingDefinition:
”A scientist has index h if h of his/her Np papers have at least h citations each, and the other (Np − h) papers have no more than h citations each.”
H-index
Bibliometrics at KTH
• Research Assessment Exercise (research groups, UoA)• Yearly indicator report (KTH Schools)• Funding allocation
Funding allocation
Field normalized citation rateRelative to size of school budget (size of school)Currently, re-allocation of 20 MSEK of KTH research funds
Research Assessment Exercise
Researcher basedWide range of indicators• Publishing
– Number of publications– Coverage in Web of Science– Field normalized citation rate of the journals, in average.
• Impact– Citations – Field normalized citation rate– Share of 10% most cited publications in the research field.
• Collaboration – Share of internationally co-authored publications
Yearly indicator report
• Number of peer reviewed articles • Number of peer reviewed conference papers• Field normalized citation rate• Top 10% publications• Number and Share of level 2 publications in the
Norwegian system• Number of publications co-published with industry• Share of publications internationally co-published
Databases used for bibliometrics
Web of Science is the most important database for bibliometric analysesScopus is the second most important, (and more or less the only alternative)
Google Scholar
Good search toolCover all types of publications (including patents)
Not used for ”serious” bibliometrics• Poorly defined contents• Normalizations not possiblePrimitive user interfaceThird-party user interface: Publish or perish (http://www.harzing.com/pop.htm)
Google Scholar
Choice of journal
Relevance to subject
AudienceOutreach
Peer review process
LanguageImpact
Format
Open Access
In Web of Science?
In Scopus?
Google/Google Scholar
Journal Prestige
Journal Impact
Much discussed and critizedeg http://www.sciencemag.org/content/340/6134/787.full and http://am.ascb.org/dora/
JIF is a poor proxy for the number of citations to expect. Overrated as an indicator of where to publish to maximize citations
Could be useful as a proxy for the ”brand value” of a paper - for indivduals and universities
Science 17 May 2013
Journal Impact Factor (JIF)How is it calculated?
JIF = Citations 2012 / Citable Items 2010-2011
Thomson Reuters description http://thomsonreuters.com/products_services/science/free/essays/impact_factor/
Citations from 2012
Issues from 2010-2011
To access Journal Citation Reports
Through the KTH-library site select>Search Tools > Databases > Web of Knowledge > Add Resources > Journal Citation Reportshttps://www.kth.se/kthb
Journal Impact Factor (JIF)a measure of the speed at which content in a particular journal is
picked up and referred to
Eigenfactor Score = the percentage of the total weighted citations that journal i receives. It is adjusted for differences in citation patterns among disciplines. Article Influence Score = a measure of the per-article citation influence of the journal
Alternatives to the WoS JIFEigenfactor.org • eigenfactor.org or through Web of Knowledge• Based on WoS (ca 8 300 journals)• Field normalized (using a PageRank algorithm)• Citations from high impact journals are valued higher• Are not influenced by journal self-citation. SCImago journal rank • scimagojr.com/journalrank.php or through Scopus• Based on Scopus data (ca 20 000 journals)• Field normalized (using a PageRank algorithm)SNIP (source normalized impact)• through Scopus• Based on Scopus (probably also WoS in the future)• “Source normalized” more fair evaluation of applied fields
To access Scopus
Through the KTH-library site>Search Tools > Databases > Scopus > Analyticshttps://www.kth.se/kthb
Improving your visibility using uniqe author identifiersOpen Researcher and Contributor ID
http://orcid.org/
ORCID can import publication data from
Scopus Author IDResearcherID (Web of Science)CrossRef
Personal ORCID siteeg http://orcid.org/0000-0002-5739-5213
DiVA – KTH publication database
Budget citation indicator and school indicators KTH RAE 2012Dynamic listings for • CV• Profile pages• web pages
DiVA
The researchers at KTH should register all new publications not registered by Web of Science or Scopus
When register:• Check for duplicates• KTH-ID (u1l3g15d)• Organization• WoS-ID
DiVA
• Check for duplicates
DiVA
• Organization
DiVA
• Web of Science ID
DiVA
Strategic research areas
Open Access
Green – Parallel publishing Gold – Publishing in Open Access journals
Open Access
Mandated by • VR • Riksbankens jubileumsfond• Formas• Knut och Alice Wallenbergs stiftelse• Seventh Framework Programme (FP7)• European Research Council (ERC)
More impact/citations with Open Access?
Some studies show that OA articles get more downloads and more citations - Other show no advantage - debate is still going on• More possible citers• Easier access• Easier indexing for web crawlers• Better visibility outside the research communityNo contradiction between OA and high impact factor journals• If choosing to publish in OA journals the same recommendations apply
– Check outreach and impact– Check the peer review process– Relevance– …
Citations and collaboration
1 2 3 4 5 6 7 8 9 100.00
0.20
0.40
0.60
0.80
1.00
1.20
1.40
1.60
1.80
2.00
0
2
4
6
8
10
12
14
16
Correlation between citation rates and number of au-thors in RAE2012
Field normalized citation rate (WoS)Average number of ci-tations (WoS)
Number of authors
Fiel
d no
rmal
ized
cita
tion
rate
Cita
tions
Citations and collaboration
0 20 40 60 80 100 1200
20
40
60
80
100
120
140
Correlation between citation rate and number of authors in RAE2012
Authors
Field
nor
alize
d cit
atio
n ra
te
Publications with less than 100 authors included
Social media
Why?• Find publications• Share publications• Make research visual• CollaborateCorrelation between social media impact and bibliometrics?Differences between research fields
Altmetrics
KTH’s policy for scientific publishing
Publish in international high-impact journalsMake articles freely available by publishing in Open Access journals or do parallel publishingWrite popular science to increase KTH visibility and impact on societyRegister publications in the KTH publication database DiVA
Aim: To make KTH's scientific publishing more visible for the international scientific community and the general public
http://www.kth.se/en/kthb/publicering/vagledning/policydokument-1.182530
Affiliation
KTH Royal Institute of Technology
Summary of KTH’s Publishing guide
Check the outreach of your publishing channel.
Check the impact of your journal.
Publish in English.
Plan your research and publishing for cooperation.
Use a unique and consistent author name.
Write your organizational affiliation in a way that is easy to identify by an international audience.
Register your publication in the KTH publication database DiVA.
Publish your article Open Access if possible.
Contact the Department of Publication Infrastructure at the ECE School for support and more
information.
Ulf Kronman, 2011, Guide to Scientific Publication Management for Researchers at the KTH Royal Institute of Technology, URL: http://kth.diva-portal.org/smash/record.jsf?pid=diva2:450945
Comments/questions to:Peter Sjögårde, Bibliometric Analyst
Staffan Karlsson, Bibliometric Analyst
KTH Royal Institute of Technology
School of Education and Communication in Engineering Sciences (ECE)
Unit for Publication Infrastructure