Research Workshop

Melissa Badenhorst WorldWide Information Services

Agent: Thomson Reuters

Trends in scholarly research

• Challenges faced by research community are multiple and

complex

• Competition for government research funding increasing

• Accountability:

– Research spending

– Demonstrating return on investment (ROI)

• PR Personnel responsible:

– Advertisements

– Publish journals

– Recruitment events and community outreach programmes

• Require variety of statistics to support their message

Result: Institutions seek objective data on research performance,

for data-based decision making

.

Communicating the “success” of research can be complicated,

multi-faceted, with subjective factors included.

Therefore reliable, objective information is extremely valuable

in research evaluation exercises.

The Research Assessment “Need”:

Objective Information for both Institution

and Individual to Reveal Influence/Success

and Support Decision-making

We know that a “Citation” to published work

is an acknowledgement of an intellectual

debt to that work, evidence of it’s influence.

“Bibliometrics” or “citation metrics” have

become a critical piece of research

assessment exercises.

Citation Metrics

Awards and

Honors

Funding data

Peer review

4

Science

Citation Index Arts &

Humanities

Citation Index

WOK 4.0 Social

Sciences

Citation

Index

ISI Web of

Knowledge

1960 1965 1970 1975 1980 1985 1990 1995 2000 2005 2007 2008 2009 2011

SciSearch Century of

Science TS Innovation

Essential

Science

Indicators PC-based Indicators

for journals, nations,

institutions

Custom citation projects

and national indicators -

mainframe

PC-based citation sets

Thomson Reuters Web of Science(formerly ISI) has been the authority on citation data for over 100 years.

InCites

WOK 5.0

WHERE TO PUBLISH

WHERE TO PUBLISH? THOMSON REUTERS JOURNAL CITATION REPORTS

• DHET (Dept of Higher Education & Training) uses 3 lists for accreditation

purposes: Web of Science (ISI), IBSS & South African Journal list

• Ranking agencies uses Web of Science data to calculate the ranking of

institutions such as: Times Higher Education, Leiden University Ranking,

Shanghai ranking agency, etc

• JCR uses Web of Science data to calculate the impact factor

Accessing the JCR from Web of Knowledge

JCR Home Page

Before starting, click on

Information for New

Users and read “Using

the JCR Wisely.” The

“Notices” link will include

useful information about

titles changes and title

suppressions in this years’

edition.

Science and Social Science

editions must be searched

separately

View a group of journals – Subject Category

Select one or more categories of

journals to view.

Journal Summary List Use the drop down to select how you

would like the journals arranged, then

click “Sort Again”

Full Journal Record

Calculating the Journal Impact Factor

The journal’s Impact Factor is calculated by

dividing the number of citations made in 2011 to items

published in the previous two years (2009 & 2010) by the

total number of articles & reviews published in the previous

two years

2011 cites to items published in 2009 and 2010

# of articles/reviews published in 2009 and 2010

Journal Rank in categories

Journal Rank in categories

Access to JCR from the Web of Science

Five Year Impact Factor Trend Graph

•Entry point into JCR from Web of Science

•Indicates the Journal’s Impact Factor over the latest

five years

HOW TO FIND JOURNALS RELATED TO YOUR TOPIC SEARCH

18

WEB OF SCIENCE

19

WEB OF SCIENCE

20

WEB OF SCIENCE

21

WEB OF SCIENCE

22

WEB OF SCIENCE

23

WEB OF SCIENCE

24

WEB OF SCIENCE

RESEARCH EVALUATION

SOUTH AFRICAN RESEARCH VS SOUTH AFRICAN JOURNALS

UNISA PERFORMANCE: Nr of papers published overall

SOURCE: InCitesTM, Thomson Reuters (2012)

UNISA PERFORMANCE: Impact of papers compared to global average

SOURCE: InCitesTM, Thomson Reuters (2012)

UNISA PERFORMANCE: Nr of papers published – International Collaboration

SOURCE: InCitesTM, Thomson Reuters (2012).

UNISA PERFORMANCE: Impact of papers compared with international collaboration

SOURCE: InCitesTM, Thomson Reuters (2012)

SOURCE: InCitesTM, Thomson Reuters (2012)

UNISA PERFORMANCE: Impact of subject

areas compared to global average last 10 years

UNISA PERFORMANCE: Impact of subject areas compared to global average last 5 years

SOURCE: InCitesTM, Thomson Reuters (2012)

UNISA PERFORMANCE: Impact of subject areas compared to global average last 5 years

SOURCE: InCitesTM, Thomson Reuters (2012)

UNISA COLLABORATION NETWORK: Material Science

SOURCE: InCitesTM, Thomson Reuters (2012)

Evaluating Citation Impact of Individual Paper

• Many factors play a role: year of publication, document type,

subject area and journal

• Normalised indicators are needed to level playing field and

compare researchers with one another.

• Types of Metrics:

Relative Impact/

Bench-marking

Journal actual/expected citation rate

Category actual/ expected citation rate

Percentile in category and mean percentile

% papers in top 10% of their field

% papers in top 1% of their field

Aggregate Performance Indicator

Productivity # papers

Total influence # citations

Efficiency Avg. citation rate

Percent of papers cited

ARTICLE LEVEL INDICATORS

36 Source: Thomson Reuters InCites

This paper has received

45/16.74 = 2.69 times the

expected citations for this

subject category

This paper has received

45/21.48 = 2.09 times the

expected citations for this

journal

Integrative &

Complementary Medicine

articles from 2005 have

been cited 16.74 times

Articles published

in this journal from

2005 have been

cited 21.48 times

RESEARCHERID

What is ResearcherID

• www.researcherid.com

• Online registry for creating a unique researcher ID

number

• Build a publication list identifying your work

• Make your profile public or private

– Public profiles can be searched and viewed by others

• Generate citation metrics including:

• H-index

• Citation distribution per year

• Total Times Cited count

• Average Times Cited

Global research community where researchers connect

CREATING A PROFILE

ORCID Integration

http://www.researcherid.com

http://www.webofknowledge.com

BUILDING A PROFILE

SEARCHING RESEARCHERID

RESEARCHERID HOME PAGE

SEARCHING FOR RESEARCHERS: By Institution

Viewing a profile: Nelius Boshoff

RESEARCHER ID VISUALISE CITING AUTHORS

SEARCHING FOR RESEARCHERS: World Map

RESEARCHER ID

RESEARCHER ID VISUALISE CITING AUTHORS

HOW TO SUGGEST A JOURNAL TO BE INCLUDED IN WEB OF SCIENCE

• The detailed process on how to submit a journal:

http://science.thomsonreuters.com/mjl/selection/

• Recommending a journal for evaluation has the same electronic submission

form as submitting your own journal:

http://science.thomsonreuters.com/info/journalsubmission/

• Inquiring about the status of evaluation:

http://science.thomsonreuters.com/info/jrneval-status/

57