SciVal Introductory session Dr Charles Martinez Customer ... · Introducing Field-Weighted Citation...

SciVal Introductory session

Dr Charles Martinez

Customer Consultant

Agenda

1. Scopus: The data source of SciVal

2. Metrics in SciVal – how to use responsibly

3. SciVal

Scopus

Scopus is the largest abstract and citation database of peer-reviewed

literature, and features smart tools that allow you to track, analyze and

visualize scholarly research.

Scopus delivers a comprehensive view on the world of research.

No packages, no add-ons. One all-inclusive subscription.

76 million+

Informing national research assessments, policies & reports

Provision of citation data services for national assessments as well as data, analyses and insights for national and international reports

BIS reports ‘11 ,’13 & BEIS ‘16

Gender report – now available at

institutional level

THE World University Rankings (from ‘15) and data partner for QS

Introduction to Metrics in SciVal

Bibliometrics 101

Bibliometrics are measures of output and indicators of impact.

Probably the simplest bibliometric is a count of publications. More advanced

bibliometrics help you to understand the impact of your academic publications

within the scope of the worldwide research community.

You can use bibliometrics to look at different types

of impact.Your impact at point of publication:

• What are the top journals in your field? Where should you aim to publish?

• Have you been successful in getting your paper into an above average journal for your research area?

Your impact post publication (otherwise known as citation impact):

• How many times has your paper been cited?

• Has your paper attracted more citations than normal?

• Who is citing your work? Which researchers from which institutions?

Your impact through knowledge transfer:

• From which subject areas are most of your citations coming?

• Are any research fields outside of your own unexpectedly interested in your work?

Your impact through collaboration:

• Who do you publish with most? And, who do they publish with most?

• How international is the scope of your collaboration?

• Are you overlooking any potential collaboration opportunities?

Research metrics guidebook

• Understanding

metrics

- Scopus as data source

• Selection of

appropriate metrics

- What affects their

values, besides

performance?

• For each metric

- Situations in which they are useful

- When to take care and

how to address short-

comings

- Worked examples

The importance of triangulation

Expert opinion

Peer review

Reliable data

Strategic

Planning

for

Research External Review

No single metric is perfect. Always

use at least two metrics to give

insight into your question

A broad range of metrics is essential

for you to be able to address your

many questions,

No data set is perfect. Always reinforce your

evidence-based conclusions with at least one of,

and ideally both, peer review and expert opinion

Journal metrics in SciVal

Modified SNIP

• Refined metric calculation, better corrects for

field differences

• Outlier scores are closer to average

• Readily understandable scoring scale with an

average of 1 for easy comparison

Modified SJR

• More prestigious nature of citations that

come from within the same, or a closely

related field

• Readily understandable scoring scale with

an average of 1 for easy comparison

Introducing Field-Weighted Citation Impact

(FWCI)• FWCI indicates how the number of citations received by an entity’s publications

compares with the average number of citations received by all other similar publications in the data universe

• A FWCI of 1.00 indicates that the entity’s publications have been cited exactly as would be expected based on the global average for similar publications

• Imperial College London has a FWCI of 2.18 for period 2013-2018 meaning that your publications are cited over twice as much as the world average

• The UK had a FWCI of 1.57 for the same period

• Best used with:

• Citation Count and Citations per Publication

• ‘Time-independent metrics’ e.g. Collaboration, Academic-Corporate Collaboration and Publications in Top Journal Percentiles

Limitations of FWCI

Not recommended for small publication sets (such as a researcher’s

output) - Entities are small so that the metric may fluctuate significantly and

appear unstable over time. Field-Weighted Citation Impact calculates an

average value, and these types of calculations are strongly influenced by

outlying publications in a small data set

FWCI is a time dependent metric, recently published material where the short

time that has passed since publication will reduce the reliability of basing

decisions on citation information.

Preamble

• Don’t assume that senior decision makers necessarily understand the

principles of responsible metrics we discussed earlier

• They may be obsessed with the size of their h-index or the Impact Factor

of the Journal they edit

• They may not unaware of subject differences

• They may want a quick answer that confirms their prejudices

• Your challenge, should you accept it, is to help prevent metricide!

Getting Started

SciVal overview

SciVal offers quick, easy access to the research performance of 220 nations and

>10000 research institutions worldwide.

Overview: institutional performance indicators

Overview: institutional performance indicators

Collaborations

Publications

Publication Strategy

Durrant Group

Durrant Group

Topics of Prominence

Network Graphs – Production, Collaboration, Impact, Visualization..

Topics of Prominence

Looking at a specific institution

to collaborate with..

• What are the most prominent

topics this institution is active in

?

• What is this institution’s

presence in topics of

prominence across the subject

fields ?

• Show me the dynamics within

this topic, the top performers

and rising stars ?

• Are there any other topics I

should keep an eye on ?

Recent advances in clustering and modelling

science allow us to partition science into Topics

• We have identified ~100.000 global research topics and ranked them byProminence.

• Prominence is a new indicator that shows the current momentum of a topic by looking at citations, views and CiteScore values.

• Prominence predicts funding – helps researchers and research managers identify topics in which funding will increase.

• Going way beyond what the competition can do…

Topics of Prominence—A Planning Solution

Topics of Prominence

Topics of Prominence

Topics of Prominence

Topics of Prominence

Topics of Prominence

Topics of Prominence

Patent citations

Patent citations

Patent citations

Patent Metrics on SciVal

Article 1

Patent 1

ACME Group

Patent 2

Wayne Enterprises

Article 2

Patent 3Stark

Industries

Citing-Patents Count = 3

Patent-Cited Scholarly Output = 2

Patent-Citations Count = 4

3 patents have cited your research - Citing-Patents Count

2 scholarly outputs have been cited by patents - Patent-Cited Scholarly Output

Your research has been cited in patents 4 times - Patent-Citations Count

(remember a patent could cite different publications at a time)

University Articles

NB patent

citations can be found at an article level on Scopus

How can I benchmark Imperial College against other

institutions?

How can I benchmark Imperial College London

against other institutions?

Who do you collaborate with in China?

Who do you collaborate with in China?

What is behind the collaboration?

Which corporates do you co-author with?

Exploring Topics further with Trends

Exploring Topics further with Trends

Exploring Topics further with Trends

Exploring Topics further with Trends

Thank you