Evaluating and scoring scientific papers in bibliographies and the connection to

SICRIS and COBISS systems

Ljubljana, 8th October 2013

Dr. Stojan Pečlin

Sources of Quantitative Data - COBISS

COBISS•The introduction of COBISS as an evaluation tool increased the objectivity of the evaluation process,• Introduction of the COBISS database as the official database for publications used in the evaluation procedures in 1997 gave a significant momentum to the change of habits in publication,• It caused a shift toward publishing in international journals with high reputation,•The reputation of researchers is no longer based on abstract criteria but is grounded on solid quantitative data,•The criteria for evaluating publications are available and anyone is easily able to determine the significance of publications according to pre-set criteria.

On-line bibliographic data: COBISS

Typology of documents for bibliography management in COBISS – selected

documents

1.01 Original scientific article (from 40 to 300 points),1.02 Review article,1.16 Chapter in a monograph published by an international science publishing house – 60 points,2.01 Monograph published by an international science publishing house - 160 points,2.24 Patent awarded at the European Patent Office, U.S. Patent Office – 200 points,2.20 Data publication (Zaključena znanstvena zbirka podatkov) – 30 points

Sources of Quantitative Data - SICRIS

SICRIS

• incorporates substantial information on research and research results,

• provides information on all projects funded by public funds,

• an integral system which supplements COBISS with more substantial information.

Score for a quantitative assessment

Quantitative assessment type

Source Maximum score

A1 - Sicris score Sicris (COBISS) 5

A2 - norm number of pure citations

Sicris (Web of Science) 10

A3 - funds of other users Agency 10

A4 – exceptional achievements in scientific excellence

Sicris (COBISS, WoS) 2

PETER DOVČ [05098]

Criteria for determining eligibility for a principal investigator of research project

A1 (0-5) maximum value 1500 points Doseženo število točk:735 Note: 2,45

A2 (0-10) maximum value 600 points

Doseženo število citatov: 1061 Note:10

Shows a minimum total score of scientific publications in the last five years, as cited in the last ten years and documented collaboration with other funders in the last five years and the outstanding achievements.

Note (A1+A2+A3+A4): 15,47

Eligibility criteria –entry conditions

The limit value of the sum A1+A2+A3+A4 which the project leaders must have in the application for each field separately – the values for 2013 are:

Basic project: A1+A2+A3+A4=5.5 natural sciences

A1+A2+A3+A4=5.0 technical sciences A1+A2+A3+A4=2.5 medical sciences, pharmaceutical sciences and geology

A1+A2+A3+A4=3,5 biotechnology and biology A1+A2+A3+A4=2.0 social sciences and clinical medicine

A1+A2+A3+A4=2.5 humanities

Use of quantitative indicators

• Pre-filtering focused on scientific and broader criteria is for potential applicants already done in a stage of eligibility screening. •Determination of researchers who can automatically enter the second round of assessment on the basis of the sum of indicators (A1+A2+A3+A4).

•An important reason for introducing this was to decrease the burden of administration, at least for the majority of researchers who already have a rich bibliographic record to prove their excellence.

Thank you for your attention!stojan.peclin@arrs.si