Research Institute’s CRIS as a Source of Data for Assessing

Research Results

Sergey Parinov, CEMI RASSocionet project

How we can develop CRIS to provide …

• complex, detailed and accurate data for better assessing research results and researchers by:

– Higher Attestation Commission (VAK) experts – Research Foundations, e.g. Russian Foundation for

Basic Research to evaluate proposals– Managers of research organizations to make right

motivations of scientists

• CRIS has to be a part of research e-infrastructure

What we can develop in CRIS and in research e-infrastructure:

• Tools for electronic depositing of research results to give experts full and accessible set of research results

• Tools and services for linking relative research materials and maintaining networks of such relations to give experts complexity of data

• Tools and services for better research results usage and its monitoring to give experts more accurate and realistic data for research assessments

Full and accessible data on research results

• CRIS provides a tool for electronic depositing by researchers of all their research results (as articles)

• Research e-infrastructure provides an integration mechanism to build an unified information space from local CRISs’ data

• Interactions between local CRISs and integration mechanism can based on OAI-PMH protocol and CERIF data format

• Current problem: lack of motivation for researchers

Electronic depositing tools

• There are many systems, which support OAI-PMH protocol (Eprints, Dspace, Socionet Personal Zone, etc.) and few of them supporting CERIF format (e.g. SPZ)

• Using Socionet Personal Zone (spz.socionet.ru) services a researcher can:– Deposit his/her single materials in thematic series of Socionet

Open Archive– Create and maintain any number of different types own series

(preprints, postprints, personal and institution profiles, news, comments, projects, thesis, etc.) collecting any number of materials/articles

Institutional Repository (IR) Tools

• Using Socionet Personal Zone a research institute can integrate all types series created by different people from their staff as IR with OAI-PMH/CERIF features

• Many people from the institute can create and maintain their thematic collections of research materials and institute’s admin can integrate it as IR

• By this way research institutes of Social Science Section of RAS built 21 IR, and as a result Russia moved to 14 position in an international rating

IRs in Russia (October 2008)ОА_Вологодский научно-координационный центр ЦЭМИ РАН    (дата: 2008-01-16 )  Ригин Василий Александрович

ОА_Центр египтологических исследований РАН    (дата: 2007-12-10 )  Давыдова Алла Борисовна

ОА_Институт экономики и организации промышленного производства СО РАН    (дата: 2007-12-04 )  Колобова Елена Анатольевна

ОА_Отделение международных экономических и политических исследований (Филиал Института экономики РАН)    (дата: 2007-12-04 )  Соколова Татьяна Владимировна

ОА_Институт Европы РАН    (дата: 2007-11-26 )  Слесаренко Мария Альбертовна

ОА_Институт философии Российской Академии Наук    (дата: 2007-11-26 )  Гаджикурбанова Полина Аслановна

ОА_Институт государства и права РАН    (дата: 2007-11-26 )  Лазуткина Ирина Николаевна

ОА_Институт мировой экономики и международных отношений Российской Академии Наук    (дата: 2007-11-26 )  Хилькевич Евгения Владимировна

ОА_Институт проблем региональной экономики    (дата: 2007-11-26 )  Жук Надежда Петровна

ОА_Институт социально-экономических исследований Уфимского научного центра РАН    (дата: 2007-11-26 )  Климова Нина Ивановна

ОА_Сочинский научно-исследовательский центр Российской академии наук    (дата: 2007-11-26 )  Кизилова Ольга Викторовна

ОА_Институт народнохозяйственного прогнозирования    (дата: 2007-11-26 )  Ковалев Владимир Петрович

ОА_Институт экономики Российской Академии наук    (дата: 2007-11-25 )  Романюк Эвелина Игоревна

ОА_Институт аграрных проблем Российской академии наук    (дата: 2007-11-25 )  Осовин М.Н.

ОА_Институт экономических проблем Кольского Научного Центра РАН    (дата: 2007-11-25 )  Емельянова Елена Евгеньевна

ОА_Санкт-Петербургский экономико-математический институт РАН    (дата: 2007-11-25 )  Гузий Л.И.

ОА_Социологический институт Российской академии наук (статус государственного учреждения)    (дата: 2007-11-25 )  Русакова Инна Викторовна

ОА_Институт США и Канады Российской Академии Наук    (дата: 2007-11-24 )  Соколова М.Е.

ОА_Отделение международных экономических и политических исследований (Филиал Института экономики РАН)    (дата: 2007-11-24 )  Соколова Т.В.

ОА_Центральный экономико-математический институт Российской академии наук    (дата: 2007-11-24 )  Ляпичева Н.Г.

ОА_Институт проблем рынка РАН    (дата: 2007-11-24 )  Когаловский М.Р.

Russia in IRs international rating (September 2008)

Страна кол-во ОА1. United States 2252. United Kingdom 1083. Germany 864. Brazil 555. Japan 466. Canada 447. France 408. Sweden 359. Australia 3410. Spain 3211. Italy 3112. India 2813. Netherlands 2314. Russian Federation 20

Source: http://roar.eprints.org/index.php?action=browse

Leading Russian Research Institutes by IR’s characteristics

Institute Name Number of materials in IR

Number of series in IR

1. Институт экономики и организации промышленного производства СО РАН

11323 13

2. Центральный экономико-математический институт РАН

2356 153. Институт философии РАН 838 244. Институт проблем рынка РАН 712 85. Институт народнохозяйственного прогнозирования РАН

281 66. Вологодский научно-координационный центр ЦЭМИ РАН

158 47. Институт экономических проблем Кольского Научного Центра РАН

147 68. Институт экономики РАН 139 79. Отделение международных экономических и политических исследований (Филиал Института экономики РАН)

100 8

10. Институт США и Канады РАН 96 811. Институт аграрных проблем РАН 74 612. Институт социально-политических исследований РАН

59 4

Example of series structure of IR(for IEIE SB RAS)

Series Title Number of materialsАвторефераты диссертаций, принятых к защите 1Авторефераты защищенных диссертаций 23Журнал "Регион: экономика и социология" 449Каталог изданий ИЭОПП СО РАН 246Монографии, сборники, учебники сотрудников ИЭОПП СО РАН по региональной тематике с 1990 г.

139

Новости ИЭОПП СО РАН 15Организационные профили ИЭОПП СО РАН 7Отчеты о научной и научно-организационной деятельности института в целом, подразделений и исследователей ИЭОПП СО РАН

7

Препринты сотрудников ИЭОПП СО РАН по региональной тематике с 1990 г.

183

Публикации Григория Ханина 41Публикации сотрудников ИЭОПП СО РАН по региональной тематике с 1990 г.

611

Сотрудники ИЭОПП СО РАН 17Труды сотрудников ИЭиОПП 9767

Example OAI-PMH{CERIF} support for IR at Socionet

Complexity of data on research results

• CRIS provides a tool to make thematic links between relative materials located at any part of unified information space

• Research e-infrastructure provides a service to support such links and tools to maintain networks of such relations

• Basic information objects for linking are:– a research article or a material– personal profile of a researcher– institution profile

Example of types of linking for a research article

Links as a graph

Example of types of links for a personal profile

Example of types of links for an institution profile

Needed development

• Adding to CERIF a set of specifications for global thematic links between information objects:– how to provide global unified ID for objects from

local CRIS– open format for specifying links between objects– open list of links types

Accurate and realistic data for research results usage assessment• CRIS provides a tool to use (cite) research

results in advanced and improved form located in any other CRIS

• Research e-infrastructure provides a service to support such advanced citations

• A focus on building a new advanced model to make electronic citations in deposited research articles/materials

Electronic citation tool

• To make citation as a one of thematic links between fragments of articles located in any CRIS

• Each citation link includes a set of quality attributes of usage type and a field for notes

• Making a citation an author specifies linked fragments of texts, selects usage type and can fill in a note

Quality attributes of electronic citation

Making a citation an author should select one or many of quality attributes to specify how (s)he uses the cited research result. Suggested usage types:•«grounds for receiving my results», which means direct scientific use of cited result by the author;•«proof of cited result», i.e. the result of the author proves the cited one;•«cited result proves result, obtained by the author previously», i.e. the author states his/her priority with regard to independently obtained cited result;•«similar or related result», meaning that the author in a certain sense repeated the cited result;•«illustration of my conclusions», implying certain logical link between the result of the author and the cited one;•«object for criticism», means that the author doubts the cited result.

Electronic citation output: new data for research assessment

• who and how uses certain research results as the basis for own scientific argument; these cases mean direct utilization of results and increase indicator of its using;

• which results prove or are proved by other results, which should enhance the indicator of the proved results’ credibility;

• which results repeat the existing ones, which should increase the degree of both results credibility;

• which results use as general illustrations than means a case of weak usage of results;

• who criticizes which results

Needed development

• Adding to CERIF a “citation” type of links with a set of quality attributes and a “note” field

• Provide an open list of quality attributes for citation links