MetaScience: Holistic Approach for Research Modeling and Analysis

MetaScience An Holistic Approach for Research Modeling

Valerio Cosentino, Javier Cánovas & Jordi Cabot ICREA – Open University of Catalonia

@softmodeling modeling-languages.com

http://pixgood.com/mr-hyde-sketch.html

ResearcherReviewer

Both need to work together to have a healthy community

How can we use conceptual models to help ?

Nurture

your Com

munity

MetaScience: Modeling Research

Communities

Size doesn’t matter

-Data vs Information-Non-trivial analysis: Integration of different sources-Conceptual Schema as unifying representation-Separation of data collection from data analysis-

Conceptual Schema

DB schema

DB schema

Data Collection

Flick/skepticalview

Conferences and papers: DBLP

Table mapping

PCs and topics: web scrapping

+ a variety of other (overlapping) sources & formats

Community Analysis for everybody

Flickr/leg0fenris

Single metrics, e.g. authors per paper

19791981

19831985

19861987

19881989

19901991

19921993

19941995

19961997

19981999

20012002

20032004

20052006

20072008

20092010

20112012

20132014

20150

0.5

1

1.5

2

2.5

3

3.5

4

ρ = 0.88

Single metrics, e.g. seniority of researchers

Graph-based analysis: Co-authorship graphs

Prolific authorsFrequent

collaborationsClustersBetweenness (bridge

authors)

Historical / temporal view, e.g. PC Analysis

ARE PC MEMBERS ACTIVE IN THE CONFERENCE?60 out of the 99 members from 2015 did not publish in the previous 3 editions

ARE ACTIVE MEMBERS BEING IGNORED?Only 7 researchers published constantly from 2012 to 2014

3 of them were PC members in 2015, while the remaining 4 were not

Newcomers

% of papers with all authors new to the main track

% of papers with all authors new to the conf

NL/ Topic analysis, e.g. Top-30 keywords for last 10 edts

From paper abstracts From topics of interest

http://matt.might.net/articles/phd-school-in-pictures

And there’s much more...

Collaborating with the complex systems group: rich club ordering, small-

world behaviour, inter-conf analysis…

CORE analysis (shameless plug)

Tool Support

Flickr/JDHancock

Gitana: Integrated analysis (ER’15)

Coding platform

Issue trackers Commun. channels

Code review tools

https://github.com/SOM-Research/metaScience

Challenges

Flickr/TimPainter

The CS keeps growing

Data Collection limitations

And even more challenges….

Paper classificationo Not clear distinction of paper types o Changes on the characteristics from one edition to another (e.g. number of

pages for short papers)

Committee / topics datao Conference edition web sites may be not available anymore

Partial solution: WayBack Machineo Committee data similar but there is no common “standard”

Entity resolutiono Researchers can use different names

Partial solution: DBLP provides aliaseso Researcher names may appear misspelled (mostly in committee data)

Let’s work togetherjordi.cabot@icrea.cat

@softmodeling

modeling-languages.co

m