Results of the Horizon 2020 DMP template survey

Results of the Horizon 2020

DMP template survey

Ellen Leenarts

DANS amp OpenAIRE

OpenAIRE amp FAIR Data Expert Group webinar 11th January 2018

httpswwwopenaireeueventseventdetail529

dansknaw

openaire_eu

Sarah Jones

DCC OpenAIRE amp FAIR

Data Expert GroupsjDCC

digitalcuration

FAIRdata

Background to the survey

bull Conducted by OpenAIRE amp FAIR Data Expert Group between May-July 2017

bull Survey intended to help iterate and improve EC approach to DMPs

bull Asked about attitudes to DMPs and specifics on H2020 template and support needed

bull Circulated by EUDAT FOSTER amp other projects LIBER the RDA European

Commission project officers YEAR network and EURODOC

bull Received 289 responses

bull Around 50 were researchers and 60 were (also) research support

OpenAIRE amp FAIR Data Expert Group webinar 11th January 2018 httpswwwopenaireeueventseventdetail529 2

Infographic

3

bull Results at a glance

bull Available via

httpszenodoorgrecord1120245

Overall positive response to DMPs [Q3]

Both positive and negative it helped us reflect on potential issues and decide

how to address these as a project and also it was frustrating and felt like an

administrative exercise that was very long and cumbersome too specific in

some areas and too vague unclear in others


ldquoInitially it looks as an administrative exercise

but I find it very useful since although I have an

idea of what data I will collect in my project this

makes me reflect on the best format to present

them where to make them available etcrdquo

Good understanding of FAIR buthellip

ldquoWe understand the basic principle of FAIR but the terminology is often difficult

to grasp immediately Things could be explained better in plain languagerdquo

ldquoThe term interoperable is quite confusing sometimes and mixed with re-userdquo

ldquoI could do with help understanding the section on Making data interoperable

as I dont understand a number of the terms and conceptsrdquo

Table from Q4 comments from Q5


To what extent do the following statements represent your experience of using the H2020 template

Agree Neither agree nor disagree Disagree

I donrsquot understand what FAIR means 10 17 16 28 74 125

Language is a barrier [Q5]

Respondents mentioned

40 terms which were

unclear to them


ldquoResearchers are not familiar with the following termsphrases Metadata standards for

metadatadata ontologies mapping with ontologies interoperability All the ICT jargonrdquo

ldquoWith the help from Swedish National Data Service we could clarify many questions Without

this help we would not be able to finish the DMPrdquo

Template structure is problematic [Q6 amp 19]

ldquoThere is too much overlap between F A I and R

We have stopped talking about FAIR and removed

it from our replacement H2020 DMP templaterdquo

ldquoQuestions about the Metadata appear under 21

22 and 23rdquo

ldquoHaving to explain how to make data findable

before talking of the repositories chosen to make

data open is difficult and forces you to anticipate

things to be detailed laterrdquo


bull Repetition

bull Ordering not logical

bull Too many precise questions

bull Need more dropdown options

and examples

User priorities for support [Q11]


Our recommendations

1 Clarify EC requirements for DMPs

2 Revise the DMP template structure

3 Simplify the DMP content and terminology

4 Provide discipline-specific guidelines and example answers

5 Encourage the publishing of DMPs and collate examples

6 Facilitate the inclusion of RDM costs in grant applications

7 Improve DMP review practices and share guidelines


Experience with DMP template [Q4]


Guidance that could be improved [Q7]

bull More subject- or field-

specific

bull Less complicated

technical or less vague

generic

bull Inclusion of examples

bull DMPs

bull Repositories

bull Interoperability

bull Cost estimation


Missing topics [Q8]

bull Discipline-specific approach

bull Access

bull Data quality assurance

bull Metadata and documentation

bull Software

bull Reproducibility

bull Costs

bull Storage

bull Legal issues

bull The format of the template


ldquoI think this would probably

vary according to individual

projects It is possible that a

one-size-fits-all approach is

not practicalrdquo

Issues encountered [Q9]

ldquoProcesses around the assessment of the

content are unclear to merdquo

ldquoAs stated before clarification of what is

an eligible cost regarding RDM is urgently

needed for researchers and also for the

RDM support teams at the universitiesrdquo


Suggestions [Q10]


ldquoWhich parts should be set up

already in the beginning and what

can be added later Would be

helpful to indicate needed and

nice to have for the starting point

or for different stagesrdquo

DMP publishing [Q12]

bull Half of free text answers rdquoYes ifhelliprdquo

bull Depending on confidentiality of the

information in the DMP

bull First reach a level of confidence in

publishing DMPs

bull The project has finished

bull No because it might bring project

partners in danger


Suggestions to EC [Q14]

ldquoTalk to researchers and ask them

whether the DMP requirements

are realistic Involve researchers

when developing disciplinary

guidancerdquo

ldquoFocus on technical exchange

format for these plans so they can

be shared between tools (ie

make the plans themselves FAIR)rdquo


Providing feedback [Q15-16]

ldquoIn some cases I had to look together with researchers into their publications or WPs

description of a project in order to help them identify the type of data they are collecting in

order to include them in the DMP This exercise also helped them to identify which data might

have a re-use potential and which ones were submitted to special policies regulationsrdquo


Time to review H2020 DMPs [Q18]


27 said the H2020 process took much longer and was more complicated

based on 45 responses

19

Recommendationshellip

Image CC-BY-NC by Thomas Hawk

httpswwwflickrcomphotosthomashawk15634502093


bull Collate all data-related and DMP guidelines in a single document

bull Provide public announcements and alerts to key groups when guidelines change

bull Be more explicit about when a DMP is and isnrsquot required

bull Clarify exactly what set of questions should be answered in DMPs

bull Provide a docx or rtf template to use as well as supporting online tools

httpeceuropaeuresearchparticipantsdatarefh2020grants_manualhioa_pilot

h2020-hi-oa-data-mgt_enpdf


bull Regroup questions according to key activities and order in a more logical fashion

bull Identify which questions should be answered when

bull Where possible indicate secondary questions that can be skipped if not relevant

bull Include more yesno questions dropdown options or API integrations

bull Identify questions that will support evaluation and formulate them in a structured

way to enable automated compliance checks in future


3 Simplify DMP content amp terminology

bull Simplify the terminology used where possible

bull Provide a glossary of terms to assist researchers

bull Offer example answers particularly for questions with more technical terms

bull Seek to shorten the number of questions being asked

bull Provide some hierarchy or routing to the structuring of the questions


4 Discipline guidelines amp example answers

bull Provide discipline-specific guidelines

bull Offer example answers based on good practice in each domain

bull Give dropdown options or ranges pertinent to each field


We suggest that the EC builds on existing work and

collaborates with domain data centres and discipline-

specific groups such as learned societies

5 Publish DMPs and collate examples

bull Encourage projects to publish their DMPs

bull Offer a DMP registry service

bull Provide a library of lsquoapprovedrsquo DMPs representing

the range of funded research


Build on projectsrsquo existing willingness to publish and

work with external reviewers e-Infrastructure projects

and other groups eg LIBER to help approve examples

6 Include RDM costs in grant applications

bull Raise a few RDM questions alerts at the grant proposal stage

bull Provide worked examples that demonstrate what to include as RDM costs and how

bull Brief reviewers on eligible and expected costs


Clarification of what is an eligible cost regarding RDM is urgently needed for researchers

and also for the RDM support teams at the universities For example

bull If a project needs to buy extra storage from the own institution is that cost eligible

Or only external storage systems are eligible

bull Database curatorsadmins could be financed by EC projects

bull Are licenses for Electronic lab Notebooks (ELNs) for experimental data documentation

eligible costs

bull Are there differences in RDM eligible costs between consortium projects and IF or

ERC for example If there are differences it would be best if the EC provide examples

for all the type of calls

7 Explain DMP review practices

bull Endorse the internal assessment framework to ensure consistent use

bull Continue to provide internal training on reviewing DMPs in collaboration with

FOSTER Plus and other relevant groups

bull Develop circulate review guidelines and FAQs on practical implementation

bull Make a public statement on how DMPs are being reviewed ideally releasing the

assessment framework at the same time


Activities that may help

bull Science Europe Domain Data Protocols (DDPs)

bull Collections of example DMPs eg DCC RIOjournal Zenodo OpenAIRE

bull Existing costs guides eg LCRDM resource amp Wellcome guidance

bull Integrating registries into tools like DMPonline

bull RDA Working Group on Common standards for DMPs

bull Further support from FAIR Data EG OpenAIRE and others


What can you do

bull Share your DMP

ndash Publish in RIO - httpsriojournalcom

ndash Deposit in Zenodo - httpszenodoorg

ndash Add to DCC list - wwwdccacukshare-DMPs

bull Continue to provide feedback on the pilot and what works for you (or not)

bull Collaboration across research and support communities to develop your approach

bull Work with wider initiatives eg NOADs and international groups like RDA


Conclusions

Although there are several recommendations to the EC feedback was positive

bull Many found the process of developing a DMP a positive experience

bull Over half agree that the template was very useful

bull 19 of 68 stated they encountered no issues in following the EC guidelines

The EC has already iterated its open data guidelines and actively seeks input to

inform future policy developments

Further updates are likely The FAIR Data EG is to advise on future revisions of the

DMP template including the development of additional discipline specific guidance


Where to find out more

All the survey materials are on Zenodo

DOI 105281zenodo1120245


bull Survey report

bull Raw data

bull Analysed dataset

bull Infographic


Acknowledgments

Marjan Grootveld DANS

Emilie Hermans UGent

Eliane Fankhauser DANS

Background to the survey

bull Conducted by OpenAIRE amp FAIR Data Expert Group between May-July 2017

bull Survey intended to help iterate and improve EC approach to DMPs

bull Asked about attitudes to DMPs and specifics on H2020 template and support needed

bull Circulated by EUDAT FOSTER amp other projects LIBER the RDA European

Commission project officers YEAR network and EURODOC

bull Received 289 responses

bull Around 50 were researchers and 60 were (also) research support


Infographic

3


bull Available via


























40 terms which were

unclear to them











22 and 23rdquo






bull Repetition




and examples



Our recommendations













specific



generic


bull DMPs

bull Repositories




Missing topics [Q8]


bull Access



bull Software


bull Costs

bull Storage

bull Legal issues







not practicalrdquo









Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments




Infographic

3


bull Available via


























40 terms which were

unclear to them











22 and 23rdquo






bull Repetition




and examples



Our recommendations













specific



generic


bull DMPs

bull Repositories




Missing topics [Q8]


bull Access



bull Software


bull Costs

bull Storage

bull Legal issues







not practicalrdquo









Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments




























40 terms which were

unclear to them











22 and 23rdquo






bull Repetition




and examples



Our recommendations













specific



generic


bull DMPs

bull Repositories




Missing topics [Q8]


bull Access



bull Software


bull Costs

bull Storage

bull Legal issues







not practicalrdquo









Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments

















40 terms which were

unclear to them











22 and 23rdquo






bull Repetition




and examples



Our recommendations













specific



generic


bull DMPs

bull Repositories




Missing topics [Q8]


bull Access



bull Software


bull Costs

bull Storage

bull Legal issues







not practicalrdquo









Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments






40 terms which were

unclear to them











22 and 23rdquo






bull Repetition




and examples



Our recommendations













specific



generic


bull DMPs

bull Repositories




Missing topics [Q8]


bull Access



bull Software


bull Costs

bull Storage

bull Legal issues







not practicalrdquo









Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments









22 and 23rdquo






bull Repetition




and examples



Our recommendations













specific



generic


bull DMPs

bull Repositories




Missing topics [Q8]


bull Access



bull Software


bull Costs

bull Storage

bull Legal issues







not practicalrdquo









Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments






Our recommendations













specific



generic


bull DMPs

bull Repositories




Missing topics [Q8]


bull Access



bull Software


bull Costs

bull Storage

bull Legal issues







not practicalrdquo









Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments




Our recommendations













specific



generic


bull DMPs

bull Repositories




Missing topics [Q8]


bull Access



bull Software


bull Costs

bull Storage

bull Legal issues







not practicalrdquo









Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments








specific



generic


bull DMPs

bull Repositories




Missing topics [Q8]


bull Access



bull Software


bull Costs

bull Storage

bull Legal issues







not practicalrdquo









Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments






specific



generic


bull DMPs

bull Repositories




Missing topics [Q8]


bull Access



bull Software


bull Costs

bull Storage

bull Legal issues







not practicalrdquo









Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments




Missing topics [Q8]


bull Access



bull Software


bull Costs

bull Storage

bull Legal issues







not practicalrdquo









Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments












Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments




Suggestions [Q10]













publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments









publishing DMPs



partners in danger







guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments









guidancerdquo
















19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments














19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments








19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments




19























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments























































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments















































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments







































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments
































eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments
























eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments















eligible costs




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments




















What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments












What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments




What can you do

bull Share your DMP








Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments




Conclusions












DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments






DOI 105281zenodo1120245


bull Survey report

bull Raw data


bull Infographic


Acknowledgments




Technology

Results of the Horizon 2020 DMP template survey