Embed Size (px)
Citation preview
Trinity College Dublin, The University of Dublin
IMPACT ASSESSMENT
Internal or External?
Dr Mairéad Hurley Science Gallery Dublin 03.05.17
Trinity College Dublin, The University of Dublin
How would you define the term "research"? (2015)
Before and After and On the Night: N = 627
Trinity College Dublin, The University of Dublin
How would you define the term "research"?
“Looking for answers to a problem or topic”
“Finding out information that's new to you”
“Looking up stuff”
“Asking probing questions about things”
“Finding out new things”
“Looking up about something”
“Gathering data to find out answers to a question”
Trinity College Dublin, The University of Dublin
PROBE
This project has received funding under the
European Union’s Horizon 2020 research and
innovation programme under grant agreement No
722628
Trinity College Dublin, The University of Dublin
Trinity College Dublin – Front Square and surrounding buildings
Trinity College Dublin, The University of Dublin
Trinity College Dublin – Front Square and surrounding buildings
Trinity College Dublin, The University of Dublin
What type of research do you think is most important for Europe?
Question Options – based on Grand Societal Challenges
1. Health and the understanding, treatment and prevention of disease 2. Food security, sustainable agriculture and forestry, marine and maritime and
inland water research, and the development of a Bioeconomy 3. Secure, clean and efficient energy for Europe 4. Smart, green and integrated transport for Europe 5. Climate and environmental action, improving resource efficiency and the use
of raw materials 6. Improving Europe as an inclusive, innovative, equal and reflective society 7. Protecting the freedom and security of Europe and its citizens 8. Other
Trinity College Dublin, The University of Dublin
Pre: N = 172
Post: N = 83
What type of research do you think is most important for Europe?
Trinity College Dublin, The University of Dublin
Trinity College Dublin, The University of Dublin
Trinity College Dublin, The University of Dublin
Trinity College Dublin, The University of Dublin
Trinity College Dublin, The University of Dublin
Please list anything that comes to mind when you think of the word "research"
Pre: N = 172
Post: N = 83
Trinity College Dublin, The University of Dublin
Who do you believe decides on research funding in Europe?
Question Options:
● Politicians ● Civil servants ● Scientists ● Industry ● Independent experts ● European Union ● Non-governmental organisations ● Non-experts
Trinity College Dublin, The University of Dublin
Pre: N = 172
Post: N = 83
Who do you believe decides on research funding in Europe?
Trinity College Dublin, The University of Dublin
While attending Probe, did anything surprise you and if so, what was it that surprised you?
Post: N = 83
Trinity College Dublin, The University of Dublin
• Time – if in a university, relies on time commitment of an academic lead, not always fast
• If institution doesn’t have a department skilled in evaluation of impact, can take time and money to train someone to carry out meaningful evaluation
• Bias – needs to be truly impartial to avoid bias
Internal Evaluation: Pros & Cons
• Embedded in your institution – access to the evaluator year round
• Can work with the same evaluation team over multiple years
• Academically rigorous – it is research in itself, validated by peer-reviewed publications
• Has value for institution
• Honesty - is not skewed towards profitability but can still factor in marketing type questions
Trinity College Dublin, The University of Dublin
• EXPENSIVE!!!
• External team are less likely to be driven to obtain results
External Evaluation: Pros & Cons
• Market research companies likely to be more efficient with manpower
• Saves time for coordinator to hand over large task
• Will meet reporting deadlines!
Trinity College Dublin, The University of Dublin
Internal
Trinity College Dublin, The University of Dublin
Internal Evaluation – learnings for 2017
• Outdoor evaluation in the rain – need to factor into planning this year
• Online issues – guest wifi was patchy, planning to use an evaluation tool that can be used offline & that will automate much of the analysis – streamline process
• Focus much less on print & TV media and increase digital campaign
• Coverage beyond Dublin city almost non-existent: target areas outside the capital
Trinity College Dublin, The University of Dublin
Internal Evaluation – towards a pan-European approach
• Join us for our ECSITE conference session ”A decade of European Researchers’ Night: techniques and formats” 09.00 Friday June 16th
• Plans for use of same evaluation tools & comparative study between Ireland & Scotland – could extend to other countries so get in touch if you’re interested
• Also carried out research into researchers’ opinions. Initial findings show “surprise” at level of engagement from people compared to other outreach events: suggests format change and festival atmosphere increased public engagement with research.
Trinity College Dublin, The University of Dublin
Thank You! [email protected]
Evaluation Coordinator: Dr. Joseph Roche [email protected]
Trinity College Dublin, The University of Dublin
What is your age?
Post: N = 83
18 - 25 years old: 42.7% 25 - 34 years old: 24.4% 45 - 54 years old: 14.6% 35 - 44 years old: 9.8% Under 18 years of age: 3.7% 55 - 64 years old: 3.7% Over 65 years of age: 1.2% Prefer not to disclose: 0%
Trinity College Dublin, The University of Dublin
Where do you live?
Post: N = 83
Dublin: 81.5% Outside Ireland: 6.2% Wicklow: 3.7% Cork: 2.5% Down: 1.2% Kildare: 1.2% Louth: 1.2% Meath: 1.2% Roscommon: 1.2% Other Counties: 0%
Trinity College Dublin, The University of Dublin
What is your gender?
Post: N = 83
Female: 59.3% Male: 40.7% Prefer not to disclose: 0% Other: 0%
