Upload
antony-gallagher
View
226
Download
2
Tags:
Embed Size (px)
Citation preview
Connecting researchers and research organisations with data publication metricsthe visibility and value of data publications in bibliometrics and altmetrics systems
CSIRO INFORMATION MANAGEMENT & TECHNOLOGY
Dominic Hogan & Anne Stevenson | Research Data Services Support 24th October 2013
Image: http://xkcd.com/285/
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Metrics – what’s available
• Data Citation Index – flexible DOI searching with citation data. Hoping for ANDS ingest in the near future.
2 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Metrics – what’s available
• Scopus – you might get excited when searching for a DOI prefix in “references”, e.g. the ANDS DOI prefixes:
3 |
…but then you have to remember the correct syntax for an exact phrase.
At least it works in principle, even if there’s nothing worth showing off yet.
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Metrics – what’s available
• Google Scholar – am I doing it correctly?
4 |
(Incidentally, neither the DAP nor RDA records for this show up in GS)
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Metrics – what’s available
• For comparison, here’s a similar search in Google
5 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Metrics – what’s available
• Microsoft Academic Search• DOI search does not allow truncation, so full DOIs only• General search will retrieve many false positives
• Exact phrase may prove useful for DOI prefixes
6 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Altmetrics
• What Google Trends has to say about this
7 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Altmetrics
• Roberta Kwok points out the difference between the “views” and “citations” of this article:
8 |
Hull, D., Pettifer, S. R., & Kell, D. B. (2008). Defrosting the Digital Library: Bibliographic Tools for the Next Generation Web. PLoS Comput Biol, 4(10), e1000204. doi: 10.1371/journal.pcbi.1000204Kwok, R. (2013). Research impact: Altmetrics make their mark. Nature, 500(7463), 491-493. doi: 10.1038/nj7463-491a
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Altmetrics
• Impact Story:• CSIRO datasets showing up as “items with no metrics”
• Dryad and figshare datasets showing up in a “dataset” category
• Tracking DOIs from DataCite is on the roadmap, but timeline unknown• Search by creator is also on the roadmap
9 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Altmetrics
• Altmetric.com:• We tested out tweeting a DOI,
Altmetric.com did pick it up• No real activity for the ANDS DOI prefix• Altmetric badges embedded in Scopus
10 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Altmetrics
• Plum Analytics:• Specifically mentions that metrics are
gathered for datasets• Can currently add figshare and Dryad
records to a profile• Some issues with what gets listed
(although it’s uncertain whether this was just the way the profile was created)
11 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Altmetrics
• Some publishers are displaying altmetrics in their pages
12 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Altmetrics
• The paper itself doesn’t cite the data in the reference section
13 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Project Columbus
The steps:• Weekly report on new collections from the DAP.• New collections with DOIs identified.• We search our publications systems for the data collection
authors, looking for papers that aren’t published yet.• We then contact the authors that match to talk about data citation
generally, and Project Columbus specifically.
Results so far:• Very early days. 4 candidates identified.• Candidates are extremely keen, however.• Additional datasets have been deposited by candidates
14 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Project Columbus
• Use available tools to report metrics back to authors.• Current:
• Google Analytics reports• Analysis of server logs• Providing data for inclusion in annual reports• Manual searching for DOIs in the wild• Use of metrics tools on the citing papers• Future:
• Data Citation Index• Impact Story search-by-creator• Science reviews / internal assessments
15 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Case study: what DOIs do we have?
16 |
• At EOFY 2013 CSIRO had under 100 DOIs for data collections in the DAP
Jul-2012
Aug-2012
Sep-2012
Oct-2012
Nov-2012
Dec-2012
Jan-2013
Feb-2013
Mar-2013
Apr-2013
May-2013
Jun-2013
Jul-2013
Aug-2013
Sep-2013
Oct-2013
0
50
100
150
200
250
300
350
400
450
Total DOIs minted for DAP collections
Total DOIs minted
Date
Num
ber o
f DO
Is
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Australian Telescope National Facility
• But wait…
17 |
What’s this?
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Australian Telescope National Facility
• Publications which include archived Parkes pulsar data should include an additional statement as follows:
– This paper includes archived data obtained through the Australia Telescope Online Archive and the CSIRO Data Access Portal (http://data.csiro.au).
• So will anybody cite the DOI?
18 |
Nothing from either list matches with the other – at least the list is small enough to manually check
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Anywhere…?
• By excluding the two main suspects, we get a sane number of results to browse• Definitely some false positives• Compared to searching for a
handle…• ANDS PID handles have the prefix
“102.100.100” – more false hits• The prefix is not organisation specific,
so it’s harder to filter out parent organisations
19 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Roll your own
• Google Analytics• Server logs
20 |
1/10/2
012
14/10/2
012
27/10/2
012
9/11/2
012
22/11/2
012
5/12/2
012
18/12/2
012
31/12/2
012
13/01/2
013
26/01/2
013
8/02/2
013
21/02/2
013
6/03/2
013
19/03/2
013
1/04/2
013
14/04/2
013
27/04/2
013
10/05/2
013
23/05/2
013
5/06/2
013
18/06/2
013
1/07/2
013
14/07/2
013
27/07/2
013
9/08/2
013
22/08/2
013
4/09/2
013
17/09/2
013
30/09/2
0130
100200300400500600700800900
1000
DAP downloads (ATNF spikes are off scale)
Manual_otherREST_otherATNFATNF_REST
Date
Num
ber o
f dow
nloa
d ev
ents
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
ATNF downloads
21 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Atlas of Australian Acid Sulphate Soils
22 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
DAP Visitors
23 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Challenges
• It’s early days for altmetrics, there are no standards. There’s capacity to innovate or collaborate with altmetrics providers.• What sort of metrics would you be interested in seeing?• What sort of metrics would your researcher or organisation be
interested in?
24 |
Bibliometrics and Altmetrics| Dominic Hogan & Anne Stevenson
Thanks to• Sue Cook• David Benn• Cynthia Love
25 |
Acknowledgementsyou
CSIRO Information Management & TechnologyDominic HoganResearch Data Service Supportt 1300 363 400e [email protected] www.csiro.au
CSIRO Information Management & TechnologyAnne StevensonResearch Data Service Supportt 1300 363 400e [email protected] www.csiro.au
CSIRO INFORMATION MANAGEMENT & TECHNOLOGY
Thank you