2
Sharing data collection instruments Brian D Johnston Research in injury prevention, by den- ition, requires collection of data in some form. Thus every investigator is faced with the challenge of identifying data collection instruments and deciding how best to use these. In some cases, a researcher will be asking new questions or measuring a new concept. If so, the researcher will need to decide how to operationalise the concept as a measurable entity. A process of instru- ment development and validation may be required. For example, how does one measure risk taking behavioror paren- tal supervision?These are not trivial questions; getting the measures wrong risks the integrity of the entire study. On the other hand, many projects involve measuring a behavior, attitude, belief or self-reported outcome that others have measured in the past. Assuming that previous researchers have taken the time to develop and validate a data collection tool, why should others in the eld, hoping to measure the same entity, start from scratch? If, for example, I want to measure depres- sive symptoms, I would almost certainly be better off using an established data collec- tion instrument (like the CES-D 1 ) to do so, rather than trying to develop a new measure for my particular study. For a number of reasons, it is generally preferable to use existing data collection instruments when these are available. Certainly, this increases research efciency. There is no need to undertake laborious instrument development and validation studies if a well-established measurement tool already exists. Such measures are often explicitly based on a theoretical model of belief or behaviour, a fact that increases the rigour of the investigation and may shape thinking about interpret- ation of the results. In addition, a researcher can use not only the data col- lection forms (and the constructs they employ) but also data dictionaries, aggre- gate variables and data reduction techni- ques previously developed for use with the instrument. Whilst reuse of well-developed research tools improves efciency and rigour, it also facilitates data sharing, 2 direct comparison and even meta-analysis of published studies. If two researchers are measuring the same outcome in the same way, it is much easier to compare or combine their ndings in a productive manner. How many studies published in this journal alone would benet from the use of established and accepted measures of home injury hazards? 3 Fall risk in the elderly? 4 Observed and self-reported par- ental supervision 5 or child restraint use? 6 The problem, of course, is that we dont always know that such tools exist andif they doare typically challenged to obtain a copy for use in our own work. In this digital age, however, it is not surprising that web-based collections of data collection instruments have begun to appear. The National Institutes of Health toolbox offers brief measures assessing cognitive, emo- tional, motor and sensory function (www. nihtoolbox.org); the US National Cancer Institute has Grid-Enabled Measures for consensus-rated standard measures in onco- logic research; 7 the PROMIS project pro- vides metrics for common patient reported outcomes (physical function, pain, distress, etc); 8 and the Shared Data Instrument Library ties validated instruments into the REDCap secure online data resource. 9 Happily, researchers in injury and vio- lence prevention now have database and library of non-proprietary data collection instruments and survey forms specic to their eld. The US National Center for Injury Prevention and Control at the Centers for Disease Control and Prevention (CDC) funded the Society for the Advancement of Violence and Injury Research (SAVIR) to develop a system to facilitate sharing of non-proprietary instru- ments among the research and practice communities. Thanks to work led by Carol Runyan and David Lawrence, that system now exists. Housed within the searchableand freely availableSafetyLit database, the SAVIR Instrument Library provides infor- mation about the development and back- ground of the instruments, how the instruments were used to support research published in peer-reviewed articles and reports, comments on the use of the instrument, any problems encountered, and often, the instrument itself. Citations and links to the published articles based on the instrument are also included. Interested readers can explore the instru- ment collection here: http://www.safetylit. org/instruments.htm The goal now is to expend the number of data collection tools in the library. To that end, the journal encourages our col- leagues to make use of the collection when launching new research and to con- tribute their own measures to the data- base. Study protocols, in particular, should be submitted with data collection instruments when available. We will also be inviting authors of accepted papers to share their data forms through this mech- anism. Science is a team sport and the injury prevention community has a long track record of successful collaborations. We are highly supportive of this new opportunity. Competing interests None. Provenance and peer review Commissioned, internally peer reviewed. To cite Johnston BD. Inj Prev 2014;20:73. Inj Prev 2014;20:73. doi:10.1136/injuryprev-2014-041224 REFERENCES 1 Radloff LS. The CES-D Scale: A Self-Report Depression Scale for Research in the General Population. Applied Psychological Measurement 1977;1:385401. 2 Johnston BD. Living in the grey area: a case for data sharing in observational epidemiology. Injury Prevention 2012;18:35859. 3 Kendrick D, Maula A, Stewart J, et al. Keeping children safe at home: protocol for three matched casecontrol studies of modiable risk factors for falls. Injury Prevention 2012;18:e3. 4 Gleeson M, Sherrington C, Borkowski E, et al. Improving balance and mobility in people over 50 years of age with vision impairments: can the Alexander Technique help? A study protocol for the VISIBILITY randomised controlled trial. Injury Prevention 2014;20:e3. 5 Andrade C, Carita AI, Cordovil R, et al. Cross-cultural adaptation and validation of the Portuguese version of the Parental Supervision Attributes Prole Questionnaire. Injury Prevention 2013;19:42127. 6 ONeil J, Slaven JE, Talty J, et al. Are parents following the recommendations for keeping children younger than 2 years rear facing during motor vehicle travel? Injury Prevention Published Online First: 28 Oct 2013. doi: 10.1136/injuryprev-2013-040894. 7 Moser RP, Hesse BW, Shaikh AR, et al. Grid-Enabled Measures: Using Science 2.0 to Standardize Measures and Share Data. American Journal of Preventive Medicine 2011;40(5, Supplement 2):S134S43. 8 Cella D, Riley W, Stone A, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its rst wave of adult self-reported health outcome item banks: 20052008. Journal of Clinical Epidemiology 2010;63:117994. 9 Obeid JS, McGraw CA, Minor BL, et al. Procurement of shared data instruments for Research Electronic Data Capture (REDCap). Journal of Biomedical Informatics 2013;46:25965. Correspondence to Dr Brian D Johnston, Department of Pediatrics, University of Washington, Seattle, WA 98104, USA; [email protected] Johnston BD. Inj Prev April 2014 Vol 20 No 2 73 Editorial group.bmj.com on October 2, 2014 - Published by injuryprevention.bmj.com Downloaded from

Sharing data collection instruments

  • Upload
    b-d

  • View
    213

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Sharing data collection instruments

Sharing data collection instrumentsBrian D Johnston

Research in injury prevention, by defin-ition, requires collection of data in someform. Thus every investigator is faced withthe challenge of identifying data collectioninstruments and deciding how best to usethese. In some cases, a researcher will beasking new questions or measuring a newconcept. If so, the researcher will need todecide how to operationalise the conceptas a measurable entity. A process of instru-ment development and validation may berequired. For example, how does onemeasure “risk taking behavior” or “paren-tal supervision?” These are not trivialquestions; getting the measures wrongrisks the integrity of the entire study.

On the other hand, many projectsinvolve measuring a behavior, attitude,belief or self-reported outcome that othershave measured in the past. Assuming thatprevious researchers have taken the time todevelop and validate a data collection tool,why should others in the field, hoping tomeasure the same entity, start from scratch?If, for example, I want to measure depres-sive symptoms, I would almost certainly bebetter off using an established data collec-tion instrument (like the CES-D1) to do so,rather than trying to develop a newmeasure for my particular study.

For a number of reasons, it is generallypreferable to use existing data collectioninstruments when these are available.Certainly, this increases research efficiency.There is no need to undertake laboriousinstrument development and validationstudies if a well-established measurementtool already exists. Such measures areoften explicitly based on a theoreticalmodel of belief or behaviour, a fact thatincreases the rigour of the investigationand may shape thinking about interpret-ation of the results. In addition, aresearcher can use not only the data col-lection forms (and the constructs theyemploy) but also data dictionaries, aggre-gate variables and data reduction techni-ques previously developed for use withthe instrument.

Whilst reuse of well-developed researchtools improves efficiency and rigour, italso facilitates data sharing,2 direct

comparison and even meta-analysis ofpublished studies. If two researchers aremeasuring the same outcome in the sameway, it is much easier to compare orcombine their findings in a productivemanner. How many studies published inthis journal alone would benefit from theuse of established and accepted measuresof home injury hazards?3 Fall risk in theelderly?4 Observed and self-reported par-ental supervision5 or child restraint use?6

The problem, of course, is that we don’talways know that such tools exist and–ifthey do–are typically challenged to obtain acopy for use in our own work. In thisdigital age, however, it is not surprising thatweb-based collections of data collectioninstruments have begun to appear. TheNational Institutes of Health toolbox offersbrief measures assessing cognitive, emo-tional, motor and sensory function (www.nihtoolbox.org); the US National CancerInstitute has Grid-Enabled Measures forconsensus-rated standard measures in onco-logic research;7 the PROMIS project pro-vides metrics for common patient reportedoutcomes (physical function, pain, distress,etc);8 and the Shared Data InstrumentLibrary ties validated instruments into theREDCap secure online data resource.9

Happily, researchers in injury and vio-lence prevention now have database andlibrary of non-proprietary data collectioninstruments and survey forms specific totheir field. The US National Center forInjury Prevention and Control at theCenters for Disease Control and Prevention(CDC) funded the Society for theAdvancement of Violence and InjuryResearch (SAVIR) to develop a system tofacilitate sharing of non-proprietary instru-ments among the research and practicecommunities. Thanks to work led by CarolRunyan and David Lawrence, that systemnow exists.Housed within the searchable–and

freely available–SafetyLit database, theSAVIR Instrument Library provides infor-mation about the development and back-ground of the instruments, how theinstruments were used to support researchpublished in peer-reviewed articles andreports, comments on the use of theinstrument, any problems encountered,and often, the instrument itself. Citationsand links to the published articles based

on the instrument are also included.Interested readers can explore the instru-ment collection here: http://www.safetylit.org/instruments.htm

The goal now is to expend the numberof data collection tools in the library. Tothat end, the journal encourages our col-leagues to make use of the collectionwhen launching new research and to con-tribute their own measures to the data-base. Study protocols, in particular,should be submitted with data collectioninstruments when available. We will alsobe inviting authors of accepted papers toshare their data forms through this mech-anism. Science is a team sport and theinjury prevention community has a longtrack record of successful collaborations.We are highly supportive of this newopportunity.

Competing interests None.

Provenance and peer review Commissioned,internally peer reviewed.

To cite Johnston BD. Inj Prev 2014;20:73.

Inj Prev 2014;20:73.doi:10.1136/injuryprev-2014-041224

REFERENCES1 Radloff LS. The CES-D Scale: A Self-Report Depression

Scale for Research in the General Population. AppliedPsychological Measurement 1977;1:385–401.

2 Johnston BD. Living in the grey area: a case for datasharing in observational epidemiology. InjuryPrevention 2012;18:358–59.

3 Kendrick D, Maula A, Stewart J, et al. Keepingchildren safe at home: protocol for three matchedcase–control studies of modifiable risk factors for falls.Injury Prevention 2012;18:e3.

4 Gleeson M, Sherrington C, Borkowski E, et al.Improving balance and mobility in people over50 years of age with vision impairments: can theAlexander Technique help? A study protocol for theVISIBILITY randomised controlled trial. InjuryPrevention 2014;20:e3.

5 Andrade C, Carita AI, Cordovil R, et al. Cross-culturaladaptation and validation of the Portuguese version ofthe Parental Supervision Attributes ProfileQuestionnaire. Injury Prevention 2013;19:421–27.

6 O’Neil J, Slaven JE, Talty J, et al. Are parents followingthe recommendations for keeping children youngerthan 2 years rear facing during motor vehicle travel?Injury Prevention Published Online First: 28 Oct 2013.doi: 10.1136/injuryprev-2013-040894.

7 Moser RP, Hesse BW, Shaikh AR, et al. Grid-EnabledMeasures: Using Science 2.0 to Standardize Measuresand Share Data. American Journal of PreventiveMedicine 2011;40(5, Supplement 2):S134–S43.

8 Cella D, Riley W, Stone A, et al. The Patient-ReportedOutcomes Measurement Information System (PROMIS)developed and tested its first wave of adultself-reported health outcome item banks: 2005–2008.Journal of Clinical Epidemiology 2010;63:1179–94.

9 Obeid JS, McGraw CA, Minor BL, et al. Procurementof shared data instruments for Research ElectronicData Capture (REDCap). Journal of BiomedicalInformatics 2013;46:259–65.

Correspondence to Dr Brian D Johnston, Departmentof Pediatrics, University of Washington, Seattle, WA98104, USA; [email protected]

Johnston BD. Inj Prev April 2014 Vol 20 No 2 73

Editorial

group.bmj.com on October 2, 2014 - Published by injuryprevention.bmj.comDownloaded from

Page 2: Sharing data collection instruments

doi: 10.1136/injuryprev-2014-041224 2014 20: 73Inj Prev

 Brian D Johnston Sharing data collection instruments

http://injuryprevention.bmj.com/content/20/2/73.full.htmlUpdated information and services can be found at:

These include:

References http://injuryprevention.bmj.com/content/20/2/73.full.html#ref-list-1

This article cites 8 articles, 5 of which can be accessed free at:

serviceEmail alerting

the box at the top right corner of the online article.Receive free email alerts when new articles cite this article. Sign up in

Notes

http://group.bmj.com/group/rights-licensing/permissionsTo request permissions go to:

http://journals.bmj.com/cgi/reprintformTo order reprints go to:

http://group.bmj.com/subscribe/To subscribe to BMJ go to:

group.bmj.com on October 2, 2014 - Published by injuryprevention.bmj.comDownloaded from