2
ORAL PRESENTATION Open Access Modelling multiple outcomes to improve the detection of causal mediation effects in complex intervention trials Neil Casey 1 , Simon Thompson 1,2 , Andrew T Prevost 1,3* From Clinical Trials Methodology Conference 2011 Bristol, UK. 4-5 October 2011 Aim In a trial to increase physical activity in sedentary adults, there was no evidence of effect on the primary outcome, though large significant effects amongst eight related SF36 measures of general health [1]. How could such differences arise? Could they be: a true effect mediated through receiving the intervention, another systematic effect such as self-reporting bias, and/or chance? The aim was to develop reliable methods to investigate whether effects of the intervention on the SF36 out- comes were mediated through truly receiving the inter- vention delivered in intervention sessions. Methods We adopted a structural mean modelling approach with a two-stage least-squares estimation algorithm, in order to estimate mediation effects free from confounding bias [2]. It involves predicting the mediator (number of ses- sions attended), and outcomes, from baseline covariates. Each individual has a personal predicted counterfactualtreatment-effect difference which is regressed on the predicted mediator using a dose-response model. Although reliably bias-free, typically these methods do not provide sufficiently precise estimates except for the simplest of models. A simulation study was designed to establish the factors driving the lack of precision. We extended the two-stage approach, using linear mixed effects and GEE modelling to enable multiple SF36 out- comes to contribute to estimation of a common media- tion effect. Results In this trial, attendance at sessions was invariably high, adversely affecting the precision of the estimates. From the simulation study, important factors affecting detec- tion were identified to be the size of the trial effect and the degree to which the mediator is predictable from baseline covariates. The effect of analysing four SF36 outcomes to estimate an assumed common mediation effect was to reduce the standard error of the estimated effect by up to 40%, equivalent to offering an increase in power to detect mediation from 50% to 80%. The med- iation effect was statistically significant. Conclusions The extension of bias-free estimation of a mediation effect from one to multiple related outcomes offered an appreciable improvement in the power to detect media- tion effects and to estimate them more precisely. The significant effect through sessions indicates that some of the effect may well be genuinely connected with receipt of intervention material. The approach requires assumptions. Author details 1 Department of Public Health and Primary Care, University of Cambridge, CB2 0SR, UK. 2 Medical Research Council Biostatistics Unit, Institute of Public Health, Cambridge, CB2 0SR, UK. 3 Department of Primary Care and Public Health Sciences, Kings College London, SE1 3QD, UK. Published: 13 December 2011 References 1. Kinmonth AL, Wareham NJ, Hardeman W, Sutton S, Prevost AT, Fanshawe T, Williams KM, Ekelund U, Spiegelhalter D, Griffin SJ: Efficacy of a theory- based behavioural intervention to increase physical activity in an at-risk group in primary care (ProActive UK): a randomised trial. Lancet 2008, 371:41-48. * Correspondence: [email protected] 1 Department of Public Health and Primary Care, University of Cambridge, CB2 0SR, UK Full list of author information is available at the end of the article Casey et al. Trials 2011, 12(Suppl 1):A146 http://www.trialsjournal.com/content/12/S1/A146 TRIALS © 2011 Casey et al; licensee BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Modelling multiple outcomes to improve the detection of causal mediation effects in complex intervention trials

Embed Size (px)

Citation preview

Page 1: Modelling multiple outcomes to improve the detection of causal mediation effects in complex intervention trials

ORAL PRESENTATION Open Access

Modelling multiple outcomes to improve thedetection of causal mediation effects in complexintervention trialsNeil Casey1, Simon Thompson1,2, Andrew T Prevost1,3*

From Clinical Trials Methodology Conference 2011Bristol, UK. 4-5 October 2011

AimIn a trial to increase physical activity in sedentary adults,there was no evidence of effect on the primary outcome,though large significant effects amongst eight relatedSF36 measures of general health [1]. How could suchdifferences arise? Could they be: a true effect mediatedthrough receiving the intervention, another systematiceffect such as self-reporting bias, and/or chance? Theaim was to develop reliable methods to investigatewhether effects of the intervention on the SF36 out-comes were mediated through truly receiving the inter-vention delivered in intervention sessions.

MethodsWe adopted a structural mean modelling approach witha two-stage least-squares estimation algorithm, in orderto estimate mediation effects free from confounding bias[2]. It involves predicting the mediator (number of ses-sions attended), and outcomes, from baseline covariates.Each individual has a personal predicted ‘counterfactual’treatment-effect difference which is regressed on thepredicted mediator using a dose-response model.Although reliably bias-free, typically these methods donot provide sufficiently precise estimates except for thesimplest of models. A simulation study was designed toestablish the factors driving the lack of precision. Weextended the two-stage approach, using linear mixedeffects and GEE modelling to enable multiple SF36 out-comes to contribute to estimation of a common media-tion effect.

ResultsIn this trial, attendance at sessions was invariably high,adversely affecting the precision of the estimates. Fromthe simulation study, important factors affecting detec-tion were identified to be the size of the trial effect andthe degree to which the mediator is predictable frombaseline covariates. The effect of analysing four SF36outcomes to estimate an assumed common mediationeffect was to reduce the standard error of the estimatedeffect by up to 40%, equivalent to offering an increase inpower to detect mediation from 50% to 80%. The med-iation effect was statistically significant.

ConclusionsThe extension of bias-free estimation of a mediationeffect from one to multiple related outcomes offered anappreciable improvement in the power to detect media-tion effects and to estimate them more precisely. Thesignificant effect through sessions indicates that some ofthe effect may well be genuinely connected with receiptof intervention material. The approach requiresassumptions.

Author details1Department of Public Health and Primary Care, University of Cambridge,CB2 0SR, UK. 2Medical Research Council Biostatistics Unit, Institute of PublicHealth, Cambridge, CB2 0SR, UK. 3Department of Primary Care and PublicHealth Sciences, King’s College London, SE1 3QD, UK.

Published: 13 December 2011

References1. Kinmonth AL, Wareham NJ, Hardeman W, Sutton S, Prevost AT, Fanshawe T,

Williams KM, Ekelund U, Spiegelhalter D, Griffin SJ: Efficacy of a theory-based behavioural intervention to increase physical activity in an at-riskgroup in primary care (ProActive UK): a randomised trial. Lancet 2008,371:41-48.

* Correspondence: [email protected] of Public Health and Primary Care, University of Cambridge,CB2 0SR, UKFull list of author information is available at the end of the article

Casey et al. Trials 2011, 12(Suppl 1):A146http://www.trialsjournal.com/content/12/S1/A146 TRIALS

© 2011 Casey et al; licensee BioMed Central Ltd. This is an open access article distributed under the terms of the Creative CommonsAttribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction inany medium, provided the original work is properly cited.

Page 2: Modelling multiple outcomes to improve the detection of causal mediation effects in complex intervention trials

2. Dunn G, Bentall R: Modelling treatment-effect heterogeneity inrandomized controlled trials of complex interventions (psychologicaltreatments). Stat Med 2007, 26:4719-4745.

doi:10.1186/1745-6215-12-S1-A146Cite this article as: Casey et al.: Modelling multiple outcomes toimprove the detection of causal mediation effects in complexintervention trials. Trials 2011 12(Suppl 1):A146.

Submit your next manuscript to BioMed Centraland take full advantage of:

• Convenient online submission

• Thorough peer review

• No space constraints or color figure charges

• Immediate publication on acceptance

• Inclusion in PubMed, CAS, Scopus and Google Scholar

• Research which is freely available for redistribution

Submit your manuscript at www.biomedcentral.com/submit

Casey et al. Trials 2011, 12(Suppl 1):A146http://www.trialsjournal.com/content/12/S1/A146

Page 2 of 2