1
Methods Metabolite quantitation data was selected for biomarker analysis when missingness was < 20%*, and the assay precision** was %CV <=25%. All metabolite and protein quantitation data were log- transformed. Quantitation data showing significant dependency (p<0.01) on collection center, BMI at sampling, age, or gestational age at sampling were normalised using Multiple of the Median (MoM) methodology. Both normalised and non-normalised were considered. Cotinine data was dichotomized based on presence (1) or absence (0) in a specimen; strong agreement with self-reported smoking status was found. *except for cotinine; **based on replicate analyses Predictive performance: The prognostic performance of single variables for all-, preterm- and term-PE was assessed using AUROC. (Bio)marker selection: Variables with AUROC >0.6 (and lower limit of the AUROC 95% CI ≥0.5) are considered promsing predictors. Modelling: For each possible combination of one to four predictors, a model was trained using one component partial least square analysis (PLS-DA/EDC) across all outcomes. The prognostic performance were derived for a) mean over 3-fold cross validation and b) the entire sample sets. Concordance with models developed using logistic regression was also checked. Model selection: Models were selected if 1) lower limit of the 95% CI ≥0.5 for the AUROC statistic in both the cross-validation and entire set, AND 2) difference between the AUROC statistic over the cross- validation and the entire set <=0.1. Only sparse models were retained by selecting models whose difference of test performance between a given model and all its parent models are greater than a given threshold. Biomarker selection: Predictors were ranked based on the test performance of the selected models they are constituent of. Metabolomic Diagnostics (MetDx) developed the MetDxSCOUT™ workflow. All metabolite analyses were performed at MetDx as part of IMPROvED. *MetDx is developing the clinical assays. Generic performance Rule-in performance Rule-out performance AUROC Sn at 20% FPR Sp at 20% FNR Sn at 10% FPR Sp at 20% FNR Sn at pre-set PPV Sp at pre-set NPV Outcome Prevalence in SCOPE 3 PPV cut-off NPV cut-off Cut-off rationale All PE 0.05 1/7.5= 0.133 1-(1/90)= 0.988 Equal to PE risk in multiparous with previous PE (PPV) or without previous PE (NPV) 4 Preterm PE (<37 wks) 0.014 1/14= 0.0714 1-(1/400)= 0.9975 PPV and NPV targets based on Preterm predictor as reported in 6 Term PE (>=37) 0.037 1/6.5= 0.154 1-1/160 = 0.99375 Arbitrary: 5-fold increase in risk (PPV); 5-fold decrease in risk (NPV) Combining Metabolite Biomarkers and Placental Growth Factor Yields a Prognostic Test for Preterm Pre-eclampsia 1 Faculty of Health & Life Sciences, University of Liverpool, UK; 2 SQU4RE, Lokeren, Belgium; 3 Department of Women and Children’s Health, King’s College London, UK; 4 Maternal & Fetal Health Research Centre, University of Manchester, UK; 5 Leeds Institute of Biomedical and Clinical Sciences, University of Leeds, UK; 6 Irish Centre for Fetal and Neonatal Translational Research, Cork, Ireland; 7 College of Life Sciences, University of Leicester, UK; 8 Metabolomic Diagnostics, Cork, Ireland; 9 On behalf of the Screening for Pregnancy Outcomes (SCOPE) consortium Objectives Develop a library of quantitative mass spectrometry assays for metabolites implicated in pre-eclampsia (PE), whereby metabolites discovered in the New Zealand/Australian SCOPE study samples 2 were prioritised. Verify the biomarker potential for prediction of either low or high risk of developing PE, preterm-PE and/or term-PE in early pregnancy specimens from a separate low risk nulliparous cohort, i.e., the European branch of SCOPE. Identify core combinations of complementary (bio)markers with the potential of delivering clinical useful prognostic performance for prediction of all-, preterm- and/or term- PE. 2 Kenny et al; doi:10.1161/hypertensionaha.110.157297 Introduction Prognosis of pre-eclampsia in nulliparous remains a challenge in prenatal care. Nulliparity is a significant risk factor (RR = 2.1; 95%CI 1.9 – 2.4) 1 , and accounts for the greatest population attributable fraction of pre-eclampsia (PAF = 32.3%; 95% CI 27.4– 37.0) 1 , Current prenatal care protocols are still largely based on clinical risk factors, rendering them ineffective for predicting pre- eclampsia risk in 1 st time pregnant women. The protein biomarkers Placental Growth factor (PlGF), soluble Fms-like tyrosine kinase-1 (s-Flt1) and soluble Endoglin (s-ENG) have been extensively studied in pre-eclampsia prognosis and detection. Low levels of circulating PlGF early in pregnancy have some prognostic performance, yet PlGF-based prognosis is insufficient to warrants its use in a single-marker test. Thus far, most attempts to find additional biomarkers to improve the prediction of pre-eclampsia risk in nulliparous, did not progress beyond the biomarker discovery phase. We established MetDxSCOUT™, a translational research workflow, to elicit genuine metabolite biomarker potential within discovered biomarker candidates studies 1 Bartsch et al; doi:10.1136/bmj.i1753 Results Variables which featured in at least two of the prognostic viewpoints assessed (univariable. multivariable modelling: generic, rule-in, rule-out) across the three outcomes investigated (all-, preterm- and term PE) are considered verified. Conclusions An extensive list of putative metabolite biomarkers for the prognosis of pre-eclampsia have been subjected to a comprehensive verification exercise, resulting in a verified set of 13 prognostic metabolites. These are being progressed to clinical assay development*. Three metabolite biomarkers were found to effectively complement PlGF enabling accurate prediction of preterm PE at 15 weeks’ gestation. Taken together with PlGF, a marker for placental insufficiency, the resulting 3+1 panel more comprehensively encapsulates the different aspects of the preterm pre-eclampsia syndrome, thus delivering accurate biomarker-only preterm PE prognosis in nulliparous, which was unachievable until now. Preterm PE prognosis: Exemplary Univariable Performances Marker AUROC 95% CI Dilinoleoyl-glycerol (DLG) 0.70 [0.59 0.82] Study samples Variables for in prognostic analysis Prognostic viewpoints considered Thomas et al; doi: 10.1186/s41512-017-0017-y Louise Kenny 1,9 , Grégoire Thomas 2,8 , Lucilla Poston 3,9 , Jenny Myers 4,9 , Nigel Simpson 5,9 , Fergus McCarthy 6,9 Philip Baker 7,9 , Robin Tuytten 8 5 Rolnik et al; doi: 10.1002/uog.18816 3 Kenny et al; doi: 10.1161/hypertensionaha.114.03578 Data Pre-processing Univariable analysis Multivariable analysis Test performance: The statistics used to assess biomarker panels for prognosing generic-, high- (rule-in) or low PE risk (rule-out) are given ↓→. Verified prognostic (bio)markers for PE Recursive partitioning was applied to further triage the “PlGF-only” False Negatives into a high PE risk group (PPV>=0.07) and a low PE risk group (NPV >= 0.9975). Marker AUROC 95% CI Placental Growth Factor 0.73 [0.61 0.85] Clinical risk factor Metabolite Bmi Dilinoleoyl-glycerol (DLG) Blood pressure Citrulline Protein 1-heptadecanoyl-2-hydroxy-sn- glycero-3-phosphocholine Placental Growth factor Isoleucine (ILE) s-Endoglin Leucine (LEU) NG-Monomethyl-L-arginine Stearoylcarnitine Univariable Performance Ergothioneine (ERG) Complementarity in multivariable models 2-Hydroxybutanoic acid Decanoylcarnitine Etiocholanolone glucuronide 20-Carboxy-leukotriene B4 25-Hydroxyvitamin D3 Complementing PlGF for Preterm PE prognosis Interestingly the three metabolites map onto complementary pathways. DLG, a diacylglycerol, may mediate insulin resistance, ergothioneine associates with mitochondrial oxidative stress, and amino acids leucine/isoleucine inform about placental nutrient uptake. The authors GT & RT also gratefully acknowledge the SCOPE consortium for the collaboration opportunity. The authors LK, FMC, PB & RT gratefully acknowledge funding from the EU-HEALTH Project IMPROvED (305169) of the Seventh Framework Programme. IMPROvED’s goal is to develop a clinically robust predictive blood test for pre-eclampsia. www .fp7-improved.eu

Combining Metabolite Biomarkers and Placental Growth ... · (PLS-DA/EDC) across all outcomes. The prognostic performance were derived for a) mean over 3-fold cross validation and

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Combining Metabolite Biomarkers and Placental Growth ... · (PLS-DA/EDC) across all outcomes. The prognostic performance were derived for a) mean over 3-fold cross validation and

Methods

• Metabolite quantitation datawas selected for biomarkeranalysis when missingness was< 20%*, and the assayprecision** was %CV <=25%.

• All metabolite and proteinquantitation data were log-transformed.

• Quantitation data showingsignificant dependency(p<0.01) on collection center,BMI at sampling, age, orgestational age at samplingwere normalised usingMultiple of the Median (MoM)methodology. Both normalisedand non-normalised wereconsidered.

• Cotinine data was dichotomized based on presence (1) or absence(0) in a specimen; strong agreement with self-reported smokingstatus was found.

*except for cotinine; **based on replicate analyses

• Predictive performance: The prognostic performance of singlevariables for all-, preterm- and term-PE was assessed using AUROC.

• (Bio)marker selection: Variables with AUROC >0.6 (and lower limit ofthe AUROC 95% CI ≥0.5) are considered promsing predictors.

• Modelling: For each possible combination of one to four predictors, amodel was trained using one component partial least square analysis(PLS-DA/EDC) across all outcomes. The prognostic performance werederived for a) mean over 3-fold cross validation and b) the entiresample sets. Concordance with models developed using logisticregression was also checked.

• Model selection: Models were selected if 1) lower limit of the 95% CI≥0.5 for the AUROC statistic in both the cross-validation and entireset, AND 2) difference between the AUROC statistic over the cross-validation and the entire set <=0.1. Only sparse models wereretained by selecting models whose difference of test performancebetween a given model and all its parent models are greater than agiven threshold.

• Biomarker selection: Predictors were ranked based on the testperformance of the selected models they are constituent of.

Metabolomic Diagnostics (MetDx) developed the MetDxSCOUT™ workflow. Allmetabolite analyses were performed at MetDx as part of IMPROvED. *MetDx isdeveloping the clinical assays.

Generic

performance

Rule-in

performance

Rule-out

performance

AUROC

Sn at 20% FPR Sp at 20% FNR

Sn at 10% FPR Sp at 20% FNR

Sn at pre-set PPV Sp at pre-set NPV

Outcome Prevalence

in SCOPE3

PPV

cut-off

NPV

cut-off

Cut-off rationale

All PE 0.051/7.5=

0.133

1-(1/90)=

0.988

Equal to PE risk in multiparous with previous

PE (PPV) or without previous PE (NPV)4

Preterm PE

(<37 wks) 0.014

1/14=

0.0714

1-(1/400)=

0.9975

PPV and NPV targets based on Preterm

predictor as reported in6

Term PE

(>=37)0.037

1/6.5=

0.154

1-1/160 =

0.99375

Arbitrary: 5-fold increase in risk (PPV); 5-fold

decrease in risk (NPV)

Combining Metabolite Biomarkers and Placental Growth Factor Yields a Prognostic Test for Preterm Pre-eclampsia

1Faculty of Health & Life Sciences, University of Liverpool, UK; 2SQU4RE, Lokeren, Belgium; 3Department of Women and Children’s Health, King’s College London, UK; 4Maternal & Fetal Health Research Centre, University of Manchester, UK; 5Leeds Institute of Biomedical and Clinical Sciences, University of Leeds, UK; 6Irish Centre for Fetal and Neonatal Translational Research, Cork,

Ireland; 7College of Life Sciences, University of Leicester, UK; 8Metabolomic Diagnostics, Cork, Ireland; 9On behalf of the Screening for Pregnancy Outcomes (SCOPE) consortium

Objectives• Develop a library of quantitative mass spectrometry assaysfor metabolites implicated in pre-eclampsia (PE), wherebymetabolites discovered in the New Zealand/AustralianSCOPE study samples2were prioritised.

• Verify the biomarker potential for prediction of either lowor high risk of developing PE, preterm-PE and/or term-PEin early pregnancy specimens from a separate low risknulliparous cohort, i.e., the European branch of SCOPE.

• Identify core combinations of complementary (bio)markerswith the potential of delivering clinical useful prognosticperformance for prediction of all-, preterm- and/or term-PE.

2Kenny et al; doi:10.1161/hypertensionaha.110.157297

IntroductionPrognosis of pre-eclampsia in nulliparous remains achallenge in prenatal care.

• Nulliparity is a significant risk factor (RR = 2.1; 95%CI 1.9 –2.4)1, and accounts for the greatest population attributablefraction of pre-eclampsia (PAF = 32.3%; 95% CI 27.4– 37.0)1,

• Current prenatal care protocols are still largely based on clinicalrisk factors, rendering them ineffective for predicting pre-eclampsia risk in 1st time pregnant women.

• The protein biomarkers Placental Growth factor (PlGF), solubleFms-like tyrosine kinase-1 (s-Flt1) and soluble Endoglin (s-ENG)have been extensively studied in pre-eclampsia prognosis anddetection. Low levels of circulating PlGF early in pregnancy havesome prognostic performance, yet PlGF-based prognosis isinsufficient to warrants its use in a single-marker test.

• Thus far, most attempts to find additional biomarkers to improvethe prediction of pre-eclampsia risk in nulliparous, did notprogress beyond the biomarker discovery phase.

• We established MetDxSCOUT™, a translational researchworkflow, to elicit genuine metabolite biomarker potential withindiscovered biomarker candidates studies

1Bartsch et al; doi:10.1136/bmj.i1753

Results

• Variables which featured in at least two of the prognosticviewpoints assessed (univariable. multivariable modelling:generic, rule-in, rule-out) across the three outcomesinvestigated (all-, preterm- and term PE) are considered verified.

Conclusions• An extensive list of putative metabolite biomarkers for

the prognosis of pre-eclampsia have been subjectedto a comprehensive verification exercise, resulting ina verified set of 13 prognostic metabolites. These arebeing progressed to clinical assay development*.

• Three metabolite biomarkers were found to effectivelycomplement PlGF enabling accurate prediction ofpreterm PE at 15 weeks’ gestation.

Taken together with PlGF, a marker for placentalinsufficiency, the resulting 3+1 panel morecomprehensively encapsulates the different aspects ofthe preterm pre-eclampsia syndrome, thus deliveringaccurate biomarker-only preterm PE prognosis innulliparous, which was unachievable until now.

Preterm PE prognosis: Exemplary Univariable Performances

Marker AUROC95% CI

Dilinoleoyl-glycerol (DLG)0.70

[0.59 – 0.82]

Study samples

Variables for in prognostic analysis

Prognostic viewpoints considered

Thomas et al; doi: 10.1186/s41512-017-0017-y

Louise Kenny1,9, Grégoire Thomas2,8, Lucilla Poston3,9, Jenny Myers4,9, Nigel Simpson5,9, Fergus McCarthy6,9 Philip Baker7,9, Robin Tuytten8

5Rolnik et al; doi: 10.1002/uog.18816

3Kenny et al; doi: 10.1161/hypertensionaha.114.03578

Data Pre-processing

Univariable analysis

Multivariable analysis

• Test performance: Thestatistics used to assessbiomarker panels forprognosing generic-, high-(rule-in) or low PE risk(rule-out) are given↓→.

Verified prognostic (bio)markers for PE

• Recursive partitioningwas applied to furthertriage the “PlGF-only”False Negatives into ahigh PE risk group(PPV>=0.07) and a lowPE risk group (NPV >=0.9975).

Marker AUROC95% CI

Placental Growth Factor 0.73

[0.61 – 0.85]

Clinical risk factor Metabolite

Bmi Dilinoleoyl-glycerol (DLG)Blood pressure Citrulline

Protein1-heptadecanoyl-2-hydroxy-sn-glycero-3-phosphocholine

Placental Growth factor Isoleucine (ILE)s-Endoglin Leucine (LEU)

NG-Monomethyl-L-arginineStearoylcarnitine

Univariable Performance Ergothioneine (ERG)Complementarity in multivariable models

2-Hydroxybutanoic acidDecanoylcarnitineEtiocholanolone glucuronide20-Carboxy-leukotriene B425-Hydroxyvitamin D3

Complementing PlGF for Preterm PE prognosis

• Interestingly the three metabolites map onto complementarypathways. DLG, a diacylglycerol, may mediate insulinresistance, ergothioneine associates with mitochondrialoxidative stress, and amino acids leucine/isoleucine informabout placental nutrient uptake.

The authors GT & RT also gratefully acknowledge the SCOPE consortium for thecollaboration opportunity.

The authors LK, FMC, PB & RT gratefully acknowledge funding from the EU-HEALTHProject IMPROvED (305169) of the Seventh Framework Programme. IMPROvED’s goal is todevelop a clinically robust predictive blood test for pre-eclampsia. www.fp7-improved.eu