Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Research article

A patient-centered composite endpoint weighting technique for orthopaedic trauma research

Authors: Ugochukwu N. Udogwu, Andrea Howe, Katherine Frey, Marckenley Isaac, Daniel Connelly, Dimitrius Marinos, Mitchell Baker, Renan C. Castillo, Gerard P. Slobogean, Robert V. O’Toole, Nathan N. O’Hara

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

This study aimed to address the current limitations of the use of composite endpoints in orthopaedic trauma research by quantifying the relative importance of clinical outcomes common to orthopaedic trauma patients and use those values to develop a patient-centered composite endpoint weighting technique.

Methods

A Best-Worst Scaling choice experiment was administered to 396 adult surgically-treated fracture patients. Respondents were presented with ten choice sets, each consisting of three out of ten plausible clinical outcomes. Hierarchical Bayesian modeling was used to determine the utilities associated with the outcomes.

Results

Death was the outcome of greatest importance (mean utility = − 8.91), followed by above knee amputation (− 7.66), below knee amputation (− 6.97), severe pain (− 5.90), deep surgical site infection (SSI) (− 5.69), bone healing complications (− 5.20), and moderate pain (− 4.59). Mild pain (− 3.30) and superficial SSI (− 3.29), on the other hand, were the outcomes of least importance to respondents.

Conclusion

This study revealed that patients’ relative importance towards clinical outcomes followed a logical gradient, with distinct and quantifiable preferences for each possible component outcome. These findings were incorporated into a novel composite endpoint weighting technique.
Appendix
Available only for authorised users
Literature
1.
go back to reference Braunwald E, Cannon CP, McCabe CH. An approach to evaluating thrombolytic therapy in acute myocardial infarction. The 'unsatisfactory outcome' end point. Circ. 1992;86(2):683–7.CrossRef Braunwald E, Cannon CP, McCabe CH. An approach to evaluating thrombolytic therapy in acute myocardial infarction. The 'unsatisfactory outcome' end point. Circ. 1992;86(2):683–7.CrossRef
2.
go back to reference Sun H, Davison BA, Cotter G, et al. Evaluating treatment efficacy by multiple end points in phase II acute heart failure clinical trials: analyzing data using a global method. Circ Heart Fail. 2012 Nov;5(6):742–9.CrossRef Sun H, Davison BA, Cotter G, et al. Evaluating treatment efficacy by multiple end points in phase II acute heart failure clinical trials: analyzing data using a global method. Circ Heart Fail. 2012 Nov;5(6):742–9.CrossRef
3.
go back to reference Brown PM, Anstrom KJ, Felker GM, et al. Composite End Points in Acute Heart Failure Research: Data Simulations Illustrate the Limitations. Can J Cardiol. 2016 Nov;32(11):1356.e21–8.CrossRef Brown PM, Anstrom KJ, Felker GM, et al. Composite End Points in Acute Heart Failure Research: Data Simulations Illustrate the Limitations. Can J Cardiol. 2016 Nov;32(11):1356.e21–8.CrossRef
4.
go back to reference Heneghan C, Goldacre B, Mahtani KR. Why clinical trial outcomes fail to translate into benefits for patients. Trials. 2017;18(1):122.CrossRef Heneghan C, Goldacre B, Mahtani KR. Why clinical trial outcomes fail to translate into benefits for patients. Trials. 2017;18(1):122.CrossRef
5.
go back to reference Ferreira-Gonzalez I, Permanyer-Miralda G, Busse JW, Bryant DM, Montori VM, Alonso-Coello P, et al. Methodologic discussions for using and interpreting composite endpoints are limited, but still identify major concerns. J Clin Epidemiol. 2007;60(7):651–7 discussion 8-62.CrossRef Ferreira-Gonzalez I, Permanyer-Miralda G, Busse JW, Bryant DM, Montori VM, Alonso-Coello P, et al. Methodologic discussions for using and interpreting composite endpoints are limited, but still identify major concerns. J Clin Epidemiol. 2007;60(7):651–7 discussion 8-62.CrossRef
6.
go back to reference Heddle NM, Cook RJ. Composite outcomes in clinical trials: what are they and when should they be used? Transfus. 2011;51(1):11–3.CrossRef Heddle NM, Cook RJ. Composite outcomes in clinical trials: what are they and when should they be used? Transfus. 2011;51(1):11–3.CrossRef
7.
go back to reference Montori VM, Permanyer-Miralda G, Ferreira-Gonzalez I, Busse JW, Pacheco-Huergo V, Bryant D, et al. Validity of composite end points in clinical trials. BMJ. 2005;330(7491):594–6.CrossRef Montori VM, Permanyer-Miralda G, Ferreira-Gonzalez I, Busse JW, Pacheco-Huergo V, Bryant D, et al. Validity of composite end points in clinical trials. BMJ. 2005;330(7491):594–6.CrossRef
8.
go back to reference Armstrong PW, Westerhout CM, Van de Werf F, Califf RM, Welsh RC, Wilcox RG, et al. Refining clinical trial composite outcomes: an application to the assessment of the safety and efficacy of a new Thrombolytic-3 (ASSENT-3) trial. Am Heart J. 2011;161(5):848–54.CrossRef Armstrong PW, Westerhout CM, Van de Werf F, Califf RM, Welsh RC, Wilcox RG, et al. Refining clinical trial composite outcomes: an application to the assessment of the safety and efficacy of a new Thrombolytic-3 (ASSENT-3) trial. Am Heart J. 2011;161(5):848–54.CrossRef
9.
go back to reference Hong KS, Ali LK, Selco SL, Fonarow GC, Saver JL. Weighting components of composite end points in clinical trials: an approach using disability-adjusted life-years. Stroke. 2011;42(6):1722–9.CrossRef Hong KS, Ali LK, Selco SL, Fonarow GC, Saver JL. Weighting components of composite end points in clinical trials: an approach using disability-adjusted life-years. Stroke. 2011;42(6):1722–9.CrossRef
10.
go back to reference Global burden of disease 2004 update: disability weights for diseases and conditions. Geneva, Switzerland: World Health Organization; 2004. Global burden of disease 2004 update: disability weights for diseases and conditions. Geneva, Switzerland: World Health Organization; 2004.
11.
go back to reference Stolker JM, Spertus JA, Cohen DJ, et al. Rethinking composite end points in clinical trials: insights from patients and trialists. Circ. 2014 Oct 7;130(15):1254–61.CrossRef Stolker JM, Spertus JA, Cohen DJ, et al. Rethinking composite end points in clinical trials: insights from patients and trialists. Circ. 2014 Oct 7;130(15):1254–61.CrossRef
12.
go back to reference Vaanholt MCW, Kok MM, von Birgelen C, et al. Are component endpoints equal? A preference study into the practice of composite endpoints in clinical trials. Health Expect. 2018 Dec;21(6):1046–55.CrossRef Vaanholt MCW, Kok MM, von Birgelen C, et al. Are component endpoints equal? A preference study into the practice of composite endpoints in clinical trials. Health Expect. 2018 Dec;21(6):1046–55.CrossRef
13.
go back to reference Finn A, Louviere JJ. Determining the appropriate response to evidence of public concern: the case of food safety. J Public Policy Mark. 1992;11(2):12–25.CrossRef Finn A, Louviere JJ. Determining the appropriate response to evidence of public concern: the case of food safety. J Public Policy Mark. 1992;11(2):12–25.CrossRef
14.
go back to reference Szeinbach L, Barnes S. H, McGhan J, F, et al. using conjoint analysis to evaluate health state preferences. Drug Inf J. 1999;33:849–58.CrossRef Szeinbach L, Barnes S. H, McGhan J, F, et al. using conjoint analysis to evaluate health state preferences. Drug Inf J. 1999;33:849–58.CrossRef
15.
go back to reference O'Hara NN, Roy L, O'Hara LM, Spiegel JM, Lynd LD, FitzGerald JM, et al. Healthcare worker preferences for active tuberculosis case finding programs in South Africa: a best-worst scaling choice experiment. PLoS One. 2015;10(7):e0133304.CrossRef O'Hara NN, Roy L, O'Hara LM, Spiegel JM, Lynd LD, FitzGerald JM, et al. Healthcare worker preferences for active tuberculosis case finding programs in South Africa: a best-worst scaling choice experiment. PLoS One. 2015;10(7):e0133304.CrossRef
16.
go back to reference Louviere J, Lings I, Islam T, Gudergan S, Flynn T. An introduction to the application of (case 1) best–worst scaling in marketing research. Int J Res Mark. 2013;30(3):292–303.CrossRef Louviere J, Lings I, Islam T, Gudergan S, Flynn T. An introduction to the application of (case 1) best–worst scaling in marketing research. Int J Res Mark. 2013;30(3):292–303.CrossRef
17.
go back to reference Bridges JF, Hauber AB, Marshall D, Lloyd A, Prosser LA, Regier DA, et al. Conjoint analysis applications in health--a checklist: a report of the ISPOR good research practices for conjoint analysis task force. Value Health. 2011;14(4):403–13.CrossRef Bridges JF, Hauber AB, Marshall D, Lloyd A, Prosser LA, Regier DA, et al. Conjoint analysis applications in health--a checklist: a report of the ISPOR good research practices for conjoint analysis task force. Value Health. 2011;14(4):403–13.CrossRef
18.
go back to reference Bosse MJ, MacKenzie EJ, Kellam JF, Burgess AR, Webb LX, Swiontkowski MF, et al. An analysis of outcomes of reconstruction or amputation after leg-threatening injuries. N Engl J Med. 2002 Dec 12;347(24):1924–31.CrossRef Bosse MJ, MacKenzie EJ, Kellam JF, Burgess AR, Webb LX, Swiontkowski MF, et al. An analysis of outcomes of reconstruction or amputation after leg-threatening injuries. N Engl J Med. 2002 Dec 12;347(24):1924–31.CrossRef
19.
go back to reference Investigators FLOW, Bhandari M, Jeray KJ, Petrisor BA, Devereaux PJ, Heels-Ansdell D, et al. A trial of wound irrigation in the initial management of open fracture wounds. N Engl J Med. 2015 Dec 31;373(27):2629–41.CrossRef Investigators FLOW, Bhandari M, Jeray KJ, Petrisor BA, Devereaux PJ, Heels-Ansdell D, et al. A trial of wound irrigation in the initial management of open fracture wounds. N Engl J Med. 2015 Dec 31;373(27):2629–41.CrossRef
20.
go back to reference Fixation using Alternative Implants for the Treatment of Hip fractures (FAITH) Investigators. Fracture fixation in the operative management of hip fractures (FAITH): an international, multicentre, randomised controlled trial. Lancet. 2017 Apr 15;389(10078):1519–27.CrossRef Fixation using Alternative Implants for the Treatment of Hip fractures (FAITH) Investigators. Fracture fixation in the operative management of hip fractures (FAITH): an international, multicentre, randomised controlled trial. Lancet. 2017 Apr 15;389(10078):1519–27.CrossRef
21.
go back to reference Study to Prospectively Evaluate Reamed Intramedullary Nails in Patients with Tibial Fractures Investigators, Bhandari M, Guyatt G, Tornetta P 3rd, Schemitsch EH, Swiontkowski M, et al. Randomized trial of reamed and unreamed intramedullary nailing of tibial shaft fractures. J Bone Joint Surg Am. 2008 Dec;90(12):2567–78.CrossRef Study to Prospectively Evaluate Reamed Intramedullary Nails in Patients with Tibial Fractures Investigators, Bhandari M, Guyatt G, Tornetta P 3rd, Schemitsch EH, Swiontkowski M, et al. Randomized trial of reamed and unreamed intramedullary nailing of tibial shaft fractures. J Bone Joint Surg Am. 2008 Dec;90(12):2567–78.CrossRef
22.
go back to reference Kuhfeld WF, Tobias RD, Garratt M. Efficient experimental design with marketing research applications. J Mark Res. 1994 Nov;31(4):545–57.CrossRef Kuhfeld WF, Tobias RD, Garratt M. Efficient experimental design with marketing research applications. J Mark Res. 1994 Nov;31(4):545–57.CrossRef
23.
go back to reference Cheraghi-Sohi S, Hole AR, Mead N, McDonald R, Whalley D, Bower P, et al. What patients want from primary care consultations: a discrete choice experiment to identify patients' priorities. Ann Fam Med. 2008;6(2):107–15.CrossRef Cheraghi-Sohi S, Hole AR, Mead N, McDonald R, Whalley D, Bower P, et al. What patients want from primary care consultations: a discrete choice experiment to identify patients' priorities. Ann Fam Med. 2008;6(2):107–15.CrossRef
24.
go back to reference Train K. A comparison of hierarchical Bayes and maximum simulated likelihood for mixed logit. Univ California, Berkeley. 2001 Jun;18:1–3. Train K. A comparison of hierarchical Bayes and maximum simulated likelihood for mixed logit. Univ California, Berkeley. 2001 Jun;18:1–3.
25.
go back to reference McFadden D. Conditional logit analysis of qualitative choice behaviour. In: Zarembka P, editor. Frontiers in econometrics. New York: Academic Press; 1974. p. 105–42. McFadden D. Conditional logit analysis of qualitative choice behaviour. In: Zarembka P, editor. Frontiers in econometrics. New York: Academic Press; 1974. p. 105–42.
26.
go back to reference Kramer CY. Extension of multiple range tests to group means with unequal numbers of replications. Biometrics. 1956 Sep 1;12(3):307–10.CrossRef Kramer CY. Extension of multiple range tests to group means with unequal numbers of replications. Biometrics. 1956 Sep 1;12(3):307–10.CrossRef
27.
go back to reference Felker GM, Maisel AS. A global rank end point for clinical trials in acute heart failure. Circ Heart Fail. 2010;3:643–6.CrossRef Felker GM, Maisel AS. A global rank end point for clinical trials in acute heart failure. Circ Heart Fail. 2010;3:643–6.CrossRef
28.
go back to reference Brown PM, Ezekowitz JA. Composite End Points in Clinical Trials of Heart Failure Therapy: How Do We Measure the Effect Size? Circ Heart Fail. 2017 Jan;10(1). Brown PM, Ezekowitz JA. Composite End Points in Clinical Trials of Heart Failure Therapy: How Do We Measure the Effect Size? Circ Heart Fail. 2017 Jan;10(1).
29.
go back to reference Acion L, Peterson JJ, Temple S, Arndt S. Probabilistic index: an intuitive non-parametric approach to measuring the size of treatment effects. Stat Med. 2006;25:591–602.CrossRef Acion L, Peterson JJ, Temple S, Arndt S. Probabilistic index: an intuitive non-parametric approach to measuring the size of treatment effects. Stat Med. 2006;25:591–602.CrossRef
30.
go back to reference Califf RM, Harrelson-Woodlief L, Topol EJ. Left ventricular ejection fraction may not be useful as an end point of thrombolytic therapy comparative trials. Circ. 1990;82(5):1847–53.CrossRef Califf RM, Harrelson-Woodlief L, Topol EJ. Left ventricular ejection fraction may not be useful as an end point of thrombolytic therapy comparative trials. Circ. 1990;82(5):1847–53.CrossRef
31.
go back to reference Felker GM, Anstrom KJ, Rogers JG. A global ranking approach to end points in trials of mechanical circulatory support devices. J Card Fail. 2008;14(5):368–72.CrossRef Felker GM, Anstrom KJ, Rogers JG. A global ranking approach to end points in trials of mechanical circulatory support devices. J Card Fail. 2008;14(5):368–72.CrossRef
32.
go back to reference Follmann D, Wittes J, Cutler JA. The use of subjective rankings in clinical trials with an application to cardiovascular disease. Stat Med. 1992;11(4):427–37 discussion 39-54.CrossRef Follmann D, Wittes J, Cutler JA. The use of subjective rankings in clinical trials with an application to cardiovascular disease. Stat Med. 1992;11(4):427–37 discussion 39-54.CrossRef
33.
go back to reference Ferreira-Gonzalez I, Busse JW, Heels-Ansdell D, Montori VM, Akl EA, Bryant DM, et al. Problems with use of composite end points in cardiovascular trials: systematic review of randomised controlled trials. BMJ. 2007;334(7597):786.CrossRef Ferreira-Gonzalez I, Busse JW, Heels-Ansdell D, Montori VM, Akl EA, Bryant DM, et al. Problems with use of composite end points in cardiovascular trials: systematic review of randomised controlled trials. BMJ. 2007;334(7597):786.CrossRef
34.
go back to reference Stolker JM, Spertus JA, Cohen DJ, Jones PG, Jain KK, Bamberger E, et al. Rethinking composite end points in clinical trials: insights from patients and trialists. Circ. 2014;130(15):1254–61.CrossRef Stolker JM, Spertus JA, Cohen DJ, Jones PG, Jain KK, Bamberger E, et al. Rethinking composite end points in clinical trials: insights from patients and trialists. Circ. 2014;130(15):1254–61.CrossRef
35.
go back to reference Tong BC, Huber JC, Ascheim DD, Puskas JD, Ferguson TB Jr, Blackstone EH, et al. Weighting composite endpoints in clinical trials: essential evidence for the heart team. Ann Thorac Surg. 2012;94(6):1908–13.CrossRef Tong BC, Huber JC, Ascheim DD, Puskas JD, Ferguson TB Jr, Blackstone EH, et al. Weighting composite endpoints in clinical trials: essential evidence for the heart team. Ann Thorac Surg. 2012;94(6):1908–13.CrossRef
36.
go back to reference Bakal JA, Westerhout CM, Cantor WJ, Fernandez-Aviles F, Welsh RC, Fitchett D, et al. Evaluation of early percutaneous coronary intervention vs. standard therapy after fibrinolysis for ST-segment elevation myocardial infarction: contribution of weighting the composite endpoint. Eur Heart J. 2013;34(12):903–8.CrossRef Bakal JA, Westerhout CM, Cantor WJ, Fernandez-Aviles F, Welsh RC, Fitchett D, et al. Evaluation of early percutaneous coronary intervention vs. standard therapy after fibrinolysis for ST-segment elevation myocardial infarction: contribution of weighting the composite endpoint. Eur Heart J. 2013;34(12):903–8.CrossRef
Metadata
Title
A patient-centered composite endpoint weighting technique for orthopaedic trauma research
Authors
Ugochukwu N. Udogwu
Andrea Howe
Katherine Frey
Marckenley Isaac
Daniel Connelly
Dimitrius Marinos
Mitchell Baker
Renan C. Castillo
Gerard P. Slobogean
Robert V. O’Toole
Nathan N. O’Hara
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0885-7

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue