Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Medical Informatics and Decision Making
Published in: BMC Medical Informatics and Decision Making 1/2019

Open Access 01-12-2019 | Prostate Cancer | Research article

Meta-analysis of predictive models to assess the clinical validity and utility for patient-centered medical decision making: application to the CAncer of the Prostate Risk Assessment (CAPRA)

Authors: Marine Lorent, Haïfa Maalmi, Philippe Tessier, Stéphane Supiot, Etienne Dantan, Yohann Foucher

Published in: BMC Medical Informatics and Decision Making | Issue 1/2019

Login to get access

Abstract

Background

The Cancer of the Prostate Risk Assessment (CAPRA) score was designed and validated several times to predict the biochemical recurrence-free survival after a radical prostatectomy. Our objectives were, first, to study the clinical validity of the CAPRA score, and, second, to assess its clinical utility for stratified medicine from an original patient-centered approach.

Methods

We proposed a meta-analysis based on a literature search using MEDLINE. Observed and predicted biochemical-recurrence-free survivals were compared to assess the calibration of the CAPRA score. Discriminative capacities were evaluated by estimating the summary time-dependent ROC curve. The clinical utility of the CAPRA score was evaluated according to the following stratified decisions: active monitoring for low-risk patients, prostatectomy for intermediate-risk patients, or radio-hormonal therapy for high risk patients. For this purpose, we assessed CAPRA’s clinical utility in terms of its ability to maximize time-dependent utility functions (i.e. Quality-Adjusted Life-Years – QALYs).

Results

We identified 683 manuscripts and finally retained 9 studies. We reported good discriminative capacities with an area under the SROCt curve at 0.73 [95%CI from 0.67 to 0.79], while graphical calibration seemed acceptable. Nevertheless, we also described that the CAPRA score was unable to discriminate between the three medical alternatives, i.e. it did not allow an increase in the number of life years in perfect health (QALYs) of patients with prostate cancer.

Conclusions

We confirmed the prognostic capacities of the CAPRA score. In contrast, we were not able to demonstrate its clinical usefulness for stratified medicine from a patient-centered perspective. Our results also highlighted the confusion between clinical validity and utility. This distinction should be better considered in order to develop predictive tools useful in practice.
Appendix
Available only for authorised users
Literature
1.
Jemal A, Siegel R, Ward E, Hao Y, Xu J, Thun MJ. Cancer statistics, 2009. CA Cancer J Clin. 2009;59:225–49.CrossRefPubMed
2.
Paller CJ, Antonarakis ES. Management of biochemically recurrent prostate cancer after local therapy: evolving standards of care and new directions. Clin Adv Hematol Oncol HO. 2013;11:14–23.
3.
Antonarakis ES, Feng Z, Trock BJ, Humphreys EB, Carducci MA, Partin AW, et al. The natural history of metastatic progression in men with prostate-specific antigen recurrence after radical prostatectomy: long-term follow-up. BJU Int. 2012;109:32–9.CrossRefPubMed
4.
D’Amico AV, Whittington R, Malkowicz SB, Schultz D, Blank K, Broderick GA, et al. Biochemical outcome after radical prostatectomy, external beam radiation therapy, or interstitial radiation therapy for clinically localized prostate cancer. JAMA. 1998;280:969–74.CrossRefPubMed
5.
Roach M, Lu J, Pilepich MV, Asbell SO, Mohiuddin M, Terry R, et al. Four prognostic groups predict long-term survival from prostate cancer following radiotherapy alone on radiation therapy oncology group clinical trials. Int J Radiat Oncol Biol Phys. 2000;47:609–15.CrossRefPubMed
6.
Roach M, Weinberg V, Nash M, Sandler HM, McLaughlin PW, Kattan MW. Defining high risk prostate cancer with risk groups and nomograms: implications for designing clinical trials. J Urol. 2006;176(6 Pt 2):S16–20.PubMed
7.
Huang J, Vicini FA, Williams SG, Ye H, McGrath S, Ghilezan M, et al. Percentage of positive biopsy cores: a better risk stratification model for prostate cancer? Int J Radiat Oncol Biol Phys. 2012;83:1141–8.CrossRefPubMed
8.
Cooperberg MR, Pasta DJ, Elkin EP, Litwin MS, Latini DM, DuChane J, et al. The UCSF Cancer of the prostate risk assessment (CAPRA) score: a straightforward and reliable preoperative predictor of disease recurrence after radical prostatectomy. J Urol. 2005;173:1938–42.CrossRefPubMedCentralPubMed
9.
Kim Y-J, Cho KH, Pyo HR, Lee KH, Moon SH, Kim TH, et al. Radical prostatectomy versus external beam radiotherapy for localized prostate cancer: comparison of treatment outcomes. Strahlenther Onkol Organ Dtsch Rontgengesellschaft Al. 2014.
10.
Meurs P, Galvin R, Fanning DM, Fahey T. Prognostic value of the CAPRA clinical prediction rule: a systematic review and meta-analysis. BJU Int. 2013;111:427–36.CrossRefPubMed
11.
12.
13.
14.
15.
Poisot T. The digitize package: extracting numerical data from scatterplots. R J. 2011;3:25–6.
16.
Parmar MK, Torri V, Stewart L. Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. Stat Med. 1998;17:2815–34.CrossRefPubMed
17.
18.
19.
Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21:1539–58.CrossRefPubMed
20.
Combescure C, Foucher Y, Jackson D. Meta-analysis of single-arm survival studies: a distribution-free approach for estimating summary survival curves with random effects. Stat Med. 2014;33:2521–37.CrossRefPubMed
21.
Combescure C, Daures JP, Foucher Y. A literature-based approach to evaluate the predictive capacity of a marker using time-dependent summary receiver operating characteristics. Stat Methods Med Res. 2016;25:674–85.CrossRefPubMed
22.
23.
Foucher Y, Lorent M, Tessier P, Supiot S, Sébille V, Dantan E. A mini-review of quality of life as an outcome in prostate cancer trials: patient-centered approaches are needed to propose appropriate treatments on behalf of patients. Health Qual Life Outcomes. 2018;16:40.CrossRefPubMedCentralPubMed
24.
Dantan E, Foucher Y, Lorent M, Giral M, Tessier P. Optimal threshold estimator of a prognostic marker by maximizing a time-dependent expected utility function for a patient-centered stratified medicine. Stat Methods Med Res. 2018;27:1847–59.CrossRefPubMed
25.
Royston P, Parmar MK. Restricted mean survival time: an alternative to the hazard ratio for the design and analysis of randomized trials with a time-to-event outcome. BMC Med Res Methodol. 2013;13:152.CrossRefPubMedCentralPubMed
26.
Bill-Axelson A, Holmberg L, Filén F, Ruutu M, Garmo H, Busch C, et al. Radical prostatectomy versus watchful waiting in localized prostate cancer: the Scandinavian prostate cancer group-4 randomized trial. J Natl Cancer Inst. 2008;100:1144–54.CrossRefPubMedCentralPubMed
27.
Bolla M, Van Tienhoven G, Warde P, Dubois JB, Mirimanoff R-O, Storme G, et al. External irradiation with or without long-term androgen suppression for prostate cancer with high metastatic risk: 10-year results of an EORTC randomised study. Lancet Oncol. 2010;11:1066–73.CrossRefPubMed
28.
Denham JW, Joseph D, Lamb DS, Spry NA, Duchesne G, Matthews J, et al. Short-term androgen suppression and radiotherapy versus intermediate-term androgen suppression and radiotherapy, with or without zoledronic acid, in men with locally advanced prostate cancer (TROG 03.04 RADAR): an open-label, randomised, phase 3 factorial trial. Lancet Oncol. 2014;15:1076–89.CrossRefPubMed
29.
Horwitz EM, Bae K, Hanks GE, Porter A, Grignon DJ, Brereton HD, et al. Ten-year follow-up of radiation therapy oncology group protocol 92-02: a phase III trial of the duration of elective androgen deprivation in locally advanced prostate cancer. J Clin Oncol Off J Am Soc Clin Oncol. 2008;26:2497–504.CrossRef
30.
Koerber F, Waidelich R, Stollenwerk B, Rogowski W. The cost-utility of open prostatectomy compared with active surveillance in early localised prostate cancer. BMC Health Serv Res. 2014;14:163.CrossRefPubMedCentralPubMed
31.
Hanmer J, Vanness D, Gangnon R, Palta M, Fryback DG. Three methods tested to model SF-6D health utilities for health states involving comorbidity/co-occurring conditions. J Clin Epidemiol. 2010;63:331–41.CrossRefPubMed
32.
Ara R, Brazier J. Estimating health state utility values for comorbidities. PharmacoEconomics. 2017;35:89–94.CrossRefPubMed
33.
Loeb S, Curnyn C, Walter D, Fagerlin A, Siebert U, Mühlberger N, et al. Health state utilities among contemporary prostate cancer patients on active surveillance. Transl Androl Urol. 2018;7:197–202.CrossRefPubMedCentralPubMed
34.
Krahn MD, Bremner KE, Alibhai SMH, Ni A, Tomlinson G, Laporte A, et al. A reference set of health utilities for long-term survivors of prostate cancer: population-based data from Ontario, Canada. Qual Life Res. 2013;22:2951–62.CrossRefPubMed
35.
Jayadevappa R, Schwartz JS, Chhatre S, Wein AJ, Bruce Malkowicz S. Association between utility and treatment among patients with prostate cancer. Qual Life Res. 2010;19:711–20.CrossRefPubMed
36.
Avila M, Becerra V, Guedea F, Suárez JF, Fernandez P, Macías V, et al. Estimating preferences for treatments in patients with localized prostate Cancer. Int J Radiat Oncol Biol Phys. 2014.
37.
Stewart ST, Lenert L, Bhatnagar V, Kaplan RM. Utilities for prostate cancer health states in men aged 60 and older. Med Care. 2005;43:347–55.CrossRefPubMed
38.
Shimizu H, Horimoto Y, Arakawa A, Sonoue H, Kurata M, Kosaka T, et al. Application of a 70-gene expression profile to Japanese breast Cancer patients. Breast Care Basel Switz. 2015;10:118–22.CrossRef
39.
Cooperberg MR, Freedland SJ, Pasta DJ, Elkin EP, Presti JC, Amling CL, et al. Multiinstitutional validation of the UCSF cancer of the prostate risk assessment for prediction of recurrence after radical prostatectomy. Cancer. 2006;107:2384–91.CrossRefPubMed
40.
Ishizaki F, Hoque MA, Nishiyama T, Kawasaki T, Kasahara T, Hara N, et al. External validation of the UCSF-CAPRA (University of California, san Francisco, Cancer of the prostate risk assessment) in Japanese patients receiving radical prostatectomy. Jpn J Clin Oncol. 2011;41:1259–64.CrossRefPubMed
41.
Loeb S, Carvalhal GF, Kan D, Desai A, Catalona WJ. External validation of the cancer of the prostate risk assessment (CAPRA) score in a single-surgeon radical prostatectomy series. Urol Oncol. 2012;30:584–9.CrossRefPubMed
42.
May M, Knoll N, Siegsmund M, Fahlenkamp D, Vogler H, Hoschke B, et al. Validity of the CAPRA score to predict biochemical recurrence-free survival after radical prostatectomy. Results from a european multicenter survey of 1,296 patients. J Urol. 2007;178:1957–62 discussion 1962.CrossRefPubMed
43.
Zhao KH, Hernandez DJ, Han M, Humphreys EB, Mangold LA, Partin AW. External validation of University of California, san Francisco, Cancer of the prostate risk assessment score. Urology. 2008;72:396–400.CrossRefPubMed
44.
Budaus L, Isbarn H, Tennstedt P, Salomon G, Schlomm T, Steuber T, et al. Risk assessment of metastatic recurrence in patients with prostate cancer by using the Cancer of the prostate risk assessment score: results from 2937 European patients. BJU Int. 2012;110:1714–20.CrossRefPubMed
45.
Seo WI, Kang PM, Chung JI. Predictive value of the cancer of the prostate risk assessment score for recurrence-free survival after radical prostatectomy in Korea: a single-surgeon series. Korean J Urol. 2014;55:321–6.CrossRefPubMedCentralPubMed
46.
Yoshida T. Editorial comment to Japan Cancer of the prostate risk assessment for combined androgen blockade including bicalutamide: clinical application and validation. Int J Urol Off J Jpn Urol Assoc. 2013;20:714–5.
47.
Tamblyn DJ, Chopra S, Yu C, Kattan MW, Pinnock C, Kopsaftis T. Comparative analysis of three risk assessment tools in Australian patients with prostate cancer. BJU Int. 2011;108(Suppl 2):51–6.CrossRefPubMed
48.
Lughezzani G, Lazzeri M, Larcher A, Lista G, Scattoni V, Cestari A, et al. Development and internal validation of a prostate health index based nomogram for predicting prostate cancer at extended biopsy. J Urol. 2012;188:1144–50.CrossRefPubMed
49.
50.
51.
Klotz L, Emberton M. Management of low risk prostate cancer-active surveillance and focal therapy. Nat Rev Clin Oncol. 2014;11:324–34.CrossRefPubMed
52.
Donovan JL, Hamdy FC, Lane JA, Mason M, Metcalfe C, Walsh E, et al. Patient-reported outcomes after monitoring, surgery, or Radiotherapy for Prostate Cancer. N Engl J Med. 2016.
53.
Hamdy FC, Donovan JL, Lane JA, Mason M, Metcalfe C, Holding P, et al. 10-year outcomes after monitoring, surgery, or radiotherapy for localized prostate Cancer. N Engl J Med. 2016;375:1415–24.CrossRefPubMed
54.
Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Mak Int J Soc Med Decis Mak. 2006;26:565–74.CrossRef
55.
Traeger AC, Hübscher M, McAuley JH. Understanding the usefulness of prognostic models in clinical decision-making. J Physiother. 2017;63:121–5.CrossRefPubMed
56.
Montgomery AA, Fahey T. How do patients’ treatment preferences compare with those of clinicians? Qual Health Care QHC. 2001;10(Suppl 1):i39–43.CrossRefPubMed
57.
Tentori K, Pighin S, Divan C, Crupi V. Mind the gap: physicians’ assessment of patients’ importance weights in localized prostate cancer. PLoS One. 2018;13:e0200780.CrossRefPubMedCentralPubMed
58.
59.
Cooperberg MR, Hilton JF, Carroll PR. The CAPRA-S score: a straightforward tool for improved prediction of outcomes after radical prostatectomy. Cancer. 2011;117:5039–46.CrossRefPubMed
60.
Metadata
Title
Meta-analysis of predictive models to assess the clinical validity and utility for patient-centered medical decision making: application to the CAncer of the Prostate Risk Assessment (CAPRA)
Authors
Marine Lorent
Haïfa Maalmi
Philippe Tessier
Stéphane Supiot
Etienne Dantan
Yohann Foucher
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2019
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-018-0727-2

Other articles of this Issue 1/2019

BMC Medical Informatics and Decision Making 1/2019 Go to the issue

Research article

The index lift in data mining has a close relationship with the association measure relative risk in epidemiological studies

Research article

Detection of probable dementia cases in undiagnosed patients using structured and unstructured electronic health records

Research article

Patterns of drinking in Aboriginal and Torres Strait Islander peoples as self-reported on the Grog Survey App: a stratified sample

Research article

Modelling cancer outcomes of bone metastatic patients: combining survival data with N-Telopeptide of type I collagen (NTX) dynamics through joint models

Research article

Predicting factors for survival of breast cancer patients using machine learning techniques

Research article

The implementation of natural language processing to extract index lesions from breast magnetic resonance imaging reports