Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2020

01-12-2020 | Prostate Cancer | Research article

A scoping review of core outcome sets and their ‘mapping’ onto real-world data using prostate cancer as a case study

Authors: Michela Meregaglia, Oriana Ciani, Helen Banks, Maximilian Salcher-Konrad, Caroline Carney, Sahan Jayawardana, Paula Williamson, Giovanni Fattore

Published in: BMC Medical Research Methodology | Issue 1/2020

Login to get access

Abstract

Background

A Core Outcomes Set (COS) is an agreed minimum set of outcomes that should be reported in all clinical studies related to a specific condition. Using prostate cancer as a case study, we identified, summarized, and critically appraised published COS development studies and assessed the degree of overlap between them and selected real-world data (RWD) sources.

Methods

We conducted a scoping review of the Core Outcome Measures in Effectiveness Trials (COMET) Initiative database to identify all COS studies developed for prostate cancer. Several characteristics (i.e., study type, methods for consensus, type of participants, outcomes included in COS and corresponding measurement instruments, timing, and sources) were extracted from the studies; outcomes were classified according to a predefined 38-item taxonomy. The study methodology was assessed based on the recent COS-STAndards for Development (COS-STAD) recommendations. A ‘mapping’ exercise was conducted between the COS identified and RWD routinely collected in selected European countries.

Results

Eleven COS development studies published between 1995 and 2017 were retrieved, of which 8 were classified as ‘COS for clinical trials and clinical research’, 2 as ‘COS for practice’ and 1 as ‘COS patient reported outcomes’. Recommended outcomes were mainly categorized into ‘mortality and survival’ (17%), ‘outcomes related to neoplasm’ (18%), and ‘renal and urinary outcomes’ (13%) with no relevant differences among COS study types. The studies generally fulfilled the criteria for the COS-STAD ‘scope specification’ domain but not the ‘stakeholders involved’ and ‘consensus process’ domains. About 72% overlap existed between COS and linked administrative data sources, with important gaps. Linking with patient registries improved coverage (85%), but was sometimes limited to smaller follow-up patient groups.

Conclusions

This scoping review identified few COS development studies in prostate cancer, some quite dated and with a growing level of methodological quality over time. This study revealed promising overlap between COS and RWD sources, though with important limitations; linking established, national patient registries to administrative data provide the best means to additionally capture patient-reported and some clinical outcomes over time. Thus, increasing the combination of different data sources and the interoperability of systems to follow larger patient groups in RWD is required.
Appendix
Available only for authorised users
Literature
1.
go back to reference Cave A, Kurz X, Arlett P. Real-world data for regulatory decision making: challenges and possible solutions for Europe. Clin Pharmacol Ther. 2019;106(1):36–9.PubMedPubMedCentralCrossRef Cave A, Kurz X, Arlett P. Real-world data for regulatory decision making: challenges and possible solutions for Europe. Clin Pharmacol Ther. 2019;106(1):36–9.PubMedPubMedCentralCrossRef
3.
go back to reference Franklin JM, Schneeweiss S. When and how can real world data analyses substitute for randomized controlled trials? Clin Pharmacol Ther. 2017;102(6):924–33.CrossRefPubMed Franklin JM, Schneeweiss S. When and how can real world data analyses substitute for randomized controlled trials? Clin Pharmacol Ther. 2017;102(6):924–33.CrossRefPubMed
7.
go back to reference Kirkham JJ, Davis K, Altman DG, Blazeby JM, Clarke M, Tunis S, et al. Core outcome set-STAndards for development: the COS-STAD recommendations. PLoS Med. 2018;14(11):e1002447.CrossRef Kirkham JJ, Davis K, Altman DG, Blazeby JM, Clarke M, Tunis S, et al. Core outcome set-STAndards for development: the COS-STAD recommendations. PLoS Med. 2018;14(11):e1002447.CrossRef
8.
10.
go back to reference Eton DT, Beebe TJ, Hagen PT, Halyard MY, Montori VM, Naessens JM, et al. Harmonizing and consolidating the measurement of patient-reported information at health care institutions: a position statement of the Mayo Clinic. Patient Relat Outcome Meas. 2014;5:7–15.PubMedPubMedCentralCrossRef Eton DT, Beebe TJ, Hagen PT, Halyard MY, Montori VM, Naessens JM, et al. Harmonizing and consolidating the measurement of patient-reported information at health care institutions: a position statement of the Mayo Clinic. Patient Relat Outcome Meas. 2014;5:7–15.PubMedPubMedCentralCrossRef
12.
go back to reference Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–73.PubMedCrossRef Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–73.PubMedCrossRef
13.
go back to reference Gargon E, Gurung B, Medley N, Altman DG, Blazeby JM, Clarke M, et al. Choosing important health outcomes for comparative effectiveness research: a systematic review. PLoS One. 2014;9(6):e99111.PubMedPubMedCentralCrossRef Gargon E, Gurung B, Medley N, Altman DG, Blazeby JM, Clarke M, et al. Choosing important health outcomes for comparative effectiveness research: a systematic review. PLoS One. 2014;9(6):e99111.PubMedPubMedCentralCrossRef
14.
go back to reference Gargon E, Gorst SL, Harman NL, Smith V, Matvienko-Sikar K, Williamson PR. Choosing important health outcomes for comparative effectiveness research: 4th annual update to a systematic review of core outcome sets for research. PLoS One. 2018;13(12):e0209869.PubMedPubMedCentralCrossRef Gargon E, Gorst SL, Harman NL, Smith V, Matvienko-Sikar K, Williamson PR. Choosing important health outcomes for comparative effectiveness research: 4th annual update to a systematic review of core outcome sets for research. PLoS One. 2018;13(12):e0209869.PubMedPubMedCentralCrossRef
17.
go back to reference Gandaglia G, Bray F, Cooperberg MR, Karnes RJ, Leveridge MJ, Moretti K, et al. Prostate Cancer registries: current status and future directions. Eur Urol. 2016;69(6):998–1012.PubMedCrossRef Gandaglia G, Bray F, Cooperberg MR, Karnes RJ, Leveridge MJ, Moretti K, et al. Prostate Cancer registries: current status and future directions. Eur Urol. 2016;69(6):998–1012.PubMedCrossRef
18.
go back to reference Stattin P, Sandin F, Hellström K, Robinson D, Franck Lissbrant IF. The National Prostate Cancer Register of Sweden. Tijdschr Urol. 2017;7(2–3):50–9.CrossRef Stattin P, Sandin F, Hellström K, Robinson D, Franck Lissbrant IF. The National Prostate Cancer Register of Sweden. Tijdschr Urol. 2017;7(2–3):50–9.CrossRef
19.
go back to reference Van Hemelrijck M, Wigertz A, Sandin F, Garmo H, Hellström K, Fransson P, et al. Cohort profile: the National Prostate Cancer Register of Sweden and prostate Cancer data base Sweden 2.0. Int J Epidemiol. 2013;42(4):956–67.PubMedCrossRef Van Hemelrijck M, Wigertz A, Sandin F, Garmo H, Hellström K, Fransson P, et al. Cohort profile: the National Prostate Cancer Register of Sweden and prostate Cancer data base Sweden 2.0. Int J Epidemiol. 2013;42(4):956–67.PubMedCrossRef
20.
go back to reference Van Hemelrijck M, Garmo H, Wigertz A, Nilsson P, Stattin P. Cohort profile update: the National Prostate Cancer Register of Sweden and prostate Cancer data base--a refined prostate cancer trajectory. Int J Epidemiol. 2016;45(1):73–82.CrossRefPubMed Van Hemelrijck M, Garmo H, Wigertz A, Nilsson P, Stattin P. Cohort profile update: the National Prostate Cancer Register of Sweden and prostate Cancer data base--a refined prostate cancer trajectory. Int J Epidemiol. 2016;45(1):73–82.CrossRefPubMed
21.
go back to reference Auvinen A, Rietbergen JBW, Denis LJ, Schroder FH, Prorok PC for the International Prostate Cancer Screening Trial Evaluation Group. Prospective evaluation plan for randomized trials of prostate cancer screening. J Med Screen. 1996;3:97–104.CrossRefPubMed Auvinen A, Rietbergen JBW, Denis LJ, Schroder FH, Prorok PC for the International Prostate Cancer Screening Trial Evaluation Group. Prospective evaluation plan for randomized trials of prostate cancer screening. J Med Screen. 1996;3:97–104.CrossRefPubMed
23.
go back to reference Dawson NA. Apples and oranges: building a consensus for standardized eligibility criteria and endpoints in prostate cancer clinical trials. J Clin Oncol. 1998;16:3398–405.CrossRefPubMed Dawson NA. Apples and oranges: building a consensus for standardized eligibility criteria and endpoints in prostate cancer clinical trials. J Clin Oncol. 1998;16:3398–405.CrossRefPubMed
24.
go back to reference Denis L, Norlen BJ, Holmberg L, Begg CB, Damber JE, Wilt TJ. Planning controlled clinical trials. Urology. 1997;49(Suppl 4A):15–26.CrossRefPubMed Denis L, Norlen BJ, Holmberg L, Begg CB, Damber JE, Wilt TJ. Planning controlled clinical trials. Urology. 1997;49(Suppl 4A):15–26.CrossRefPubMed
26.
go back to reference Martin NE, Massey L, Stowell C, Bangma C, Briganti A, Bill-Axelson A, et al. Defining a standard set of patient-Centred outcomes for men with localized prostate Cancer. Eur Urol. 2015;67:460–7.CrossRefPubMed Martin NE, Massey L, Stowell C, Bangma C, Briganti A, Bill-Axelson A, et al. Defining a standard set of patient-Centred outcomes for men with localized prostate Cancer. Eur Urol. 2015;67:460–7.CrossRefPubMed
27.
go back to reference Middleton RG, Thompson IM, Austenfeld MS, Cooner WH, Correa RJ, Gibbons RP, et al. Prostate Cancer clinical guidelines panel summary report on the Management of Clinically Localized Prostate Cancer. J Urol. 1995;154:2144–8.CrossRefPubMed Middleton RG, Thompson IM, Austenfeld MS, Cooner WH, Correa RJ, Gibbons RP, et al. Prostate Cancer clinical guidelines panel summary report on the Management of Clinically Localized Prostate Cancer. J Urol. 1995;154:2144–8.CrossRefPubMed
28.
go back to reference Morgans AK, van Bommel ACM, Stowell C, Abrahm JL, Basch E, Bekelman JE, et al. Development of a standardized set of patient-Centred outcomes for advanced prostate Cancer: an international effort for a unified approach. Eur Urol. 2015;68:891–8.CrossRefPubMed Morgans AK, van Bommel ACM, Stowell C, Abrahm JL, Basch E, Bekelman JE, et al. Development of a standardized set of patient-Centred outcomes for advanced prostate Cancer: an international effort for a unified approach. Eur Urol. 2015;68:891–8.CrossRefPubMed
29.
go back to reference Schellhammer P, Cockett A, Boccon-Gibod L, Gospodarowicz M, Krongrad A, Murchie Thomson I, et al. Assessment of endpoints for clinical trials for localized prostate cancer. Urology. 1997;49(Suppl A):27–38.CrossRefPubMed Schellhammer P, Cockett A, Boccon-Gibod L, Gospodarowicz M, Krongrad A, Murchie Thomson I, et al. Assessment of endpoints for clinical trials for localized prostate cancer. Urology. 1997;49(Suppl A):27–38.CrossRefPubMed
30.
go back to reference Van den Bos W, Muller BG, Ahmed H, Bangma CH, Barret E, Crouzet S, et al. Focal therapy in prostate Cancer: international multidisciplinary consensus on trial design. Eur Urol. 2014;65:1078–83.CrossRefPubMed Van den Bos W, Muller BG, Ahmed H, Bangma CH, Barret E, Crouzet S, et al. Focal therapy in prostate Cancer: international multidisciplinary consensus on trial design. Eur Urol. 2014;65:1078–83.CrossRefPubMed
31.
go back to reference Van den Bos W, Muller BG, de Bruin DM, de Castro Abreu AL, Chaussy C, Coleman JA, et al. Salvage ablative therapy in prostate cancer: International multidisciplinary consensus on trial design. Urol Oncol. 2015;33(11):495.e1–7.CrossRef Van den Bos W, Muller BG, de Bruin DM, de Castro Abreu AL, Chaussy C, Coleman JA, et al. Salvage ablative therapy in prostate cancer: International multidisciplinary consensus on trial design. Urol Oncol. 2015;33(11):495.e1–7.CrossRef
32.
go back to reference Ciani O, Buyse M, Drummond M, Rasi G, Saad ED, Taylor RS. Time to review the role of surrogate end points in health policy: state of the art and the way forward. Value Health. 2017;20(3):487–95.CrossRefPubMed Ciani O, Buyse M, Drummond M, Rasi G, Saad ED, Taylor RS. Time to review the role of surrogate end points in health policy: state of the art and the way forward. Value Health. 2017;20(3):487–95.CrossRefPubMed
33.
go back to reference Kirkham JJ, Gorst S, Altman DG, Blazeby JM, Clarke M, Devane D, et al. Core outcome set–STAndards for reporting: the COS-STAR statement. PLoS Med. 2016;13(10):e1002148.PubMedPubMedCentralCrossRef Kirkham JJ, Gorst S, Altman DG, Blazeby JM, Clarke M, Devane D, et al. Core outcome set–STAndards for reporting: the COS-STAR statement. PLoS Med. 2016;13(10):e1002148.PubMedPubMedCentralCrossRef
34.
go back to reference Chamie K, Williams SB, Hu JC. Population-based assessment of determining treatments for prostate Cancer. JAMA Oncol. 2015;1(1):60–7.CrossRefPubMed Chamie K, Williams SB, Hu JC. Population-based assessment of determining treatments for prostate Cancer. JAMA Oncol. 2015;1(1):60–7.CrossRefPubMed
35.
go back to reference Brodszky V, Varga P, Gimesi-Országh J, Fadgyas-Freyler P, Boncz I, Nyirády P, et al. Long-term costs and survival of prostate cancer: a population-based study. Int Urol Nephrol. 2017;49(10):1707–14.CrossRefPubMed Brodszky V, Varga P, Gimesi-Országh J, Fadgyas-Freyler P, Boncz I, Nyirády P, et al. Long-term costs and survival of prostate cancer: a population-based study. Int Urol Nephrol. 2017;49(10):1707–14.CrossRefPubMed
36.
go back to reference Kawai AT, Martinez D, Saltus CW, Vassilev ZP, Soriano-Gabarró M, Kaye JA. Incidence of skeletal-related events in patients with castration-resistant prostate Cancer: an observational retrospective cohort study in the US. Prostate Cancer. 2019;2019:5971615.PubMedPubMedCentralCrossRef Kawai AT, Martinez D, Saltus CW, Vassilev ZP, Soriano-Gabarró M, Kaye JA. Incidence of skeletal-related events in patients with castration-resistant prostate Cancer: an observational retrospective cohort study in the US. Prostate Cancer. 2019;2019:5971615.PubMedPubMedCentralCrossRef
37.
go back to reference Bartlett VL, Dhruva SS, Shah ND, Ryan P, Ross JS. Feasibility of using real-world data to replicate clinical trial evidence. JAMA Netw Open. 2019;2(10):e1912869.PubMedPubMedCentralCrossRef Bartlett VL, Dhruva SS, Shah ND, Ryan P, Ross JS. Feasibility of using real-world data to replicate clinical trial evidence. JAMA Netw Open. 2019;2(10):e1912869.PubMedPubMedCentralCrossRef
39.
go back to reference Häkkinen U, Iversen T, Peltola M, Seppälä TT, Malmivaara A, Belicza É, et al. Health care performance comparison using a disease-based approach: the EuroHOPE project. Health Policy. 2013;112(1–2):100–9.PubMedCrossRef Häkkinen U, Iversen T, Peltola M, Seppälä TT, Malmivaara A, Belicza É, et al. Health care performance comparison using a disease-based approach: the EuroHOPE project. Health Policy. 2013;112(1–2):100–9.PubMedCrossRef
41.
go back to reference Williams LJ, Fletcher E, Douglas A, Anderson EDC, McCallum A, Simpson CR, et al. Retrospective cohort study of breast cancer incidence, health service use and outcomes in Europe: a study of feasibility. Eur J Pub Health. 2018;28(2):327–32.CrossRef Williams LJ, Fletcher E, Douglas A, Anderson EDC, McCallum A, Simpson CR, et al. Retrospective cohort study of breast cancer incidence, health service use and outcomes in Europe: a study of feasibility. Eur J Pub Health. 2018;28(2):327–32.CrossRef
42.
go back to reference Aksnessæther BY, Lund JÅ, Myklebust TÅ, Klepp OH, Skovlund E, Roth Hoff S, et al. Second cancers in radically treated Norwegian prostate cancer patients. Acta Oncol. 2019;58(6):838–44.CrossRefPubMed Aksnessæther BY, Lund JÅ, Myklebust TÅ, Klepp OH, Skovlund E, Roth Hoff S, et al. Second cancers in radically treated Norwegian prostate cancer patients. Acta Oncol. 2019;58(6):838–44.CrossRefPubMed
43.
go back to reference Reeve BB, Stover AM, Jensen RE, Chen RC, Taylor KL, Clauser SB, et al. Impact of diagnosis and treatment of clinically localized prostate cancer on health-related quality of life for older Americans: a population-based study. Cancer. 2012;118(22):5679–87.PubMedCrossRef Reeve BB, Stover AM, Jensen RE, Chen RC, Taylor KL, Clauser SB, et al. Impact of diagnosis and treatment of clinically localized prostate cancer on health-related quality of life for older Americans: a population-based study. Cancer. 2012;118(22):5679–87.PubMedCrossRef
44.
go back to reference Mues KE, Liede A, Liu J, Wetmore JB, Zaha R, Bradbury BD, et al. Use of the Medicare database in epidemiologic and health services research: a valuable source of real-world evidence on the older and disabled populations in the US. Clin Epidemiol. 2017;9:267–77.PubMedPubMedCentralCrossRef Mues KE, Liede A, Liu J, Wetmore JB, Zaha R, Bradbury BD, et al. Use of the Medicare database in epidemiologic and health services research: a valuable source of real-world evidence on the older and disabled populations in the US. Clin Epidemiol. 2017;9:267–77.PubMedPubMedCentralCrossRef
45.
go back to reference Dean BB, Lam J, Natoli JL, Butler Q, Aguilar D, Nordyke RJ. Review: use of electronic medical Records for Health Outcomes Research: a literature review. Med Care Res Rev. 2009;66(6):611–38.CrossRefPubMed Dean BB, Lam J, Natoli JL, Butler Q, Aguilar D, Nordyke RJ. Review: use of electronic medical Records for Health Outcomes Research: a literature review. Med Care Res Rev. 2009;66(6):611–38.CrossRefPubMed
46.
go back to reference Hernandez-Boussard T, Kourdis PD, Seto T, Ferrari M, Blayney DW, Rubin D, et al. Mining electronic health records to extract patient-centered outcomes following prostate Cancer treatment. AMIA Annu Symp Proc. 2017;2018:876–82. Hernandez-Boussard T, Kourdis PD, Seto T, Ferrari M, Blayney DW, Rubin D, et al. Mining electronic health records to extract patient-centered outcomes following prostate Cancer treatment. AMIA Annu Symp Proc. 2017;2018:876–82.
47.
go back to reference Seneviratne MG, Seto T, Blayney DW, Brooks JD, Hernandez-Boussard T. Architecture and Implementation of a Clinical Research Data Warehouse for Prostate Cancer. EGEMS (Wash DC). 2018;6(1):13. Seneviratne MG, Seto T, Blayney DW, Brooks JD, Hernandez-Boussard T. Architecture and Implementation of a Clinical Research Data Warehouse for Prostate Cancer. EGEMS (Wash DC). 2018;6(1):13.
48.
go back to reference Nouraei SA, Virk JS, Hudovsky A, Wathen C, Darzi A, Parsons D. Accuracy of clinician-clinical coder information handover following acute medical admissions: implication for using administrative datasets in clinical outcomes management. J Public Health (Oxf). 2016;38(2):352–62.CrossRef Nouraei SA, Virk JS, Hudovsky A, Wathen C, Darzi A, Parsons D. Accuracy of clinician-clinical coder information handover following acute medical admissions: implication for using administrative datasets in clinical outcomes management. J Public Health (Oxf). 2016;38(2):352–62.CrossRef
49.
go back to reference Kirkham JJ, Clarke M, Williamson PR. A methodological approach for assessing the uptake of core outcome sets using ClinicalTrials.gov: findings from a review of randomised controlled trials of rheumatoid arthritis. BMJ. 2017;357:j2262.PubMedPubMedCentralCrossRef Kirkham JJ, Clarke M, Williamson PR. A methodological approach for assessing the uptake of core outcome sets using ClinicalTrials.gov: findings from a review of randomised controlled trials of rheumatoid arthritis. BMJ. 2017;357:j2262.PubMedPubMedCentralCrossRef
51.
go back to reference Moloney RM, Messner DA, Tunis SR. The increasing complexity of the core outcomes landscape. J Clin Epidemiol. 2019;116:150–4.CrossRefPubMed Moloney RM, Messner DA, Tunis SR. The increasing complexity of the core outcomes landscape. J Clin Epidemiol. 2019;116:150–4.CrossRefPubMed
52.
go back to reference Singh K, Drouin K, Newmark LP, Lee J, Faxvaag A, Rozenblum R, et al. Many Mobile health apps target high-need, high-cost populations, but gaps remain. Health Aff (Millwood). 2016;35(12):2310–8.CrossRef Singh K, Drouin K, Newmark LP, Lee J, Faxvaag A, Rozenblum R, et al. Many Mobile health apps target high-need, high-cost populations, but gaps remain. Health Aff (Millwood). 2016;35(12):2310–8.CrossRef
53.
go back to reference Ciani O, Federici CB. Value Lies in the Eye of the Patients: The Why, What, and How of Patient-Reported Outcomes Measures. Clin Ther. 2020;42(1):25–33.CrossRefPubMed Ciani O, Federici CB. Value Lies in the Eye of the Patients: The Why, What, and How of Patient-Reported Outcomes Measures. Clin Ther. 2020;42(1):25–33.CrossRefPubMed
Metadata
Title
A scoping review of core outcome sets and their ‘mapping’ onto real-world data using prostate cancer as a case study
Authors
Michela Meregaglia
Oriana Ciani
Helen Banks
Maximilian Salcher-Konrad
Caroline Carney
Sahan Jayawardana
Paula Williamson
Giovanni Fattore
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2020
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-020-00928-w

Other articles of this Issue 1/2020

BMC Medical Research Methodology 1/2020 Go to the issue