Skip to main content
Top
Published in: Trials 1/2022

Open Access 01-12-2022 | Commentary

Sharing individual participant data: through a systematic reviewer lens

Authors: Larysa H. M. Rydzewska, Lesley A. Stewart, Jayne F. Tierney

Published in: Trials | Issue 1/2022

Login to get access

Abstract

An increasing prevalence of data-sharing models, aimed at making individual participant data (IPD) from clinical trials widely available, should facilitate the conduct of systematic reviews and meta-analyses based on IPD. We have assessed these different data-sharing approaches, from the perspective of experienced IPD reviewers, to examine their utility for conducting systematic reviews based on IPD, and to highlight any challenges. We present an overview of the range of different models, including the traditional, single question approach, topic-based repositories, and the newer generic data platforms, and show that there are benefits and drawbacks to each. In particular, not all of the new models allow researchers to fully realise the well-documented advantages of using IPD for meta-analysis, and we offer potential solutions that can help improve both data quantity and utility. However, to achieve the “nirvana” of an ideal clinical data sharing environment, both for IPD meta-analysis and other secondary research purposes, we propose that data providers, data requestors, funders, and platforms need to adopt a more joined-up and standardised approach.
Literature
1.
go back to reference Nevitt SJ, Marson AG, Davie B, Reynolds S, Williams L, Smith CT. Exploring changes over time and characteristics associated with data retrieval across individual participant data meta-analyses: systematic review. BMJ. 2017;357:j1390.PubMedPubMedCentralCrossRef Nevitt SJ, Marson AG, Davie B, Reynolds S, Williams L, Smith CT. Exploring changes over time and characteristics associated with data retrieval across individual participant data meta-analyses: systematic review. BMJ. 2017;357:j1390.PubMedPubMedCentralCrossRef
2.
go back to reference Chalmers I. The Cochrane Collaboration: preparing, maintaining and disseminating systematic reviews of the effects of health care. Ann N Y Acad Sci. 1993;703:156–65.PubMedCrossRef Chalmers I. The Cochrane Collaboration: preparing, maintaining and disseminating systematic reviews of the effects of health care. Ann N Y Acad Sci. 1993;703:156–65.PubMedCrossRef
3.
go back to reference Stewart LA, Clarke MJ. on behalf of the Cochrane Working Party Group on Meta-analysis using Individual Patient Data. Practical methodology of meta-analyses (overviews) using updated individual patient data. Stat Med. 1995;14:2057–79.PubMedCrossRef Stewart LA, Clarke MJ. on behalf of the Cochrane Working Party Group on Meta-analysis using Individual Patient Data. Practical methodology of meta-analyses (overviews) using updated individual patient data. Stat Med. 1995;14:2057–79.PubMedCrossRef
4.
go back to reference Stewart LA, Tierney JF. To IPD or Not to IPD? Advantages and disadvantages of systematic reviews using individual patient data. Eval Health Prof. 2002;25(1):76–97.PubMedCrossRef Stewart LA, Tierney JF. To IPD or Not to IPD? Advantages and disadvantages of systematic reviews using individual patient data. Eval Health Prof. 2002;25(1):76–97.PubMedCrossRef
5.
go back to reference Tierney JF, Vale CL, Riley R, Tudur Smith C, Stewart LA, Clarke M, et al. Individual participant data (IPD) meta-analyses of randomised controlled trials: Guidance on their use. PLoS Med. 2015;12(7):e1001855.PubMedPubMedCentralCrossRef Tierney JF, Vale CL, Riley R, Tudur Smith C, Stewart LA, Clarke M, et al. Individual participant data (IPD) meta-analyses of randomised controlled trials: Guidance on their use. PLoS Med. 2015;12(7):e1001855.PubMedPubMedCentralCrossRef
6.
go back to reference Tierney JF, Riley RD, Tudur-Smith C, Clarke M, Stewart LA. Rationale for embarking on an IPD meta-analysis project. In Individual participant data meta-analysis: A handbook for healthcare research. 1st. Edited by Riley RD, Tierney JF, Stewart LA. Wiley; 2021: 9-19. Tierney JF, Riley RD, Tudur-Smith C, Clarke M, Stewart LA. Rationale for embarking on an IPD meta-analysis project. In Individual participant data meta-analysis: A handbook for healthcare research. 1st. Edited by Riley RD, Tierney JF, Stewart LA. Wiley; 2021: 9-19.
7.
go back to reference Early Breast Cancer Trialists Collaborative Group. Effects of adjuvant tamoxifen and of cytotoxic therapy on mortality in early breast cancer. N Engl J Med. 1988;319(26):1681–92.CrossRef Early Breast Cancer Trialists Collaborative Group. Effects of adjuvant tamoxifen and of cytotoxic therapy on mortality in early breast cancer. N Engl J Med. 1988;319(26):1681–92.CrossRef
8.
go back to reference Non-small Cell Lung Cancer Collaborative Group. Chemotherapy in non-small cell lung cancer: a meta-analysis using updated data on individual patients from 52 randomised clinical trials. BMJ. 1995;311:899–909.CrossRef Non-small Cell Lung Cancer Collaborative Group. Chemotherapy in non-small cell lung cancer: a meta-analysis using updated data on individual patients from 52 randomised clinical trials. BMJ. 1995;311:899–909.CrossRef
9.
go back to reference Stewart LA, Riley RD, Tierney JF. Planning and initiating an IPD meta-analysis project. Individual participant data meta-analysis: A handbook for healthcare research. 1st. Riley RD, Tierney JF, Stewart LA. Wiley; 2021: 21-43.CrossRef Stewart LA, Riley RD, Tierney JF. Planning and initiating an IPD meta-analysis project. Individual participant data meta-analysis: A handbook for healthcare research. 1st. Riley RD, Tierney JF, Stewart LA. Wiley; 2021: 21-43.CrossRef
10.
go back to reference Tierney JF, Riley RD, Rydzewska LHM, Stewart LA. Running an IPD meta-analysis project: From developing the protocol to preparing data for meta-analysis. In: Riley RD, Tierney JF, Stewart LA, editors. Individual participant data meta-analysis: A handbook for healthcare research. 1st ed: Wiley; 2021. p. 45–80.CrossRef Tierney JF, Riley RD, Rydzewska LHM, Stewart LA. Running an IPD meta-analysis project: From developing the protocol to preparing data for meta-analysis. In: Riley RD, Tierney JF, Stewart LA, editors. Individual participant data meta-analysis: A handbook for healthcare research. 1st ed: Wiley; 2021. p. 45–80.CrossRef
11.
go back to reference Kawahara T, Fukuda M, Oba K, Sakamoto J, Buyse M. Meta-analysis of randomized clinical trials in the era of individual patient data sharing. Int J Clin Oncol. 2018;23(3):403–9.PubMedPubMedCentralCrossRef Kawahara T, Fukuda M, Oba K, Sakamoto J, Buyse M. Meta-analysis of randomized clinical trials in the era of individual patient data sharing. Int J Clin Oncol. 2018;23(3):403–9.PubMedPubMedCentralCrossRef
12.
go back to reference Early Breast Cancer Trialists' Collaborative Group. Polychemotherapy for early breast cancer: an overview of the randomised trials. Lancet. 1998;352:930–42.CrossRef Early Breast Cancer Trialists' Collaborative Group. Polychemotherapy for early breast cancer: an overview of the randomised trials. Lancet. 1998;352:930–42.CrossRef
13.
go back to reference Early Breast Cancer Trialists Collaborative Group. Effects of radiotherapy and surgery in early breast cancer. An overview of the randomized trials. N Engl J Med. 1995;333(22):1444–55.CrossRef Early Breast Cancer Trialists Collaborative Group. Effects of radiotherapy and surgery in early breast cancer. An overview of the randomized trials. N Engl J Med. 1995;333(22):1444–55.CrossRef
14.
15.
go back to reference Early Breast Cancer Trialists' Collaborative Group, Correa C, McGale P, Taylor C, Wang Y, Clarke M, et al. Overview of the randomized trials of radiotherapy in ductal carcinoma in situ of the breast. J Natl Cancer Inst Monogr. 2010;2010(41):162–77.CrossRef Early Breast Cancer Trialists' Collaborative Group, Correa C, McGale P, Taylor C, Wang Y, Clarke M, et al. Overview of the randomized trials of radiotherapy in ductal carcinoma in situ of the breast. J Natl Cancer Inst Monogr. 2010;2010(41):162–77.CrossRef
16.
go back to reference Sargent D, Sobrero A, Grothey A, O'Connell MJ, Buyse M, Andre T, et al. Evidence for cure by adjuvant therapy in colon cancer: observations based on individual patient data from 20,898 patients on 18 randomized trials. J Clin Oncol. 2009;27(6):872–7.PubMedPubMedCentralCrossRef Sargent D, Sobrero A, Grothey A, O'Connell MJ, Buyse M, Andre T, et al. Evidence for cure by adjuvant therapy in colon cancer: observations based on individual patient data from 20,898 patients on 18 randomized trials. J Clin Oncol. 2009;27(6):872–7.PubMedPubMedCentralCrossRef
17.
go back to reference Early Breast Cancer Trialists' Collaborative Group, Davies C, Godwin J, Gray R, Clarke M, Cutter D, et al. Relevance of breast cancer hormone receptors and other factors to the efficacy of adjuvant tamoxifen: patient-level meta-analysis of randomised trials. Lancet. 2011;378(9793):771–84.CrossRef Early Breast Cancer Trialists' Collaborative Group, Davies C, Godwin J, Gray R, Clarke M, Cutter D, et al. Relevance of breast cancer hormone receptors and other factors to the efficacy of adjuvant tamoxifen: patient-level meta-analysis of randomised trials. Lancet. 2011;378(9793):771–84.CrossRef
18.
go back to reference Sinicrope FA, Foster NR, Yothers G, Benson A, Seitz JF, Labianca R, et al. Body mass index at diagnosis and survival among colon cancer patients enrolled in clinical trials of adjuvant chemotherapy. Cancer. 2013;119(8):1528–36.PubMedCrossRef Sinicrope FA, Foster NR, Yothers G, Benson A, Seitz JF, Labianca R, et al. Body mass index at diagnosis and survival among colon cancer patients enrolled in clinical trials of adjuvant chemotherapy. Cancer. 2013;119(8):1528–36.PubMedCrossRef
19.
go back to reference Sargent DJ, Wieand HS, Haller DG, Gray R, Benedetti JK, Buyse M, et al. Disease-free survival versus overall survival as a primary end point for adjuvant colon cancer studies: individual patient data from 20,898 patients on 18 randomized trials. J Clin Oncol. 2005;23(34):8664–70.PubMedCrossRef Sargent DJ, Wieand HS, Haller DG, Gray R, Benedetti JK, Buyse M, et al. Disease-free survival versus overall survival as a primary end point for adjuvant colon cancer studies: individual patient data from 20,898 patients on 18 randomized trials. J Clin Oncol. 2005;23(34):8664–70.PubMedCrossRef
20.
go back to reference Xie W, Regan MM, Buyse M, Halabi S, Kantoff PW, Sartor O, et al. Metastasis-free survival is a strong surrogate of overall survival in localized prostate cancer. J Clin Oncol. 2017;35(27):3097–104.PubMedPubMedCentralCrossRef Xie W, Regan MM, Buyse M, Halabi S, Kantoff PW, Sartor O, et al. Metastasis-free survival is a strong surrogate of overall survival in localized prostate cancer. J Clin Oncol. 2017;35(27):3097–104.PubMedPubMedCentralCrossRef
21.
go back to reference Buyse M, Sargent DJ, Goldberg RM, de Gramont A, ARCAD Clinical Trials Program. The ARCAD advanced colorectal cancer database--open for business. Ann Oncol. 2012;23(1):281–2.PubMedCrossRef Buyse M, Sargent DJ, Goldberg RM, de Gramont A, ARCAD Clinical Trials Program. The ARCAD advanced colorectal cancer database--open for business. Ann Oncol. 2012;23(1):281–2.PubMedCrossRef
22.
go back to reference Shi Q, de Gramont A, Grothey A, Zalcberg J, Chibaudel B, Schmoll HJ, et al. Individual patient data analysis of progression-free survival versus overall survival as a first-line end point for metastatic colorectal cancer in modern randomized trials: findings from the analysis and research in cancers of the digestive system database. J Clin Oncol. 2015;33(1):22–8.PubMedCrossRef Shi Q, de Gramont A, Grothey A, Zalcberg J, Chibaudel B, Schmoll HJ, et al. Individual patient data analysis of progression-free survival versus overall survival as a first-line end point for metastatic colorectal cancer in modern randomized trials: findings from the analysis and research in cancers of the digestive system database. J Clin Oncol. 2015;33(1):22–8.PubMedCrossRef
23.
go back to reference van Rooijen KL, Shi Q, Goey KKH, Meyers J, Heinemann V, Diaz-Rubio E, et al. Prognostic value of primary tumour resection in synchronous metastatic colorectal cancer: Individual patient data analysis of first-line randomised trials from the ARCAD database. Eur J Cancer. 2018;91:99–106.PubMedCrossRef van Rooijen KL, Shi Q, Goey KKH, Meyers J, Heinemann V, Diaz-Rubio E, et al. Prognostic value of primary tumour resection in synchronous metastatic colorectal cancer: Individual patient data analysis of first-line randomised trials from the ARCAD database. Eur J Cancer. 2018;91:99–106.PubMedCrossRef
24.
go back to reference Tierney JF, Vale CL, Parelukar WR, Rydzewska L, Halabi S. Evidence synthesis to accelerate and improve the evaluation of therapies for metastatic hormone-sensitive prostate cancer. Eur Urol Focus. 2019;5(2):137–43.PubMedCrossRef Tierney JF, Vale CL, Parelukar WR, Rydzewska L, Halabi S. Evidence synthesis to accelerate and improve the evaluation of therapies for metastatic hormone-sensitive prostate cancer. Eur Urol Focus. 2019;5(2):137–43.PubMedCrossRef
25.
go back to reference Tierney JF, Fisher DJ, Vale CL, Burdett S, Rydzewska LH, Rogozińska E, et al. A framework for prospective, adaptive meta-analysis (FAME) of aggregate data from randomised trials. PLoS Med. 2021;18(5):e1003629.PubMedPubMedCentralCrossRef Tierney JF, Fisher DJ, Vale CL, Burdett S, Rydzewska LH, Rogozińska E, et al. A framework for prospective, adaptive meta-analysis (FAME) of aggregate data from randomised trials. PLoS Med. 2021;18(5):e1003629.PubMedPubMedCentralCrossRef
30.
go back to reference Institute of Medicine (IOM). Sharing clinical trial data: Maximizing benefits, minimizing risk. Washington, DC: The National Academies Press; 2015. Institute of Medicine (IOM). Sharing clinical trial data: Maximizing benefits, minimizing risk. Washington, DC: The National Academies Press; 2015.
31.
go back to reference Taichman DB, Sahni P, Pinborg A, Peiperl L, Laine C, James A, et al. Data Sharing Statements for Clinical Trials - A Requirement of the International Committee of Medical Journal Editors. N Engl J Med. 2017;376(23):2277–9.PubMedCrossRef Taichman DB, Sahni P, Pinborg A, Peiperl L, Laine C, James A, et al. Data Sharing Statements for Clinical Trials - A Requirement of the International Committee of Medical Journal Editors. N Engl J Med. 2017;376(23):2277–9.PubMedCrossRef
33.
go back to reference Banzi R, Canham S, Kuchinke W, Krleza-Jeric K, Demotes-Mainard J, Ohmann C. Evaluation of repositories for sharing individual-participant data from clinical studies. Trials. 2019;20(1):169.PubMedPubMedCentralCrossRef Banzi R, Canham S, Kuchinke W, Krleza-Jeric K, Demotes-Mainard J, Ohmann C. Evaluation of repositories for sharing individual-participant data from clinical studies. Trials. 2019;20(1):169.PubMedPubMedCentralCrossRef
35.
go back to reference Gaye A, Marcon Y, Isaeva J, LaFlamme P, Turner A, Jones EM, et al. DataSHIELD: taking the analysis to the data, not the data to the analysis. Int J Epidemiol. 2014;43(6):1929–44.PubMedPubMedCentralCrossRef Gaye A, Marcon Y, Isaeva J, LaFlamme P, Turner A, Jones EM, et al. DataSHIELD: taking the analysis to the data, not the data to the analysis. Int J Epidemiol. 2014;43(6):1929–44.PubMedPubMedCentralCrossRef
37.
go back to reference Strom BL, Buyse ME, Hughes J, Knoppers BM. Data sharing - Is the juice worth the squeeze? N Engl J Med. 2016;375(17):1608–9.PubMedCrossRef Strom BL, Buyse ME, Hughes J, Knoppers BM. Data sharing - Is the juice worth the squeeze? N Engl J Med. 2016;375(17):1608–9.PubMedCrossRef
38.
go back to reference Ross JS, Waldstreicher J, Bamford S, Berlin JA, Childers K, Desai NR, et al. Overview and experience of the YODA Project with clinical trial data sharing after 5 years. Sci Data. 2018;5:180268.PubMedPubMedCentralCrossRef Ross JS, Waldstreicher J, Bamford S, Berlin JA, Childers K, Desai NR, et al. Overview and experience of the YODA Project with clinical trial data sharing after 5 years. Sci Data. 2018;5:180268.PubMedPubMedCentralCrossRef
39.
go back to reference Bierer BE, Li R, Barnes M, Sim I. A Global, Neutral Platform for Sharing Trial Data. N Engl J Med. 2016;374(25):2411–3.PubMedCrossRef Bierer BE, Li R, Barnes M, Sim I. A Global, Neutral Platform for Sharing Trial Data. N Engl J Med. 2016;374(25):2411–3.PubMedCrossRef
40.
go back to reference NSCLC Meta-analysis Collaborative Group. Preoperative chemotherapy for non-small cell lung cancer: a systematic review and meta-analysis of individual participant data. Lancet. 2014;383:1561–71.PubMedCentralCrossRef NSCLC Meta-analysis Collaborative Group. Preoperative chemotherapy for non-small cell lung cancer: a systematic review and meta-analysis of individual participant data. Lancet. 2014;383:1561–71.PubMedCentralCrossRef
41.
go back to reference Askie LM, Duley L, Henderson-Smart D, Stewart LA. on behalf of the PARIS Collaborative Group. Antiplatelet agents for prevention of pre-eclampsia: a meta-analysis of individual patient data. Lancet. 2007;369(9575):1791–8.PubMedCrossRef Askie LM, Duley L, Henderson-Smart D, Stewart LA. on behalf of the PARIS Collaborative Group. Antiplatelet agents for prevention of pre-eclampsia: a meta-analysis of individual patient data. Lancet. 2007;369(9575):1791–8.PubMedCrossRef
42.
go back to reference Sandercock PA, Niewada M, Czlonkowska A, International Stroke Trial Collaborative Group. The International Stroke Trial (IST) database. Trials. 2011;12:101.PubMedPubMedCentralCrossRef Sandercock PA, Niewada M, Czlonkowska A, International Stroke Trial Collaborative Group. The International Stroke Trial (IST) database. Trials. 2011;12:101.PubMedPubMedCentralCrossRef
43.
45.
go back to reference Stewart L, Tierney J, Burdett S. Do systematic reviews based on individual patient data offer a means of circumventing biases associated with trial publications? In Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments. 1st. Edited by Rothstein H, Sutton A, Borenstein M. Chichester: Wiley; 2005: 261-286. Stewart L, Tierney J, Burdett S. Do systematic reviews based on individual patient data offer a means of circumventing biases associated with trial publications? In Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments. 1st. Edited by Rothstein H, Sutton A, Borenstein M. Chichester: Wiley; 2005: 261-286.
46.
go back to reference Vale CL, Tierney JF, Burdett S. Can trial quality be reliably assessed from published reports of cancer trials: evaluation of risk of bias assessments in systematic reviews. BMJ. 2013;346:f1798.PubMedCrossRef Vale CL, Tierney JF, Burdett S. Can trial quality be reliably assessed from published reports of cancer trials: evaluation of risk of bias assessments in systematic reviews. BMJ. 2013;346:f1798.PubMedCrossRef
47.
go back to reference Doshi P, Jefferson T, Del Mar C. The imperative to share clinical study reports: recommendations from the Tamiflu experience. PLoS Med. 2012;9(4):e1001201.PubMedPubMedCentralCrossRef Doshi P, Jefferson T, Del Mar C. The imperative to share clinical study reports: recommendations from the Tamiflu experience. PLoS Med. 2012;9(4):e1001201.PubMedPubMedCentralCrossRef
48.
go back to reference Le Noury J, Nardo JM, Healy D, Jureidini J, Raven M, Tufanaru C, et al. Restoring Study 329: efficacy and harms of paroxetine and imipramine in treatment of major depression in adolescence. BMJ. 2015;351:h4320.PubMedPubMedCentralCrossRef Le Noury J, Nardo JM, Healy D, Jureidini J, Raven M, Tufanaru C, et al. Restoring Study 329: efficacy and harms of paroxetine and imipramine in treatment of major depression in adolescence. BMJ. 2015;351:h4320.PubMedPubMedCentralCrossRef
49.
go back to reference Koenig F, Slattery J, Groves T, Lang T, Benjamini Y, Day S, et al. Sharing clinical trial data on patient level: opportunities and challenges. Biom J. 2015;57(1):8–26.PubMedCrossRef Koenig F, Slattery J, Groves T, Lang T, Benjamini Y, Day S, et al. Sharing clinical trial data on patient level: opportunities and challenges. Biom J. 2015;57(1):8–26.PubMedCrossRef
50.
go back to reference Keerie C, Tuck C, Milne G, Eldridge S, Wright N, Lewis SC. Data sharing in clinical trials - practical guidance on anonymising trial datasets. Trials. 2018;19(1):25.PubMedPubMedCentralCrossRef Keerie C, Tuck C, Milne G, Eldridge S, Wright N, Lewis SC. Data sharing in clinical trials - practical guidance on anonymising trial datasets. Trials. 2018;19(1):25.PubMedPubMedCentralCrossRef
52.
go back to reference Bauchner H, Golub RM, Fontanarosa PB. Data Sharing: An Ethical and Scientific Imperative. JAMA. 2016;315(12):1237–9.PubMedCrossRef Bauchner H, Golub RM, Fontanarosa PB. Data Sharing: An Ethical and Scientific Imperative. JAMA. 2016;315(12):1237–9.PubMedCrossRef
53.
go back to reference Huser V, Shmueli-Blumberg D. Data sharing platforms for de-identified data from human clinical trials. Clin Trials. 2018;15(4):413–23.PubMedCrossRef Huser V, Shmueli-Blumberg D. Data sharing platforms for de-identified data from human clinical trials. Clin Trials. 2018;15(4):413–23.PubMedCrossRef
55.
go back to reference Clarke M. History of evidence synthesis to assess treatment effects: Personal reflections on something that is very much alive. J R Soc Med. 2016;109(4):154–63.PubMedPubMedCentralCrossRef Clarke M. History of evidence synthesis to assess treatment effects: Personal reflections on something that is very much alive. J R Soc Med. 2016;109(4):154–63.PubMedPubMedCentralCrossRef
56.
go back to reference Ohmann C, Moher D, Siebert M, Motschall E, Naudet F. Status, use and impact of sharing individual participant data from clinical trials: a scoping review. BMJ Open. 2021;11(8):e049228.PubMedPubMedCentralCrossRef Ohmann C, Moher D, Siebert M, Motschall E, Naudet F. Status, use and impact of sharing individual participant data from clinical trials: a scoping review. BMJ Open. 2021;11(8):e049228.PubMedPubMedCentralCrossRef
Metadata
Title
Sharing individual participant data: through a systematic reviewer lens
Authors
Larysa H. M. Rydzewska
Lesley A. Stewart
Jayne F. Tierney
Publication date
01-12-2022
Publisher
BioMed Central
Published in
Trials / Issue 1/2022
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-021-05787-4

Other articles of this Issue 1/2022

Trials 1/2022 Go to the issue