Skip to main content
Top
Published in: Orphanet Journal of Rare Diseases 1/2019

Open Access 01-12-2019 | Research

Agreement between results of meta-analyses from case reports and clinical studies, regarding efficacy and safety of idursulfase therapy in patients with mucopolysaccharidosis type II (MPS-II). A new tool for evidence-based medicine in rare diseases

Authors: Miguel Sampayo-Cordero, Bernat Miguel-Huguet, Almudena Pardo-Mateos, Andrea Malfettone, José Pérez-García, Antonio Llombart-Cussac, Javier Cortés, Marc Moltó-Abad, Cecilia Muñoz-Delgado, Marta Pérez-Quintana, Jordi Pérez-López

Published in: Orphanet Journal of Rare Diseases | Issue 1/2019

Login to get access

Abstract

Background

A preliminary exploratory study shows solid agreement between the results of case reports and clinical study meta-analyses in mucopolysaccharidosis Type I (MPS-I) adult patients. The aim of the present study is to confirm previous results in another patient population, suffering from mucopolysaccharidosis Type II (MPS-II).

Methods

A systematic review and meta-analysis of case reports published by April 2018 was conducted for MPS-II patients treated with enzyme replacement therapy (ERT). The study is reported in accordance with PRISMA and MOOSE guidelines (PROSPERO database code CRD42018093408). The assessed population and outcomes were the same as previously analyzed in a meta-analysis of MPS-II clinical studies. The primary endpoint was the percent of clinical cases showing improvement in efficacy outcome, or no harm in safety outcome after ERT initiation. A restrictive procedure to aggregate case reports, by selecting standardized and well-defined outcomes, was proposed. Different sensitivity analyses were able to evaluate the robustness of results.

Results

Every outcome classified as “acceptable evidence group” in our case report meta-analysis had been graded as “moderate strength of evidence” in the aforementioned meta-analysis of clinical studies. Sensitivity, specificity, and positive-negative predictive values for results of both meta-analyses reached 100%, and were deemed equivalent.

Conclusions

Aggregating case reports quantitatively, rather than analyzing them qualitatively, may improve conclusions in rare diseases and personalized medicine. Additionally, we propose some methods to evaluate publication bias and heterogeneity of the included studies in a meta-analysis of case reports.
Appendix
Available only for authorised users
Literature
1.
go back to reference Cook MC. Medical case reports in the age of genomic medicine. Clin Transl Immunol. 2015;4(10):e45.CrossRef Cook MC. Medical case reports in the age of genomic medicine. Clin Transl Immunol. 2015;4(10):e45.CrossRef
2.
go back to reference Frieden TR. Evidence for health decision making: beyond randomized controlled trials. N Engl J Med. 2017;377(5):465–75.PubMedCrossRef Frieden TR. Evidence for health decision making: beyond randomized controlled trials. N Engl J Med. 2017;377(5):465–75.PubMedCrossRef
3.
go back to reference Sherman RE, Anderson SA, Dal Pan GJ, Gray GW, Gross T, Hunter NL, et al. Real-World Evidence - What Is It and What Can It Tell Us? N Engl J Med. 2016;375(23):2293–7.PubMedCrossRef Sherman RE, Anderson SA, Dal Pan GJ, Gray GW, Gross T, Hunter NL, et al. Real-World Evidence - What Is It and What Can It Tell Us? N Engl J Med. 2016;375(23):2293–7.PubMedCrossRef
4.
go back to reference Sul J, Blumenthal GM, Jiang X, He K, Keegan P, Pazdur R. FDA approval summary: Pembrolizumab for the treatment of patients with metastatic non-small cell lung Cancer whose tumors express programmed death-ligand 1. Oncologist. 2016;21(5):643–50.PubMedPubMedCentralCrossRef Sul J, Blumenthal GM, Jiang X, He K, Keegan P, Pazdur R. FDA approval summary: Pembrolizumab for the treatment of patients with metastatic non-small cell lung Cancer whose tumors express programmed death-ligand 1. Oncologist. 2016;21(5):643–50.PubMedPubMedCentralCrossRef
5.
go back to reference Monzon JG, Hay AE, McDonald GT, Pater JL, Meyer RM, Chen E, et al. Correlation of single arm versus randomised phase 2 oncology trial characteristics with phase 3 outcome. Eur J Cancer. 2015;51(17):2501–7.PubMedCrossRef Monzon JG, Hay AE, McDonald GT, Pater JL, Meyer RM, Chen E, et al. Correlation of single arm versus randomised phase 2 oncology trial characteristics with phase 3 outcome. Eur J Cancer. 2015;51(17):2501–7.PubMedCrossRef
7.
go back to reference Nakamura T, Igarashi H, Ito T, Jensen RT. Important of case-reports/series, in rare diseases: using neuroendocrine tumors as an example. World J Clin Cases. 2014;2(11):608–13.PubMedPubMedCentralCrossRef Nakamura T, Igarashi H, Ito T, Jensen RT. Important of case-reports/series, in rare diseases: using neuroendocrine tumors as an example. World J Clin Cases. 2014;2(11):608–13.PubMedPubMedCentralCrossRef
10.
go back to reference Pérez-López J, Morales-Conejo M, López-Rodríguez M, Hermida-Ameijeiras A, Moltó-Abad M. Ficacy of laronidase therapy in patients with mucopolysaccharidosis Type I who initiated enzyme replacement therapy in adult age. A systematic review and meta-analysis. Mol Genet Metab. 2017;121(2):138–49.PubMedCrossRef Pérez-López J, Morales-Conejo M, López-Rodríguez M, Hermida-Ameijeiras A, Moltó-Abad M. Ficacy of laronidase therapy in patients with mucopolysaccharidosis Type I who initiated enzyme replacement therapy in adult age. A systematic review and meta-analysis. Mol Genet Metab. 2017;121(2):138–49.PubMedCrossRef
11.
go back to reference Sampayo-Cordero M, Miguel-Huguet B, Pardo-Mateos A, Moltó-Abad M, Muñoz-Delgado C, Pérez-López J. Agreement between the results of meta-analyses from case reports and from clinical studies regarding the efficacy of laronidase therapy in patients with mucopolysaccharidosis type I who initiated enzyme replacement therapy in adult age: an example of case reports meta-analyses as an useful tool for evidence-based medicine in rare diseases. Mol Genet Metab. 2018;123(2):69–75.PubMedCrossRef Sampayo-Cordero M, Miguel-Huguet B, Pardo-Mateos A, Moltó-Abad M, Muñoz-Delgado C, Pérez-López J. Agreement between the results of meta-analyses from case reports and from clinical studies regarding the efficacy of laronidase therapy in patients with mucopolysaccharidosis type I who initiated enzyme replacement therapy in adult age: an example of case reports meta-analyses as an useful tool for evidence-based medicine in rare diseases. Mol Genet Metab. 2018;123(2):69–75.PubMedCrossRef
12.
go back to reference Bradley LA, Haddow HRM, Palomaki GE. Treatment of mucopolysaccharidosis type II (Hunter syndrome): results from a systematic evidence review. Genet Med. 2017;19(11):1187–201.PubMedCrossRef Bradley LA, Haddow HRM, Palomaki GE. Treatment of mucopolysaccharidosis type II (Hunter syndrome): results from a systematic evidence review. Genet Med. 2017;19(11):1187–201.PubMedCrossRef
13.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG, P. Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Brit Med J. 2009;339:b2535.PubMedCrossRefPubMedCentral Moher D, Liberati A, Tetzlaff J, Altman DG, P. Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Brit Med J. 2009;339:b2535.PubMedCrossRefPubMedCentral
14.
go back to reference Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000;283(15):2008–12.PubMedCrossRef Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000;283(15):2008–12.PubMedCrossRef
15.
go back to reference AHRQ. Methods guide for effectiveness and comparative effectiveness reviews. Rockville: Agency for Healthcare Research and Quality; 2014. AHRQ. Methods guide for effectiveness and comparative effectiveness reviews. Rockville: Agency for Healthcare Research and Quality; 2014.
16.
go back to reference Vickerstaff V, Ambler G, King M, Nazareth I, Omar RZ. Are multiple primary outcomes analysed appropriately in randomised controlled trials? A review. Contemp Clin Trials. 2015;45(Pt A):8–12.PubMedCrossRef Vickerstaff V, Ambler G, King M, Nazareth I, Omar RZ. Are multiple primary outcomes analysed appropriately in randomised controlled trials? A review. Contemp Clin Trials. 2015;45(Pt A):8–12.PubMedCrossRef
17.
go back to reference Benjamini Y, Cohen R. Weighted false discovery rate controlling procedures for clinical trials. Biostatistics. 2017;18(1):91–104.PubMedCrossRef Benjamini Y, Cohen R. Weighted false discovery rate controlling procedures for clinical trials. Biostatistics. 2017;18(1):91–104.PubMedCrossRef
20.
21.
go back to reference Jansen-van der Weide MC, Gaasterland CMW, Roes KCB, Pontes C, Vives R, Sancho A, et al. Rare disease registries: potential applications towards impact on development of new drug treatments. Orphanet J Rare Dis. 2018;13:154.PubMedPubMedCentralCrossRef Jansen-van der Weide MC, Gaasterland CMW, Roes KCB, Pontes C, Vives R, Sancho A, et al. Rare disease registries: potential applications towards impact on development of new drug treatments. Orphanet J Rare Dis. 2018;13:154.PubMedPubMedCentralCrossRef
22.
go back to reference Kamel MG, Nam NT, Han NHB, El-Shabouny AE, Makram AM, Abd-Elhay FA, et al. Post-dengue acute disseminated encephalomyelitis: a case report and meta-analysis. PLoS Negl Trop Dis. 2017;11(6):e0005715.PubMedPubMedCentralCrossRef Kamel MG, Nam NT, Han NHB, El-Shabouny AE, Makram AM, Abd-Elhay FA, et al. Post-dengue acute disseminated encephalomyelitis: a case report and meta-analysis. PLoS Negl Trop Dis. 2017;11(6):e0005715.PubMedPubMedCentralCrossRef
23.
go back to reference da Silva EM, Strufaldi MW, Andriolo RB, Silva LA. Enzyme replacement therapy with idursulfase for mucopolysaccharidosis type II (Hunter syndrome). Cochrane Database Syst Rev. 2016;2:CD008185.PubMed da Silva EM, Strufaldi MW, Andriolo RB, Silva LA. Enzyme replacement therapy with idursulfase for mucopolysaccharidosis type II (Hunter syndrome). Cochrane Database Syst Rev. 2016;2:CD008185.PubMed
24.
go back to reference Muenzer J, Wraith JE, Beck M, Giugliani R, Harmatz P, Eng CM, et al. A phase II/III clinical study of enzyme replacement therapy with idursulfase in mucopolysaccharidosis II (Hunter syndrome). Genet Med. 2006;8(8):465–73.PubMedCrossRef Muenzer J, Wraith JE, Beck M, Giugliani R, Harmatz P, Eng CM, et al. A phase II/III clinical study of enzyme replacement therapy with idursulfase in mucopolysaccharidosis II (Hunter syndrome). Genet Med. 2006;8(8):465–73.PubMedCrossRef
25.
go back to reference Alegra T, Eizerik DP, de Cerqueira CC, Pereira TV, Dornelles AD, Schwartz IV. Efficacy and safety of idursulfase therapy in patients with mucopolysaccharidosis type II with and without comparison to placebo: systematic review and meta-analysis. Cad Saude Publica. 2013;29(Suppl 1):S45–58.PubMedCrossRef Alegra T, Eizerik DP, de Cerqueira CC, Pereira TV, Dornelles AD, Schwartz IV. Efficacy and safety of idursulfase therapy in patients with mucopolysaccharidosis type II with and without comparison to placebo: systematic review and meta-analysis. Cad Saude Publica. 2013;29(Suppl 1):S45–58.PubMedCrossRef
26.
go back to reference Clarke LA, Wraith JE, Beck M, Kolodny EH, Pastores GM, Muenzer J, et al. Long-term efficacy and safety of laronidase in the treatment of mucopolysaccharidosis I. Pediatrics. 2009;123(1):229–40.PubMedCrossRef Clarke LA, Wraith JE, Beck M, Kolodny EH, Pastores GM, Muenzer J, et al. Long-term efficacy and safety of laronidase in the treatment of mucopolysaccharidosis I. Pediatrics. 2009;123(1):229–40.PubMedCrossRef
27.
go back to reference Muenzer J. Overview of the mucopolysaccharidoses. Rheumatology (Oxford). 2011;50(Suppl 5):v4–12.CrossRef Muenzer J. Overview of the mucopolysaccharidoses. Rheumatology (Oxford). 2011;50(Suppl 5):v4–12.CrossRef
28.
go back to reference Okuyama T, Tanaka A, Suzuki Y, Ida H, Tanaka T, Cox GF, et al. Japan Elaprase treatment (JET) study: Idursulfase enzyme replacement therapy in adult patients with attenuated Hunter syndrome (Mucopolysaccharidosis II, MPS II). Mol Genet Metab. 2010;99(1):18–25.PubMedCrossRef Okuyama T, Tanaka A, Suzuki Y, Ida H, Tanaka T, Cox GF, et al. Japan Elaprase treatment (JET) study: Idursulfase enzyme replacement therapy in adult patients with attenuated Hunter syndrome (Mucopolysaccharidosis II, MPS II). Mol Genet Metab. 2010;99(1):18–25.PubMedCrossRef
29.
go back to reference Brands MM, Frohn-Mulder IM, Hagemans ML, Hop WC, Oussoren E, Helbing WA, et al. Mucopolysaccharidosis: cardiologic features and effects of enzyme-replacement therapy in 24 children with MPS I, II and VI. J Inherit Metab Dis. 2013;36(2):227–34.PubMedCrossRef Brands MM, Frohn-Mulder IM, Hagemans ML, Hop WC, Oussoren E, Helbing WA, et al. Mucopolysaccharidosis: cardiologic features and effects of enzyme-replacement therapy in 24 children with MPS I, II and VI. J Inherit Metab Dis. 2013;36(2):227–34.PubMedCrossRef
30.
go back to reference Pérez-López J, Moltó-Abad M, Muñoz-Delgado C, Morales-Conejo M, Ceberio-Hualde L, Del Toro M. Efficacy of Idursulfase therapy in patients with mucopolysaccharidosis type II who initiated enzyme replacement therapy in adult age. A systematic review of the literature. Mol Genet Metab. 2018;124(3):216–27.PubMedCrossRef Pérez-López J, Moltó-Abad M, Muñoz-Delgado C, Morales-Conejo M, Ceberio-Hualde L, Del Toro M. Efficacy of Idursulfase therapy in patients with mucopolysaccharidosis type II who initiated enzyme replacement therapy in adult age. A systematic review of the literature. Mol Genet Metab. 2018;124(3):216–27.PubMedCrossRef
32.
33.
go back to reference Akacha M, Kothny W. Estimands: a more strategic approach to study design and analysis. Clin Pharmacol Ther. 2017;102(6):894–6.PubMedCrossRef Akacha M, Kothny W. Estimands: a more strategic approach to study design and analysis. Clin Pharmacol Ther. 2017;102(6):894–6.PubMedCrossRef
34.
go back to reference Weinreich S, Vrinten C, Kuijpers M, Lipka A, Schimmel K, Van Zwet E, Wied C, Hekster Y, Verschuuren J, Cornel M. Aggregated N-of-1 trials for unlicensed medicines for small populations: an assessment of a trial with ephedrine for myasthenia gravis. Orphanet J Rare Dis. 2017;12(88):88.PubMedPubMedCentralCrossRef Weinreich S, Vrinten C, Kuijpers M, Lipka A, Schimmel K, Van Zwet E, Wied C, Hekster Y, Verschuuren J, Cornel M. Aggregated N-of-1 trials for unlicensed medicines for small populations: an assessment of a trial with ephedrine for myasthenia gravis. Orphanet J Rare Dis. 2017;12(88):88.PubMedPubMedCentralCrossRef
36.
go back to reference AHRQ. Design and Implementation of N-of-1 Trials: A User’s Guide, In: quality Afhcra, editor. Rockville: Agency for Healthcare Research and Quality; 2014. p. 33–53. AHRQ. Design and Implementation of N-of-1 Trials: A User’s Guide, In: quality Afhcra, editor. Rockville: Agency for Healthcare Research and Quality; 2014. p. 33–53.
37.
go back to reference Elbourne DR, Altman DG, Higgins JP, Curtin F, Worthington HV, Vail A. Meta-analyses involving cross-over trials: methodological issues. Int J Epidemiol. 2002;31(1):140–9.PubMedCrossRef Elbourne DR, Altman DG, Higgins JP, Curtin F, Worthington HV, Vail A. Meta-analyses involving cross-over trials: methodological issues. Int J Epidemiol. 2002;31(1):140–9.PubMedCrossRef
38.
go back to reference Muenzer J, Jones SA, Tylki-Szymańska A, Harmatz P, Mendelsohn NJ, Guffon N, et al. Ten years of the Hunter Outcome Survey (HOS): insights, achievements, and lessons learned from a global patient registry. Orphanet J Rare Dis. 2017;12(1):82.PubMedPubMedCentralCrossRef Muenzer J, Jones SA, Tylki-Szymańska A, Harmatz P, Mendelsohn NJ, Guffon N, et al. Ten years of the Hunter Outcome Survey (HOS): insights, achievements, and lessons learned from a global patient registry. Orphanet J Rare Dis. 2017;12(1):82.PubMedPubMedCentralCrossRef
39.
go back to reference Muenzer J, Giugliani R, Scarpa M, Tylki-Szymanska A, Jego V, Beck M. Clinical outcomes in idursulfase-treated patients with mucopolysaccharidosis type II: 3-year data from the hunter outcome survey (HOS). Orphanet J Rare Dis. 2017;12(1):161.PubMedPubMedCentralCrossRef Muenzer J, Giugliani R, Scarpa M, Tylki-Szymanska A, Jego V, Beck M. Clinical outcomes in idursulfase-treated patients with mucopolysaccharidosis type II: 3-year data from the hunter outcome survey (HOS). Orphanet J Rare Dis. 2017;12(1):161.PubMedPubMedCentralCrossRef
40.
go back to reference Giugliani R, Harmatz P, Jones SA, Mendelsohn NJ, Vellodi A, Qiu Y, et al. Evaluation of impact of anti-idursulfase antibodies during long-term idursulfase enzyme replacement therapy in mucopolysaccharidosis II patients. Mol Genet Metab Rep. 2017;12:2–7.PubMedPubMedCentralCrossRef Giugliani R, Harmatz P, Jones SA, Mendelsohn NJ, Vellodi A, Qiu Y, et al. Evaluation of impact of anti-idursulfase antibodies during long-term idursulfase enzyme replacement therapy in mucopolysaccharidosis II patients. Mol Genet Metab Rep. 2017;12:2–7.PubMedPubMedCentralCrossRef
41.
go back to reference Rubinstein L. Phase II design: history and evolution. Chin Clin Oncol. 2014;3(4):48.PubMed Rubinstein L. Phase II design: history and evolution. Chin Clin Oncol. 2014;3(4):48.PubMed
42.
go back to reference Jardim DL, Groves ES, Breitfeld PP, Kurzrock R. Factors associated with failure of oncology drugs in late-stage clinical development: a systematic review. Cancer Treat Rev. 2017;52:12–21.PubMedCrossRef Jardim DL, Groves ES, Breitfeld PP, Kurzrock R. Factors associated with failure of oncology drugs in late-stage clinical development: a systematic review. Cancer Treat Rev. 2017;52:12–21.PubMedCrossRef
43.
go back to reference Melani C, Major A, Schowinsky J, Roschewski M, Pittaluga S, Jaffe ES, et al. PD-1 blockade in Mediastinal Gray-zone lymphoma. N Engl J Med. 2017;377(1):89–91.PubMedPubMedCentralCrossRef Melani C, Major A, Schowinsky J, Roschewski M, Pittaluga S, Jaffe ES, et al. PD-1 blockade in Mediastinal Gray-zone lymphoma. N Engl J Med. 2017;377(1):89–91.PubMedPubMedCentralCrossRef
44.
go back to reference Friede T, Posch M, Zohar S, Alberti C, Benda N, Comets E, et al. Recent advances in methodology for clinical trials in small populations: the InSPiRe project. Orphanet J Rare Dis. 2018;13(1):186.PubMedPubMedCentralCrossRef Friede T, Posch M, Zohar S, Alberti C, Benda N, Comets E, et al. Recent advances in methodology for clinical trials in small populations: the InSPiRe project. Orphanet J Rare Dis. 2018;13(1):186.PubMedPubMedCentralCrossRef
45.
go back to reference Gurevitch J, Koricheva J, Nakagawa S, Stewart G. Meta-analysis and the science of research synthesis. Nature. 2018;555(7695):175–82.PubMedCrossRef Gurevitch J, Koricheva J, Nakagawa S, Stewart G. Meta-analysis and the science of research synthesis. Nature. 2018;555(7695):175–82.PubMedCrossRef
Metadata
Title
Agreement between results of meta-analyses from case reports and clinical studies, regarding efficacy and safety of idursulfase therapy in patients with mucopolysaccharidosis type II (MPS-II). A new tool for evidence-based medicine in rare diseases
Authors
Miguel Sampayo-Cordero
Bernat Miguel-Huguet
Almudena Pardo-Mateos
Andrea Malfettone
José Pérez-García
Antonio Llombart-Cussac
Javier Cortés
Marc Moltó-Abad
Cecilia Muñoz-Delgado
Marta Pérez-Quintana
Jordi Pérez-López
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Orphanet Journal of Rare Diseases / Issue 1/2019
Electronic ISSN: 1750-1172
DOI
https://doi.org/10.1186/s13023-019-1202-6

Other articles of this Issue 1/2019

Orphanet Journal of Rare Diseases 1/2019 Go to the issue