Skip to main content
Top
Published in: Orphanet Journal of Rare Diseases 1/2013

Open Access 01-12-2013 | Research

Clinical evidence for orphan medicinal products-a cause for concern?

Authors: Eline Picavet, David Cassiman, Carla E Hollak, Johan A Maertens, Steven Simoens

Published in: Orphanet Journal of Rare Diseases | Issue 1/2013

Login to get access

Abstract

Background

The difficulties associated with organising clinical studies for orphan medicinal products (OMPs) are plentiful. Recent debate on the long-term effectiveness of some OMPs, led us to question whether the initial standards for clinical evidence for OMPs, set by the European Medicines Agency (EMA) at the time of marketing authorization, are too low. Therefore, the aim of this study was to quantitatively evaluate the characteristics and quality of clinical evidence that is presented for OMPs to obtain marketing authorization in Europe, using the new and validated COMPASS tool.

Methods

We quantitatively assessed the characteristics and quality of clinical evidence of the pivotal studies of 64 OMPs as described in the European Public Assessment Report and/or the Scientific Discussion document prepared by the Committee for Human Medicinal Products of the EMA.

Results

The 64 OMPs were altogether authorized for 78 orphan indications, for which 117 studies were identified as 'pivotal’ or 'main’ studies. In approximately two thirds of the studies, the allocation was randomized (64.8%) and a control arm was used (68.5%). Half of the studies applied some type of blinding. Only a minority (26.9%) of the studies included a Quality-of-Life (QoL) related endpoint, of which a third claim an improvement in QoL. Upon analyzing the quality of reporting, we found that some aspects (i.e. the endpoints, the sampling criteria, and the interventions) are well described, whereas other items (i.e. a description of the patients and of potential biases) are not reported for all studies.

Conclusions

In conclusion, the pivotal studies that are the basis for marketing authorization of OMPs are a cause for concern, as they exhibit methodological flaws i.e. the lack of QoL-related endpoints as outcome, lack of blinding in the study design and the use of surrogate endpoints. Additionally, there are shortcomings in the reporting of those studies that complicate the interpretation. A more demanding regulatory process for OMPs is needed to guide evidence-based clinical decision-making.
Literature
1.
go back to reference Wilcken B: Rare diseases and the assessment of intervention: what sorts of clinical trials can we use?. J Inherit Metab Dis. 2001, 24: 291-298. 10.1023/A:1010387522195.PubMedCrossRef Wilcken B: Rare diseases and the assessment of intervention: what sorts of clinical trials can we use?. J Inherit Metab Dis. 2001, 24: 291-298. 10.1023/A:1010387522195.PubMedCrossRef
2.
go back to reference Tambuyzer E: Rare diseases, orphan drugs and their regulation: questions and misconceptions. Nat Rev Drug Discov. 2010, 9: 921-929. 10.1038/nrd3275.PubMedCrossRef Tambuyzer E: Rare diseases, orphan drugs and their regulation: questions and misconceptions. Nat Rev Drug Discov. 2010, 9: 921-929. 10.1038/nrd3275.PubMedCrossRef
3.
go back to reference Gerss JWO, Kopcke W: Clinical trials and rare diseases. Rare Dis Epidemiol. 2010, 686: 173-190. 10.1007/978-90-481-9485-8_11.CrossRef Gerss JWO, Kopcke W: Clinical trials and rare diseases. Rare Dis Epidemiol. 2010, 686: 173-190. 10.1007/978-90-481-9485-8_11.CrossRef
4.
go back to reference Wiggelinkhuizen M, Tilanus ME, Bollen CW, Houwen RH: Systematic review: clinical efficacy of chelator agents and zinc in the initial treatment of Wilson disease. Aliment Pharmacol Ther. 2009, 29: 947-958. 10.1111/j.1365-2036.2009.03959.x.PubMedCrossRef Wiggelinkhuizen M, Tilanus ME, Bollen CW, Houwen RH: Systematic review: clinical efficacy of chelator agents and zinc in the initial treatment of Wilson disease. Aliment Pharmacol Ther. 2009, 29: 947-958. 10.1111/j.1365-2036.2009.03959.x.PubMedCrossRef
5.
go back to reference Joppi R, Bertele V, Garattini S: Orphan drugs, orphan diseases: the first decade of orphan drug legislation in the EU. Eur J Clin Pharmacol. 2013, 69: 1009-1024. 10.1007/s00228-012-1423-2.PubMedCrossRef Joppi R, Bertele V, Garattini S: Orphan drugs, orphan diseases: the first decade of orphan drug legislation in the EU. Eur J Clin Pharmacol. 2013, 69: 1009-1024. 10.1007/s00228-012-1423-2.PubMedCrossRef
6.
go back to reference Kesselheim AS, Myers JA, Avorn J: Characteristics of clinical trials to support approval of orphan vs nonorphan drugs for cancer. JAMA. 2011, 305: 2320-2326. 10.1001/jama.2011.769.PubMedCrossRef Kesselheim AS, Myers JA, Avorn J: Characteristics of clinical trials to support approval of orphan vs nonorphan drugs for cancer. JAMA. 2011, 305: 2320-2326. 10.1001/jama.2011.769.PubMedCrossRef
7.
go back to reference Putzeist M, Heemstra HE, Garcia JL, Mantel-Teeuwisse AK, Gispen-de Wied CC, Hoes AW, Leufkens HG: Determinants for successful marketing authorisation of orphan medicinal products in the EU. Drug Discov Today. 2012, 17: 352-358. 10.1016/j.drudis.2011.10.027.PubMedCrossRef Putzeist M, Heemstra HE, Garcia JL, Mantel-Teeuwisse AK, Gispen-de Wied CC, Hoes AW, Leufkens HG: Determinants for successful marketing authorisation of orphan medicinal products in the EU. Drug Discov Today. 2012, 17: 352-358. 10.1016/j.drudis.2011.10.027.PubMedCrossRef
8.
go back to reference Dupont AG, Van Wilder PB: Access to orphan drugs despite poor quality of clinical evidence. Br J Clin Pharmacol. 2011, 71: 488-496. 10.1111/j.1365-2125.2010.03877.x.PubMedCentralPubMedCrossRef Dupont AG, Van Wilder PB: Access to orphan drugs despite poor quality of clinical evidence. Br J Clin Pharmacol. 2011, 71: 488-496. 10.1111/j.1365-2125.2010.03877.x.PubMedCentralPubMedCrossRef
9.
go back to reference McCabe C, Tsuchiya A, Claxton K, Raftery J: Orphan drugs revisited. QJM. 2006, 99: 341-345. 10.1093/qjmed/hcl033.PubMedCrossRef McCabe C, Tsuchiya A, Claxton K, Raftery J: Orphan drugs revisited. QJM. 2006, 99: 341-345. 10.1093/qjmed/hcl033.PubMedCrossRef
10.
go back to reference El Dib RP, Nascimento P, Pastores GM: Enzyme replacement therapy for Anderson-Fabry disease. Cochrane Database Syst Rev. 2013, 2: CD006663. El Dib RP, Nascimento P, Pastores GM: Enzyme replacement therapy for Anderson-Fabry disease. Cochrane Database Syst Rev. 2013, 2: CD006663.
11.
go back to reference Rombach SM, Smid BE, Bouwman MG, Linthorst GE, Dijkgraaf MG, Hollak CE: Long term enzyme replacement therapy for Fabry disease: effectiveness on kidney, heart and brain. Orphanet J Rare Dis. 2013, 8: 47. 10.1186/1750-1172-8-47.PubMedCentralPubMedCrossRef Rombach SM, Smid BE, Bouwman MG, Linthorst GE, Dijkgraaf MG, Hollak CE: Long term enzyme replacement therapy for Fabry disease: effectiveness on kidney, heart and brain. Orphanet J Rare Dis. 2013, 8: 47. 10.1186/1750-1172-8-47.PubMedCentralPubMedCrossRef
12.
go back to reference Picavet E, Cassiman D, Aertgeerts B, Simoens S: Development and validation of COMPASS: clinical evidence of orphan medicinal products – an assessment tool. Orphanet J Rare Dis. 2013. Picavet E, Cassiman D, Aertgeerts B, Simoens S: Development and validation of COMPASS: clinical evidence of orphan medicinal products – an assessment tool. Orphanet J Rare Dis. 2013.
14.
go back to reference van der Lee JH, Wesseling J, Tanck MW, Offringa M: Efficient ways exist to obtain the optimal sample size in clinical trials in rare diseases. J Clin Epidemiol. 2008, 61: 324-330. 10.1016/j.jclinepi.2007.07.008.PubMedCrossRef van der Lee JH, Wesseling J, Tanck MW, Offringa M: Efficient ways exist to obtain the optimal sample size in clinical trials in rare diseases. J Clin Epidemiol. 2008, 61: 324-330. 10.1016/j.jclinepi.2007.07.008.PubMedCrossRef
15.
go back to reference Regnstrom J, Koenig F, Aronsson B, Reimer T, Svendsen K, Tsigkos S, Flamion B, Eichler HG, Vamvakas S: Factors associated with success of market authorisation applications for pharmaceutical drugs submitted to the European medicines agency. Eur J Clin Pharmacol. 2010, 66: 39-48. 10.1007/s00228-009-0756-y.PubMedCrossRef Regnstrom J, Koenig F, Aronsson B, Reimer T, Svendsen K, Tsigkos S, Flamion B, Eichler HG, Vamvakas S: Factors associated with success of market authorisation applications for pharmaceutical drugs submitted to the European medicines agency. Eur J Clin Pharmacol. 2010, 66: 39-48. 10.1007/s00228-009-0756-y.PubMedCrossRef
16.
go back to reference Lilford RJ, Thornton JG, Braunholtz D: Clinical trials and rare diseases: a way out of a conundrum. BMJ. 1995, 311: 1621-1625. 10.1136/bmj.311.7020.1621.PubMedCentralPubMedCrossRef Lilford RJ, Thornton JG, Braunholtz D: Clinical trials and rare diseases: a way out of a conundrum. BMJ. 1995, 311: 1621-1625. 10.1136/bmj.311.7020.1621.PubMedCentralPubMedCrossRef
17.
go back to reference McCain J: The ongoing evolution of endpoints in oncology. Manag Care. 2010, 19: 1-11. McCain J: The ongoing evolution of endpoints in oncology. Manag Care. 2010, 19: 1-11.
18.
go back to reference Heemstra HE, Leufkens HG, Rodgers RP, Xu K, Voordouw BC, Braun MM: Characteristics of orphan drug applications that fail to achieve marketing approval in the USA. Drug Discov Today. 2011, 16: 73-80. 10.1016/j.drudis.2010.11.006.PubMedCrossRef Heemstra HE, Leufkens HG, Rodgers RP, Xu K, Voordouw BC, Braun MM: Characteristics of orphan drug applications that fail to achieve marketing approval in the USA. Drug Discov Today. 2011, 16: 73-80. 10.1016/j.drudis.2010.11.006.PubMedCrossRef
19.
go back to reference Behera M, Kumar A, Soares HP, Sokol L, Djulbegovic B: Evidence-based medicine for rare diseases: implications for data interpretation and clinical trial design. Cancer Control. 2007, 14: 160-166.PubMed Behera M, Kumar A, Soares HP, Sokol L, Djulbegovic B: Evidence-based medicine for rare diseases: implications for data interpretation and clinical trial design. Cancer Control. 2007, 14: 160-166.PubMed
20.
go back to reference Luisetti M, Campo I, Scabini R, Zorzetto M, Kadija Z, Mariani F, Ferrarotti I: The problems of clinical trials and registries in rare diseases. Respir Med. 2010, 104 (Suppl 1): S42-S44.PubMedCrossRef Luisetti M, Campo I, Scabini R, Zorzetto M, Kadija Z, Mariani F, Ferrarotti I: The problems of clinical trials and registries in rare diseases. Respir Med. 2010, 104 (Suppl 1): S42-S44.PubMedCrossRef
23.
go back to reference Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Control Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.PubMedCrossRef Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Control Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.PubMedCrossRef
24.
25.
go back to reference Kianifard F, Islam MZ: A guide to the design and analysis of small clinical studies. Pharm Stat. 2011, 10: 363-368. 10.1002/pst.477.PubMedCrossRef Kianifard F, Islam MZ: A guide to the design and analysis of small clinical studies. Pharm Stat. 2011, 10: 363-368. 10.1002/pst.477.PubMedCrossRef
26.
go back to reference Ades AE, Lu G, Madan JJ: Which health-related quality-of-life outcome when planning randomized trials: disease-specific or generic, or both? A common factor model. Value Health. 2013, 16: 185-194. 10.1016/j.jval.2012.09.012.PubMedCrossRef Ades AE, Lu G, Madan JJ: Which health-related quality-of-life outcome when planning randomized trials: disease-specific or generic, or both? A common factor model. Value Health. 2013, 16: 185-194. 10.1016/j.jval.2012.09.012.PubMedCrossRef
27.
go back to reference Grange A, Bekker H, Noyes J, Langley P: Adequacy of health-related quality of life measures in children under 5 years old: systematic review. J Adv Nurs. 2007, 59: 197-220. 10.1111/j.1365-2648.2007.04333.x.PubMedCrossRef Grange A, Bekker H, Noyes J, Langley P: Adequacy of health-related quality of life measures in children under 5 years old: systematic review. J Adv Nurs. 2007, 59: 197-220. 10.1111/j.1365-2648.2007.04333.x.PubMedCrossRef
28.
go back to reference Waldek S, Germain DP, Wanner C, Warnock DG: Enzyme replacement therapy for Fabry’s disease. Lancet. 2010, 375: 1523-1524.PubMedCrossRef Waldek S, Germain DP, Wanner C, Warnock DG: Enzyme replacement therapy for Fabry’s disease. Lancet. 2010, 375: 1523-1524.PubMedCrossRef
30.
go back to reference Day S: Evidence-based medicine and rare diseases. Rare Dis Epidemiol. 2010, 686: 41-53. 10.1007/978-90-481-9485-8_3.CrossRef Day S: Evidence-based medicine and rare diseases. Rare Dis Epidemiol. 2010, 686: 41-53. 10.1007/978-90-481-9485-8_3.CrossRef
32.
go back to reference Banikazemi M, Bultas J, Waldek S, Wilcox WR, Whitley CB, McDonald M, Finkel R, Packman S, Bichet DG, Warnock DG, Desnick RJ, Fabry Disease Clinical Trial Study Group: Agalsidase-beta therapy for advanced Fabry disease: a randomized trial. Ann Intern Med. 2007, 146: 77-86. 10.7326/0003-4819-146-2-200701160-00148.PubMedCrossRef Banikazemi M, Bultas J, Waldek S, Wilcox WR, Whitley CB, McDonald M, Finkel R, Packman S, Bichet DG, Warnock DG, Desnick RJ, Fabry Disease Clinical Trial Study Group: Agalsidase-beta therapy for advanced Fabry disease: a randomized trial. Ann Intern Med. 2007, 146: 77-86. 10.7326/0003-4819-146-2-200701160-00148.PubMedCrossRef
34.
go back to reference Simoens S, Picavet E, Dooms M, Cassiman D, Morel T: Cost-effectiveness assessment of orphan drugs: a scientific and political conundrum. Appl Health Econ Health Policy. 2013, 11: 1-3. 10.1007/s40258-012-0004-y.PubMedCrossRef Simoens S, Picavet E, Dooms M, Cassiman D, Morel T: Cost-effectiveness assessment of orphan drugs: a scientific and political conundrum. Appl Health Econ Health Policy. 2013, 11: 1-3. 10.1007/s40258-012-0004-y.PubMedCrossRef
Metadata
Title
Clinical evidence for orphan medicinal products-a cause for concern?
Authors
Eline Picavet
David Cassiman
Carla E Hollak
Johan A Maertens
Steven Simoens
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Orphanet Journal of Rare Diseases / Issue 1/2013
Electronic ISSN: 1750-1172
DOI
https://doi.org/10.1186/1750-1172-8-164

Other articles of this Issue 1/2013

Orphanet Journal of Rare Diseases 1/2013 Go to the issue