Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2014

Open Access 01-12-2014 | Research article

Estimating time-to-onset of adverse drug reactions from spontaneous reporting databases

Authors: Fanny Leroy, Jean-Yves Dauxois, Hélène Théophile, Françoise Haramburu, Pascale Tubert-Bitter

Published in: BMC Medical Research Methodology | Issue 1/2014

Login to get access

Abstract

Background

Analyzing time-to-onset of adverse drug reactions from treatment exposure contributes to meeting pharmacovigilance objectives, i.e. identification and prevention. Post-marketing data are available from reporting systems. Times-to-onset from such databases are right-truncated because some patients who were exposed to the drug and who will eventually develop the adverse drug reaction may do it after the time of analysis and thus are not included in the data. Acknowledgment of the developments adapted to right-truncated data is not widespread and these methods have never been used in pharmacovigilance. We assess the use of appropriate methods as well as the consequences of not taking right truncation into account (naive approach) on parametric maximum likelihood estimation of time-to-onset distribution.

Methods

Both approaches, naive or taking right truncation into account, were compared with a simulation study. We used twelve scenarios for the exponential distribution and twenty-four for the Weibull and log-logistic distributions. These scenarios are defined by a set of parameters: the parameters of the time-to-onset distribution, the probability of this distribution falling within an observable values interval and the sample size. An application to reported lymphoma after anti TNF- α treatment from the French pharmacovigilance is presented.

Results

The simulation study shows that the bias and the mean squared error might in some instances be unacceptably large when right truncation is not considered while the truncation-based estimator shows always better and often satisfactory performances and the gap may be large. For the real dataset, the estimated expected time-to-onset leads to a minimum difference of 58 weeks between both approaches, which is not negligible. This difference is obtained for the Weibull model, under which the estimated probability of this distribution falling within an observable values interval is not far from 1.

Conclusions

It is necessary to take right truncation into account for estimating time-to-onset of adverse drug reactions from spontaneous reporting databases.
Appendix
Available only for authorised users
Literature
1.
go back to reference Fourrier A, Bégaud B, Alpérovitch A, Verdier-Taillefer M-H, Decker N, Imbs J-L, Touzé E: Hepatitis B vaccine and first episodes of central nervous system demyelinating disorders: a comparison between reported and expected number of cases. Br J Clin Pharmacol. 2001, 51 (5): 489-490.CrossRefPubMedPubMedCentral Fourrier A, Bégaud B, Alpérovitch A, Verdier-Taillefer M-H, Decker N, Imbs J-L, Touzé E: Hepatitis B vaccine and first episodes of central nervous system demyelinating disorders: a comparison between reported and expected number of cases. Br J Clin Pharmacol. 2001, 51 (5): 489-490.CrossRefPubMedPubMedCentral
2.
go back to reference Tubert P, Bégaud B, Haramburu F, Péré JC: Spontaneous reporting: how many cases are required to trigger a warning?. Br J Clin Pharmacol. 1991, 32 (4): 407-408. 10.1111/j.1365-2125.1991.tb03922.x.CrossRefPubMedPubMedCentral Tubert P, Bégaud B, Haramburu F, Péré JC: Spontaneous reporting: how many cases are required to trigger a warning?. Br J Clin Pharmacol. 1991, 32 (4): 407-408. 10.1111/j.1365-2125.1991.tb03922.x.CrossRefPubMedPubMedCentral
3.
go back to reference Moore N, Kreft-Jais C, Haramburu F, Noblet C, Andrejak M, Ollagnier M, Bégaud B: Reports of hypoglycaemia associated with the use of ACE inhibitors and other drugs: a case/non-case study in the French pharmacovigilance system database. Br J Clin Pharmacol. 1997, 44 (5): 513-518.CrossRefPubMedPubMedCentral Moore N, Kreft-Jais C, Haramburu F, Noblet C, Andrejak M, Ollagnier M, Bégaud B: Reports of hypoglycaemia associated with the use of ACE inhibitors and other drugs: a case/non-case study in the French pharmacovigilance system database. Br J Clin Pharmacol. 1997, 44 (5): 513-518.CrossRefPubMedPubMedCentral
4.
go back to reference Tubert-Bitter P, Bégaud B, Moride Y, Chaslerie A, Haramburu F: Comparing the toxicity of two drugs in the framework of spontaneous reporting: a confidence interval approach. J Clin Epidemiol. 1996, 49 (1): 121-123. 10.1016/0895-4356(95)00537-4.CrossRefPubMed Tubert-Bitter P, Bégaud B, Moride Y, Chaslerie A, Haramburu F: Comparing the toxicity of two drugs in the framework of spontaneous reporting: a confidence interval approach. J Clin Epidemiol. 1996, 49 (1): 121-123. 10.1016/0895-4356(95)00537-4.CrossRefPubMed
5.
go back to reference van der Heijden PG, van Puijenbroek EP, van Buuren S, van der Hofstede JW: On the assessment of adverse drug reactions from spontaneous reporting systems: the influence of under-reporting on odds ratios. Stat Med. 2002, 21 (14): 2027-2044. 10.1002/sim.1157.CrossRefPubMed van der Heijden PG, van Puijenbroek EP, van Buuren S, van der Hofstede JW: On the assessment of adverse drug reactions from spontaneous reporting systems: the influence of under-reporting on odds ratios. Stat Med. 2002, 21 (14): 2027-2044. 10.1002/sim.1157.CrossRefPubMed
6.
go back to reference Bate A, Lindquist M, Edwards IR, Olsson S, Orre R, Lansner A, De Freitas RM: A bayesian neural network method for adverse drug reaction signal generation. Eur J Clin Pharmacol. 1998, 54 (4): 315-321. 10.1007/s002280050466.CrossRefPubMed Bate A, Lindquist M, Edwards IR, Olsson S, Orre R, Lansner A, De Freitas RM: A bayesian neural network method for adverse drug reaction signal generation. Eur J Clin Pharmacol. 1998, 54 (4): 315-321. 10.1007/s002280050466.CrossRefPubMed
7.
go back to reference DuMouchel W: Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system. Am Stat. 1999, 53 (3): 177-190. DuMouchel W: Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system. Am Stat. 1999, 53 (3): 177-190.
8.
go back to reference Szarfman A, Machado SG, O’Neill RT: Use of screening algorithms and computer systems to efficiently signal higher-than-expected combinations of drugs and events in the US FDA’s spontaneous reports database. Drug Saf. 2002, 25 (6): 381-392. 10.2165/00002018-200225060-00001.CrossRefPubMed Szarfman A, Machado SG, O’Neill RT: Use of screening algorithms and computer systems to efficiently signal higher-than-expected combinations of drugs and events in the US FDA’s spontaneous reports database. Drug Saf. 2002, 25 (6): 381-392. 10.2165/00002018-200225060-00001.CrossRefPubMed
9.
go back to reference Evans SJW, Waller PC, Davis S: Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports. Pharmacoepidemiol Drug Saf. 2001, 10 (6): 483-486. 10.1002/pds.677.CrossRefPubMed Evans SJW, Waller PC, Davis S: Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports. Pharmacoepidemiol Drug Saf. 2001, 10 (6): 483-486. 10.1002/pds.677.CrossRefPubMed
10.
go back to reference Ahmed I, Haramburu F, Fourrier-Réglat A, Thiessard F, Kreft-Jais C, Bégaud B, Tubert-Bitter P, Miremont-Salamé G: Bayesian pharmacovigilance signal detection methods revisited in a multiple comparison setting. Stat Med. 2009, 28 (13): 1774-1792. 10.1002/sim.3586.CrossRefPubMed Ahmed I, Haramburu F, Fourrier-Réglat A, Thiessard F, Kreft-Jais C, Bégaud B, Tubert-Bitter P, Miremont-Salamé G: Bayesian pharmacovigilance signal detection methods revisited in a multiple comparison setting. Stat Med. 2009, 28 (13): 1774-1792. 10.1002/sim.3586.CrossRefPubMed
11.
go back to reference Ahmed I, Dalmasso C, Haramburu F, Thiessard F, Broët P, Tubert-Bitter P: False discovery rate estimation for frequentist pharmacovigilance signal detection methods. Biometrics. 2010, 66 (1): 301-309. 10.1111/j.1541-0420.2009.01262.x.CrossRefPubMed Ahmed I, Dalmasso C, Haramburu F, Thiessard F, Broët P, Tubert-Bitter P: False discovery rate estimation for frequentist pharmacovigilance signal detection methods. Biometrics. 2010, 66 (1): 301-309. 10.1111/j.1541-0420.2009.01262.x.CrossRefPubMed
12.
go back to reference Roux E, Thiessard F, Fourrier A, Bégaud B, Tubert-Bitter P: Evaluation of statistical association measures for the automatic signal generation in pharmacovigilance. IEEE Trans Inf Technol Biomed. 2005, 9 (4): 518-527.CrossRefPubMed Roux E, Thiessard F, Fourrier A, Bégaud B, Tubert-Bitter P: Evaluation of statistical association measures for the automatic signal generation in pharmacovigilance. IEEE Trans Inf Technol Biomed. 2005, 9 (4): 518-527.CrossRefPubMed
13.
go back to reference Ahmed I, Thiessard F, Bégaud B, Tubert-Bitter P, Miremont-Salamé G: Pharmacovigilance data mining with methods based on false discovery rates: a comparative simulation study. Clin Pharmacol Ther. 2010, 88 (4): 492-498. 10.1038/clpt.2010.111.CrossRefPubMed Ahmed I, Thiessard F, Bégaud B, Tubert-Bitter P, Miremont-Salamé G: Pharmacovigilance data mining with methods based on false discovery rates: a comparative simulation study. Clin Pharmacol Ther. 2010, 88 (4): 492-498. 10.1038/clpt.2010.111.CrossRefPubMed
14.
go back to reference Bate A, Evans SJW: Quantitative signal detection using spontaneous ADR reporting. Pharmacoepidemiol Drug Saf. 2009, 18 (6): 427-436. 10.1002/pds.1742.CrossRefPubMed Bate A, Evans SJW: Quantitative signal detection using spontaneous ADR reporting. Pharmacoepidemiol Drug Saf. 2009, 18 (6): 427-436. 10.1002/pds.1742.CrossRefPubMed
15.
go back to reference Alvarez Y, Hidalgo A, Maignen F, Slattery J: Validation of statistical signal detection procedures in eudravigilance post-authorization data: a retrospective evaluation of the potential for earlier signalling. Drug Saf. 2010, 33 (6): 475-487. 10.2165/11534410-000000000-00000.CrossRefPubMed Alvarez Y, Hidalgo A, Maignen F, Slattery J: Validation of statistical signal detection procedures in eudravigilance post-authorization data: a retrospective evaluation of the potential for earlier signalling. Drug Saf. 2010, 33 (6): 475-487. 10.2165/11534410-000000000-00000.CrossRefPubMed
16.
go back to reference Hochberg AM, Hauben M: Time-to-signal comparison for drug safety data-mining algorithms vs. traditional signaling criteria. Clin Pharmacol Ther. 2009, 85 (6): 600-606. 10.1038/clpt.2009.26.CrossRefPubMed Hochberg AM, Hauben M: Time-to-signal comparison for drug safety data-mining algorithms vs. traditional signaling criteria. Clin Pharmacol Ther. 2009, 85 (6): 600-606. 10.1038/clpt.2009.26.CrossRefPubMed
17.
go back to reference Ahmed I, Thiessard F, Haramburu F, Kreft-Jais C, Bégaud B, Tubert-Bitter P, Miremont-Salamé G: Early detection of pharmacovigilance signals with automated methods based on false discovery rates: a comparative study. Drug Saf. 2012, 35 (6): 495-506. 10.2165/11597180-000000000-00000.CrossRefPubMed Ahmed I, Thiessard F, Haramburu F, Kreft-Jais C, Bégaud B, Tubert-Bitter P, Miremont-Salamé G: Early detection of pharmacovigilance signals with automated methods based on false discovery rates: a comparative study. Drug Saf. 2012, 35 (6): 495-506. 10.2165/11597180-000000000-00000.CrossRefPubMed
18.
go back to reference Maignen F, Hauben M, Tsintis P: Modelling the time to onset of adverse reactions with parametric survival distributions. Drug Saf. 2010, 33 (5): 417-434. 10.2165/11532850-000000000-00000.CrossRefPubMed Maignen F, Hauben M, Tsintis P: Modelling the time to onset of adverse reactions with parametric survival distributions. Drug Saf. 2010, 33 (5): 417-434. 10.2165/11532850-000000000-00000.CrossRefPubMed
19.
go back to reference Van Holle L, Zeinoun Z, Bauchau V, Verstraeten T: Using time-to-onset for detecting safety signals in spontaneous reports of adverse events following immunization: a proof of concept study. Pharmacoepidemiol Drug Saf. 2012, 21 (6): 603-610. 10.1002/pds.3226.CrossRefPubMed Van Holle L, Zeinoun Z, Bauchau V, Verstraeten T: Using time-to-onset for detecting safety signals in spontaneous reports of adverse events following immunization: a proof of concept study. Pharmacoepidemiol Drug Saf. 2012, 21 (6): 603-610. 10.1002/pds.3226.CrossRefPubMed
20.
go back to reference Cornelius VR, Sauzet O, Evans SJW: A signal detection method to detect adverse drug reactions using a parametric time-to-event model in simulated cohort data. Drug Saf. 2012, 35 (7): 599-610. 10.2165/11599740-000000000-00000.CrossRefPubMed Cornelius VR, Sauzet O, Evans SJW: A signal detection method to detect adverse drug reactions using a parametric time-to-event model in simulated cohort data. Drug Saf. 2012, 35 (7): 599-610. 10.2165/11599740-000000000-00000.CrossRefPubMed
21.
go back to reference Lagakos SW, Barraj LM, De Gruttola V: Nonparametric analysis of truncated survival data, with application to aids. Biometrika. 1988, 75 (3): 515-523. 10.1093/biomet/75.3.515.CrossRef Lagakos SW, Barraj LM, De Gruttola V: Nonparametric analysis of truncated survival data, with application to aids. Biometrika. 1988, 75 (3): 515-523. 10.1093/biomet/75.3.515.CrossRef
22.
go back to reference Kalbfleisch JD, Lawless JF: Regression models for right truncated data with applications to AIDS incubation times and reporting lags. Stat Sin. 1991, 1: 19-32. Kalbfleisch JD, Lawless JF: Regression models for right truncated data with applications to AIDS incubation times and reporting lags. Stat Sin. 1991, 1: 19-32.
23.
go back to reference Bégaud B, Miremont G, Péré JC: Estimation of the denominator in spontaneous reporting. Methodological Approaches in Pharmacoepidemiology: Application to Spontaneous Reporting. 1993, Amsterdam: Elsevier, 51-70. Bégaud B, Miremont G, Péré JC: Estimation of the denominator in spontaneous reporting. Methodological Approaches in Pharmacoepidemiology: Application to Spontaneous Reporting. 1993, Amsterdam: Elsevier, 51-70.
25.
go back to reference Théophile H, Schaeverbeke T, Abouelfath A, Kahn V, Haramburu F, Bégaud B, Miremont-Salamé G: Sources of information on lymphoma associated with anti-tumour necrosis factor agents. Drug Saf. 2011, 34 (7): 577-585. 10.2165/11590200-000000000-00000.CrossRefPubMed Théophile H, Schaeverbeke T, Abouelfath A, Kahn V, Haramburu F, Bégaud B, Miremont-Salamé G: Sources of information on lymphoma associated with anti-tumour necrosis factor agents. Drug Saf. 2011, 34 (7): 577-585. 10.2165/11590200-000000000-00000.CrossRefPubMed
26.
go back to reference Efron B, Tibshirani RJ: An Introduction to the Bootstrap. 1993, New York: Chapman & HallCrossRef Efron B, Tibshirani RJ: An Introduction to the Bootstrap. 1993, New York: Chapman & HallCrossRef
27.
go back to reference Gross ST, Lai TL: Bootstrap methods for truncated and censored data. Stat Sin. 1996, 6: 509-530. Gross ST, Lai TL: Bootstrap methods for truncated and censored data. Stat Sin. 1996, 6: 509-530.
28.
go back to reference Weber JCP: Mathematical models in adverse drug reaction assessment. Iatrogenic Diseases. 3rd Ed. Edited by: Arcy PF, Griffin JP. 1986, Oxford: Oxford University Press, Weber JCP: Mathematical models in adverse drug reaction assessment. Iatrogenic Diseases. 3rd Ed. Edited by: Arcy PF, Griffin JP. 1986, Oxford: Oxford University Press,
29.
go back to reference Tubert-Bitter P, Haramburu F, Bégaud B, Chaslerie A, Abraham E, Hagry C: Spontaneous reporting of adverse drug reactions: who reports and what?. Pharmacoepidemiol Drug Saf. 1998, 7 (5): 323-329. 10.1002/(SICI)1099-1557(199809/10)7:5<323::AID-PDS374>3.0.CO;2-8.CrossRefPubMed Tubert-Bitter P, Haramburu F, Bégaud B, Chaslerie A, Abraham E, Hagry C: Spontaneous reporting of adverse drug reactions: who reports and what?. Pharmacoepidemiol Drug Saf. 1998, 7 (5): 323-329. 10.1002/(SICI)1099-1557(199809/10)7:5<323::AID-PDS374>3.0.CO;2-8.CrossRefPubMed
30.
go back to reference Haramburu F Bégaud, Moride Y: Temporal trends in spontaneous reporting of unlabelled adverse drug reactions. Br J Clin Pharmacol. 1997, 44 (3): 299-301.CrossRefPubMed Haramburu F Bégaud, Moride Y: Temporal trends in spontaneous reporting of unlabelled adverse drug reactions. Br J Clin Pharmacol. 1997, 44 (3): 299-301.CrossRefPubMed
31.
go back to reference Moride Y, Haramburu F, Requejo AA, Bégaud B: Under-reporting of adverse drug reactions in general practice. Br J of Clin Pharmacol. 1997, 43 (2): 177-181.CrossRef Moride Y, Haramburu F, Requejo AA, Bégaud B: Under-reporting of adverse drug reactions in general practice. Br J of Clin Pharmacol. 1997, 43 (2): 177-181.CrossRef
32.
go back to reference Bégaud B, Martin K, Haramburu F, Moore N: Rates of spontaneous reporting of adverse drug reactions in France (letter). JAMA. 2002, 288 (13): 1588-1588. 10.1001/jama.288.13.1588.CrossRefPubMed Bégaud B, Martin K, Haramburu F, Moore N: Rates of spontaneous reporting of adverse drug reactions in France (letter). JAMA. 2002, 288 (13): 1588-1588. 10.1001/jama.288.13.1588.CrossRefPubMed
33.
go back to reference Tubert P, Bégaud B, Haramburu F, Lellouch J, Péré J-C: Power and weakness of spontaneous reporting: a probabilistic approach. J Clin Epidemiol. 1992, 45 (3): 283-286. 10.1016/0895-4356(92)90088-5.CrossRefPubMed Tubert P, Bégaud B, Haramburu F, Lellouch J, Péré J-C: Power and weakness of spontaneous reporting: a probabilistic approach. J Clin Epidemiol. 1992, 45 (3): 283-286. 10.1016/0895-4356(92)90088-5.CrossRefPubMed
34.
go back to reference Kalbfleisch JD, Lawless JF: Inference based on retrospective ascertainment: an analysis of the data on transfusion-related AIDS. J Am Stat Assoc. 1989, 84 (406): 360-372. 10.1080/01621459.1989.10478780.CrossRef Kalbfleisch JD, Lawless JF: Inference based on retrospective ascertainment: an analysis of the data on transfusion-related AIDS. J Am Stat Assoc. 1989, 84 (406): 360-372. 10.1080/01621459.1989.10478780.CrossRef
35.
go back to reference Colton T: Biased Sampling of Cohorts in Epidemiology.Encyclopedia of Biostatistics, Vol 1. Edited by: Armitage P, Colton T. 1998, Chichester: Wiley, 338-350. Colton T: Biased Sampling of Cohorts in Epidemiology.Encyclopedia of Biostatistics, Vol 1. Edited by: Armitage P, Colton T. 1998, Chichester: Wiley, 338-350.
36.
go back to reference Lawless JF: Statistical Models and Methods for Lifetime Data, 2nd Ed. 2003, Hokoben, New Jersey: Wiley Lawless JF: Statistical Models and Methods for Lifetime Data, 2nd Ed. 2003, Hokoben, New Jersey: Wiley
37.
go back to reference Keiding N: Nonparametric estimation under truncation.Encyclopedia of Statistical Sciences, Vol 14, 2nd Ed. 2006, Hokoben, New Jersey: Wiley, 8775-8777. Keiding N: Nonparametric estimation under truncation.Encyclopedia of Statistical Sciences, Vol 14, 2nd Ed. 2006, Hokoben, New Jersey: Wiley, 8775-8777.
38.
go back to reference Gürler Ü: Bivariate estimation with right-truncated data. J Am Stat Assoc. 1996, 91 (435): 1152-1165. Gürler Ü: Bivariate estimation with right-truncated data. J Am Stat Assoc. 1996, 91 (435): 1152-1165.
39.
go back to reference Gross ST, Huber-Carol C: Regression models for truncated survival data. Scandinavian J Stat. 1992, 193-213. Gross ST, Huber-Carol C: Regression models for truncated survival data. Scandinavian J Stat. 1992, 193-213.
Metadata
Title
Estimating time-to-onset of adverse drug reactions from spontaneous reporting databases
Authors
Fanny Leroy
Jean-Yves Dauxois
Hélène Théophile
Françoise Haramburu
Pascale Tubert-Bitter
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2014
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-14-17

Other articles of this Issue 1/2014

BMC Medical Research Methodology 1/2014 Go to the issue