Skip to main content
Top
Published in: Drug Safety 3/2003

01-03-2003 | Review Article

Quantitative Methods in Pharmacovigilance

Focus on Signal Detection

Authors: Dr Manfred Hauben, Xiaofeng Zhou

Published in: Drug Safety | Issue 3/2003

Login to get access

Abstract

Pharmacovigilance serves to detect previously unrecognised adverse events associated with the use of medicines. The simplest method for detecting signals of such events is crude inspection of lists of spontaneously reported drug-event combinations. Quantitative and automated numerator-based methods such as Bayesian data mining can supplement or supplant these methods. The theoretical basis and limitations of these methods should be understood by drug safety professionals, and automated methods should not be automatically accepted. Published evaluations of these techniques are mainly limited to large regulatory databases, and performance characteristics may differ in smaller safety databases of drug developers. Head-to-head comparisons of the major techniques have not been published. Regardless of previous statistical training, pharmacovigilance practitioners should understand how these methods work. The mathematical basis of these techniques should not obscure the numerous confounders and biases inherent in the data. This article seeks to make automated signal detection methods transparent to drug safety professionals of various backgrounds. This is accomplished by first providing a brief overview of the evolution of signal detection followed by a series of sections devoted to the methods with the greatest utilisation and evidentiary support: proportional reporting rations, the Bayesian Confidence Propagation Neural Network and empirical Bayes screening. Sophisticated yet intuitive explanations are provided for each method, supported by figures in which the underlying statistical concepts are explored. Finally the strengths, limitations, pitfalls and outstanding unresolved issues are discussed. Pharmacovigilance specialists should not be intimidated by the mathematics. Understanding the theoretical basis of these methods should enhance the effective assessment and possible implementation of these techniques by drug safety professionals.
Literature
1.
go back to reference Meyboom RHB, Egberts ACG, Edwards IR, et al. Principles of signal detection in pharmacovigilance. Drug Saf 1997; 16(6): 355–65PubMedCrossRef Meyboom RHB, Egberts ACG, Edwards IR, et al. Principles of signal detection in pharmacovigilance. Drug Saf 1997; 16(6): 355–65PubMedCrossRef
2.
3.
go back to reference Lindquist M, Stahl M, Bate A, et al. A retrospective evaluation of a data mining approach to aid finding new adverse drug reaction signals in the WHO database. Drug Saf 2000; 23(6): 533–42PubMedCrossRef Lindquist M, Stahl M, Bate A, et al. A retrospective evaluation of a data mining approach to aid finding new adverse drug reaction signals in the WHO database. Drug Saf 2000; 23(6): 533–42PubMedCrossRef
4.
go back to reference Kaufman DW, Rosenberg L, Mitchell A. Signal generation and clarification: use of case-control data. Pharmacoepidemiol Drug Saf 2001; 10: 197–203PubMedCrossRef Kaufman DW, Rosenberg L, Mitchell A. Signal generation and clarification: use of case-control data. Pharmacoepidemiol Drug Saf 2001; 10: 197–203PubMedCrossRef
5.
6.
go back to reference Lindquist M, Edwards IR, Bate A, et al. From association to alert: a revised approach to international signal analysis. Pharmacoepidemiol Drug Saf 1999; 8: S15–25PubMedCrossRef Lindquist M, Edwards IR, Bate A, et al. From association to alert: a revised approach to international signal analysis. Pharmacoepidemiol Drug Saf 1999; 8: S15–25PubMedCrossRef
7.
go back to reference Evans SJW, Waller P, Davis S. Proportional reporting ratios: the use of epidemiological methods for signal detection [abstract]. Pharmacoepidemiol Drug Saf 1998; 7Suppl. 2: S102 Evans SJW, Waller P, Davis S. Proportional reporting ratios: the use of epidemiological methods for signal detection [abstract]. Pharmacoepidemiol Drug Saf 1998; 7Suppl. 2: S102
8.
go back to reference Evans SJW, Waller PC, Davis S. Use of proportional reporting ratios for signal generation from spontaneous adverse drug reaction reports. Pharmacoepidemiol Drug Saf 2001; 10: 483–6PubMedCrossRef Evans SJW, Waller PC, Davis S. Use of proportional reporting ratios for signal generation from spontaneous adverse drug reaction reports. Pharmacoepidemiol Drug Saf 2001; 10: 483–6PubMedCrossRef
9.
go back to reference Heeley EL, Wilton LV, Shakir SAW. The use of proportional reporting rations for signal generation in prescription event monitoring [abstract]. Pharmacoepidemiol Drug Saf 2002; 10(S1): S48 Heeley EL, Wilton LV, Shakir SAW. The use of proportional reporting rations for signal generation in prescription event monitoring [abstract]. Pharmacoepidemiol Drug Saf 2002; 10(S1): S48
10.
go back to reference Kilgour-Christie J, Czarnecki A, Simmons V. Proportional reporting ratio calculations from a pharmaceutical company database [abstract]. Pharmacoepidemiol Drug Saf 2001; 10: S159 Kilgour-Christie J, Czarnecki A, Simmons V. Proportional reporting ratio calculations from a pharmaceutical company database [abstract]. Pharmacoepidemiol Drug Saf 2001; 10: S159
11.
go back to reference DuMouchel W. Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system. Am Stat 1999; 53(3): 177–90 DuMouchel W. Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system. Am Stat 1999; 53(3): 177–90
12.
go back to reference O’Neill RT, Szarfman A. Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system [discussion]. Am Stat 1999; 53(3): 190–5 O’Neill RT, Szarfman A. Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system [discussion]. Am Stat 1999; 53(3): 190–5
13.
go back to reference Louis TA, Shen W. Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system [discussion]. Am Stat 1999; 53(3): 196–8 Louis TA, Shen W. Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system [discussion]. Am Stat 1999; 53(3): 196–8
14.
go back to reference Madigan D. Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system [discussion]. Am Stat 1999; 53(3): 198–200 Madigan D. Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system [discussion]. Am Stat 1999; 53(3): 198–200
15.
go back to reference DuMouchel W. Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system [reply]. Am Stat 1999; 53(3): 201–2 DuMouchel W. Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system [reply]. Am Stat 1999; 53(3): 201–2
16.
go back to reference Praus M, Schindel F, Fescharek R, et al. Alert systems for postmarketing surveillance of adverse drug reactions. Stat Med 1993; 12: 2383–93PubMedCrossRef Praus M, Schindel F, Fescharek R, et al. Alert systems for postmarketing surveillance of adverse drug reactions. Stat Med 1993; 12: 2383–93PubMedCrossRef
17.
go back to reference Shore DL, Quade D. A surveillance system based on a short memory scheme. Stat Med 1989; 8: 311–22PubMedCrossRef Shore DL, Quade D. A surveillance system based on a short memory scheme. Stat Med 1989; 8: 311–22PubMedCrossRef
18.
go back to reference Norwood PK, Sampson AR. A statistical methodology for postmarketing surveillance of adverse drug reaction reports. Stat Med 1988; 7: 1023–30PubMedCrossRef Norwood PK, Sampson AR. A statistical methodology for postmarketing surveillance of adverse drug reaction reports. Stat Med 1988; 7: 1023–30PubMedCrossRef
19.
go back to reference Parker RA. Analysis of surveillance data with Poisson regression: a case study. Stat Med 1989; 8: 285–94PubMedCrossRef Parker RA. Analysis of surveillance data with Poisson regression: a case study. Stat Med 1989; 8: 285–94PubMedCrossRef
20.
go back to reference Tubert P, Begaud B, Haramburu F, et al. Spontaneous reporting: how many cases are required to trigger a warning? Br J Clin Pharmacol 1991; 32: 407–8PubMedCrossRef Tubert P, Begaud B, Haramburu F, et al. Spontaneous reporting: how many cases are required to trigger a warning? Br J Clin Pharmacol 1991; 32: 407–8PubMedCrossRef
21.
go back to reference Schroeder DR. Detecting a rare adverse drug reaction using spontaneous reports [statistics]. Reg Anesth Pain Med 1998; 2: 183–9 Schroeder DR. Detecting a rare adverse drug reaction using spontaneous reports [statistics]. Reg Anesth Pain Med 1998; 2: 183–9
22.
go back to reference Purcell P, Barty S. Statistical techniques for signal generation: the Australian experience. Drug Saf 2002; 25(6): 415–21PubMedCrossRef Purcell P, Barty S. Statistical techniques for signal generation: the Australian experience. Drug Saf 2002; 25(6): 415–21PubMedCrossRef
23.
go back to reference Heeley E, Wilton L, Shakir A. Automated signal generation in prescription event monitoring. Drug Saf 2002; 25(6): 423–32PubMedCrossRef Heeley E, Wilton L, Shakir A. Automated signal generation in prescription event monitoring. Drug Saf 2002; 25(6): 423–32PubMedCrossRef
24.
go back to reference Evans S. Statistical and epidemiological principles in detecting signals of adverse drug reactions. Drug Information Association 38th Annual Meeting; 2002 Jun 16-20: Chicago (IL) Evans S. Statistical and epidemiological principles in detecting signals of adverse drug reactions. Drug Information Association 38th Annual Meeting; 2002 Jun 16-20: Chicago (IL)
25.
go back to reference Code of Federal Regulations (CFR). Parts 310, 314, and 600 [online]. Available from URL: http://www.access.gpo.gov/cgibin/cfrassemble.cgi?title=200221 [Accessed 2003 Jan 28] Code of Federal Regulations (CFR). Parts 310, 314, and 600 [online]. Available from URL: http://​www.​access.​gpo.​gov/​cgibin/​cfrassemble.​cgi?​title=​200221 [Accessed 2003 Jan 28]
26.
go back to reference Clark JA, Berk RH, Klincewitz SL. Calculation of the probability of multiplicities in two cell-occupancy models: implications for spontaneous reporting systems. Drug Inf J 1999; 33: 1195–203CrossRef Clark JA, Berk RH, Klincewitz SL. Calculation of the probability of multiplicities in two cell-occupancy models: implications for spontaneous reporting systems. Drug Inf J 1999; 33: 1195–203CrossRef
27.
go back to reference Begaud B, Moride Y, Tubert-Bitter P, et al. False positives in spontaneous reporting: should we worry about them? Br J Clin Pharmacol 1994; 38: 401–4PubMedCrossRef Begaud B, Moride Y, Tubert-Bitter P, et al. False positives in spontaneous reporting: should we worry about them? Br J Clin Pharmacol 1994; 38: 401–4PubMedCrossRef
28.
go back to reference Kwong K, Sammon J, Hornbuckle K, et al. A novel method for detecting potential drug-drug interactions using post-marketing adverse event database [abstract]. Pharmacoepidemiol Drug Saf 2001; 10(S1): S39 Kwong K, Sammon J, Hornbuckle K, et al. A novel method for detecting potential drug-drug interactions using post-marketing adverse event database [abstract]. Pharmacoepidemiol Drug Saf 2001; 10(S1): S39
29.
go back to reference O’Neill RT, Szarfman A. Some US Food and Drug Administration perspectives on data mining for pediatric safety assessment. Curr Ther Res Clin Exp 2001; 62: 650–63CrossRef O’Neill RT, Szarfman A. Some US Food and Drug Administration perspectives on data mining for pediatric safety assessment. Curr Ther Res Clin Exp 2001; 62: 650–63CrossRef
30.
go back to reference A new strategy for detection of signals in the WHO database 2002. Uppsala Reports 2001 Nov; 17: 8–9 A new strategy for detection of signals in the WHO database 2002. Uppsala Reports 2001 Nov; 17: 8–9
31.
go back to reference Szarfman A, Machado GS, O’Neill RT. Screening algorithms and computer systems to efficiently signal higher-than expected combinations of drugs and events in FDA’s spontaneous reports database. Drug Saf 2002; 25(6): 381–92PubMedCrossRef Szarfman A, Machado GS, O’Neill RT. Screening algorithms and computer systems to efficiently signal higher-than expected combinations of drugs and events in FDA’s spontaneous reports database. Drug Saf 2002; 25(6): 381–92PubMedCrossRef
32.
go back to reference Thakrar BT, Blesch KS, Sacks ST, et al. On technical methods of signal detection [abstract]. Pharmacoepidemiol Drug Saf 2001; 10(S1): S98 Thakrar BT, Blesch KS, Sacks ST, et al. On technical methods of signal detection [abstract]. Pharmacoepidemiol Drug Saf 2001; 10(S1): S98
33.
go back to reference Van Puijenbroek E, Bate A, Leufkens H, et al. A comparison of measures of disproportionality for signal detection in spontaneous reporting systems for adverse drug reactions. Pharmacoepidemiol Drug Saf 2002; 11: 3–10PubMedCrossRef Van Puijenbroek E, Bate A, Leufkens H, et al. A comparison of measures of disproportionality for signal detection in spontaneous reporting systems for adverse drug reactions. Pharmacoepidemiol Drug Saf 2002; 11: 3–10PubMedCrossRef
34.
go back to reference Coulter DM, Bate A, Meyboom R, et al. Antipsychotic drugs and heart muscle disorder in international pharmacovigilance: data mining study. BMJ 2001; 232: 1207–9CrossRef Coulter DM, Bate A, Meyboom R, et al. Antipsychotic drugs and heart muscle disorder in international pharmacovigilance: data mining study. BMJ 2001; 232: 1207–9CrossRef
35.
go back to reference Bate A, Lindquist M, Edwards IR. Pattern recognition using a recurrent neural network and its application to the WHO database [abstract]. 17th International Society for Pharmacoepidemiology; 2001 Aug 23-26; Toronto, Canada Bate A, Lindquist M, Edwards IR. Pattern recognition using a recurrent neural network and its application to the WHO database [abstract]. 17th International Society for Pharmacoepidemiology; 2001 Aug 23-26; Toronto, Canada
36.
go back to reference DuMouchel W, Pregibon D. Empirical Bayes screening for multi-item associations. Proc. KDD. San Diego (CA): ACM Press, 2001 DuMouchel W, Pregibon D. Empirical Bayes screening for multi-item associations. Proc. KDD. San Diego (CA): ACM Press, 2001
Metadata
Title
Quantitative Methods in Pharmacovigilance
Focus on Signal Detection
Authors
Dr Manfred Hauben
Xiaofeng Zhou
Publication date
01-03-2003
Publisher
Springer International Publishing
Published in
Drug Safety / Issue 3/2003
Print ISSN: 0114-5916
Electronic ISSN: 1179-1942
DOI
https://doi.org/10.2165/00002018-200326030-00003

Other articles of this Issue 3/2003

Drug Safety 3/2003 Go to the issue