Skip to main content
Top
Published in: International Journal of Clinical Pharmacy 4/2018

01-08-2018 | Research Article

Comparison of different methods for causality assessment of adverse drug reactions

Authors: Sapan Kumar Behera, Saibal Das, Alphienes Stanley Xavier, Srinivas Velupula, Selvarajan Sandhiya

Published in: International Journal of Clinical Pharmacy | Issue 4/2018

Login to get access

Abstract

Background The causality assessment of adverse drug reactions (ADRs) remains a challenge, and none of the different available method of causality assessment used for assessing adverse reactions has been universally accepted as the gold standard. Objective To examine the agreement and correlation among three broad approaches for causality assessment of ADRs viz. World Health Organization-Uppsala Monitoring Centre (WHO-UMC) system, Naranjo algorithm, and updated Logistic method. Setting ADR monitoring centre (AMC) of a tertiary care teaching hospital in India. Method A total of 230 cases of ADR from April 2017 to August 2017 were retrospectively analyzed by each of these three methods. The agreement among the different methods was calculated by Cohen’s kappa (κ), and Spearman’s correlation was used to find the correlation among these methods. Main outcome measures Cohen’s kappa value and Spearman’s correlation coefficient for comparison among the different methods. Results The Cohen’s κ used for analyzing the agreement between WHO-UMC system and Naranjo algorithm was 0.45, between WHO-UMC system and updated Logistic method was 0.405, and between Naranjo algorithm and updated Logistic method was 0.606. The Spearman’s correlation coefficient was 0.793 for Naranjo algorithm vs. updated Logistic method, 0.735 for WHO-UMC system vs. Naranjo algorithm, and 0.696 for WHO-UMC system vs. updated Logistic method. Conclusion Causality assessment based on objective measurements (scores and probabilities) like updated Logistic method and Naranjo algorithm are less prone to subjective variations compared to the WHO-UMC system which is based on expert judgement.
Literature
1.
go back to reference Théophile H, André M, Miremont-Salamé G, Arimone Y, Bégaud B. Comparison of three methods (an updated logistic probabilistic method, the Naranjo and Liverpool algorithms) for the evaluation of routine pharmacovigilance case reports using consensual expert judgement as reference. Drug Saf. 2013;36:1033–44.CrossRef Théophile H, André M, Miremont-Salamé G, Arimone Y, Bégaud B. Comparison of three methods (an updated logistic probabilistic method, the Naranjo and Liverpool algorithms) for the evaluation of routine pharmacovigilance case reports using consensual expert judgement as reference. Drug Saf. 2013;36:1033–44.CrossRef
2.
go back to reference Khan LM, Al-Harthi SE, Osman AM, Sattar MA, Ali AS. Dilemmas of the causality assessment tools in the diagnosis of adverse drug reactions. Saudi Pharm J SPJ Off Publ Saudi Pharm Soc. 2016;24:485–93. Khan LM, Al-Harthi SE, Osman AM, Sattar MA, Ali AS. Dilemmas of the causality assessment tools in the diagnosis of adverse drug reactions. Saudi Pharm J SPJ Off Publ Saudi Pharm Soc. 2016;24:485–93.
3.
go back to reference Hire RC, Kinage PJ, Gaikward NN. Causality assessment in pharmacovigilance: a step towards quality care. Sch J App Med Sci. 2013;1:386–92. Hire RC, Kinage PJ, Gaikward NN. Causality assessment in pharmacovigilance: a step towards quality care. Sch J App Med Sci. 2013;1:386–92.
4.
go back to reference Agbabiaka TB, Savovic J, Ernst E. Methods for causality assessment of adverse drug reactions: a systematic review. Drug Saf. 2008;31:21–38.CrossRef Agbabiaka TB, Savovic J, Ernst E. Methods for causality assessment of adverse drug reactions: a systematic review. Drug Saf. 2008;31:21–38.CrossRef
5.
go back to reference Wiholm BE. The Swedish drug-event assessment methods. Special workshop—regulatory. Drug Inf J. 1984;18:267–9.CrossRef Wiholm BE. The Swedish drug-event assessment methods. Special workshop—regulatory. Drug Inf J. 1984;18:267–9.CrossRef
6.
go back to reference Naidu RP. Causality assessment: a brief insight into practices in pharmaceutical industry. Perspect Clin Res. 2013;4(4):233–6.CrossRef Naidu RP. Causality assessment: a brief insight into practices in pharmaceutical industry. Perspect Clin Res. 2013;4(4):233–6.CrossRef
9.
go back to reference Thaker SJ, Sinha RS, Gogtay NJ, Thatte UM. Evaluation of inter-rater agreement between three causality assessment methods used in pharmacovigilance. J Pharmacol Pharmacother. 2016;7:31–3.CrossRef Thaker SJ, Sinha RS, Gogtay NJ, Thatte UM. Evaluation of inter-rater agreement between three causality assessment methods used in pharmacovigilance. J Pharmacol Pharmacother. 2016;7:31–3.CrossRef
10.
go back to reference Marante KB. The challenges of adverse drug reaction evaluation. J Pharmacovigilance. 2018;6(3):1–4 (in press).CrossRef Marante KB. The challenges of adverse drug reaction evaluation. J Pharmacovigilance. 2018;6(3):1–4 (in press).CrossRef
11.
go back to reference Lanctôt KL, Naranjo CA. Computer-assisted evaluation of adverse events using a Bayesian approach. J Clin Pharmacol. 1994;34:142–7.CrossRef Lanctôt KL, Naranjo CA. Computer-assisted evaluation of adverse events using a Bayesian approach. J Clin Pharmacol. 1994;34:142–7.CrossRef
12.
go back to reference Arimone Y, Bégaud B, Miremont-Salamé G, Fourrier-Réglat A, Molimard M, Moore N, et al. A new method for assessing drug causation provided agreement with experts’ judgment. J Clin Epidemiol. 2006;59(3):308–14.CrossRef Arimone Y, Bégaud B, Miremont-Salamé G, Fourrier-Réglat A, Molimard M, Moore N, et al. A new method for assessing drug causation provided agreement with experts’ judgment. J Clin Epidemiol. 2006;59(3):308–14.CrossRef
13.
go back to reference Théophile H, André M, Arimone Y, Haramburu F, Miremont-Salamé G, Bégaud B. An updated method improved the assessment of adverse drug reaction in routine pharmacovigilance. J Clin Epidemiol. 2012;65:1069–77.CrossRef Théophile H, André M, Arimone Y, Haramburu F, Miremont-Salamé G, Bégaud B. An updated method improved the assessment of adverse drug reaction in routine pharmacovigilance. J Clin Epidemiol. 2012;65:1069–77.CrossRef
14.
go back to reference Kyonen M, Folatre I, Lagos X, Vargas S. Comparison of two methods to assess causality of adverse drug reactions. Rev Med Chil. 2015;143:880–6.CrossRef Kyonen M, Folatre I, Lagos X, Vargas S. Comparison of two methods to assess causality of adverse drug reactions. Rev Med Chil. 2015;143:880–6.CrossRef
15.
go back to reference Kane-Gill SL, Forsberg EA, Verrico MM, Handler SM. Comparison of three pharmacovigilance algorithms in the ICU setting: a retrospective and prospective evaluation of ADRs. Drug Saf. 2012;35:645–53.CrossRef Kane-Gill SL, Forsberg EA, Verrico MM, Handler SM. Comparison of three pharmacovigilance algorithms in the ICU setting: a retrospective and prospective evaluation of ADRs. Drug Saf. 2012;35:645–53.CrossRef
16.
go back to reference Lucena MI, Camargo R, Andrade RJ, Perez-Sanchez CJ, Sanchez De La Cuesta F. Comparison of two clinical scales for causality assessment in hepatotoxicity. Hepatololgy. 2001;33:123–30.CrossRef Lucena MI, Camargo R, Andrade RJ, Perez-Sanchez CJ, Sanchez De La Cuesta F. Comparison of two clinical scales for causality assessment in hepatotoxicity. Hepatololgy. 2001;33:123–30.CrossRef
17.
go back to reference Mittal N, Gupta MC. Comparison of agreement and rational uses of the WHO and Naranjo adverse event causality assessment tools. J Pharmacol Pharmacother. 2015;6:91.CrossRef Mittal N, Gupta MC. Comparison of agreement and rational uses of the WHO and Naranjo adverse event causality assessment tools. J Pharmacol Pharmacother. 2015;6:91.CrossRef
18.
go back to reference Mouton JP, Mehta U, Rossiter DP, Maartens G, Cohen K. Interrater agreement of two adverse drug reaction causality assessment methods: a randomised comparison of the Liverpool adverse drug reaction causality assessment tool and the world health organization-uppsala monitoring centre system. PLoS ONE. 2017;12:e0172830.CrossRef Mouton JP, Mehta U, Rossiter DP, Maartens G, Cohen K. Interrater agreement of two adverse drug reaction causality assessment methods: a randomised comparison of the Liverpool adverse drug reaction causality assessment tool and the world health organization-uppsala monitoring centre system. PLoS ONE. 2017;12:e0172830.CrossRef
19.
go back to reference Son M-K, Lee Y-W, Jung H-Y, Yi S-W, Lee K-H, Kim S-U, et al. Comparison of the Naranjo and WHO-Uppsala Monitoring Centre criteria for causality assessment of adverse drug reactions. Korean J Med. 2008;74:181–7. Son M-K, Lee Y-W, Jung H-Y, Yi S-W, Lee K-H, Kim S-U, et al. Comparison of the Naranjo and WHO-Uppsala Monitoring Centre criteria for causality assessment of adverse drug reactions. Korean J Med. 2008;74:181–7.
20.
go back to reference Rehan HS, Chopra D, Kakkar AK. Causality assessment of spontaneously reported adverse drug events: comparison of WHO-UMC criteria and Naranjo probability scale. Int J Risk Saf Med. 2007;19:223–7. Rehan HS, Chopra D, Kakkar AK. Causality assessment of spontaneously reported adverse drug events: comparison of WHO-UMC criteria and Naranjo probability scale. Int J Risk Saf Med. 2007;19:223–7.
21.
go back to reference Sharma S, Gupta AK, Reddy GJ. Inter-rater and intra-rater agreement in causality assessment of adverse drug reactions: a comparative study of WHO-UMC versus Naranjo scale. Int J Res Med Sci. 2017;5:4389–94.CrossRef Sharma S, Gupta AK, Reddy GJ. Inter-rater and intra-rater agreement in causality assessment of adverse drug reactions: a comparative study of WHO-UMC versus Naranjo scale. Int J Res Med Sci. 2017;5:4389–94.CrossRef
22.
go back to reference Belhekar MN, Taur SR, Munshi RP. A study of agreement between the Naranjo algorithm and WHO-UMC criteria for causality assessment of adverse drug reactions. Indian J Pharmacol. 2014;46:117.CrossRef Belhekar MN, Taur SR, Munshi RP. A study of agreement between the Naranjo algorithm and WHO-UMC criteria for causality assessment of adverse drug reactions. Indian J Pharmacol. 2014;46:117.CrossRef
23.
go back to reference Varallo FR, Planeta CS, Herdeiro MT, Mastroianni PdeC. Imputation of adverse drug reactions: causality assessment in hospitals. PLoS ONE. 2017;12:e0171470.CrossRef Varallo FR, Planeta CS, Herdeiro MT, Mastroianni PdeC. Imputation of adverse drug reactions: causality assessment in hospitals. PLoS ONE. 2017;12:e0171470.CrossRef
24.
go back to reference Théophile H, Arimone Y, Miremont-Salamé G, Moore N, Fourrier-Réglat A, Haramburu F, et al. Comparison of three methods (consensual expert judgement, algorithmic and probabilistic approaches) of causality assessment of adverse drug reactions: an assessment using reports made to a French pharmacovigilance centre. Drug Saf. 2010;33:1045–54.CrossRef Théophile H, Arimone Y, Miremont-Salamé G, Moore N, Fourrier-Réglat A, Haramburu F, et al. Comparison of three methods (consensual expert judgement, algorithmic and probabilistic approaches) of causality assessment of adverse drug reactions: an assessment using reports made to a French pharmacovigilance centre. Drug Saf. 2010;33:1045–54.CrossRef
26.
go back to reference Naranjo CA, Busto U, Sellers EM, Sandor P, Ruiz I, Roberts EA, et al. A method for estimating the probability of adverse drug reactions. Clin Pharmacol Ther. 1981;30:239–45.CrossRef Naranjo CA, Busto U, Sellers EM, Sandor P, Ruiz I, Roberts EA, et al. A method for estimating the probability of adverse drug reactions. Clin Pharmacol Ther. 1981;30:239–45.CrossRef
28.
go back to reference Ganesan S, Sandhiya S, Reddy KC, Subrahmanyam DK, Adithan C. The impact of the educational intervention on knowledge, attitude, and practice of pharmacovigilance toward adverse drug reactions reporting among health-care professionals in a tertiary care hospital in South India. J Nat Sci Biol Med. 2017;8:203–9.CrossRef Ganesan S, Sandhiya S, Reddy KC, Subrahmanyam DK, Adithan C. The impact of the educational intervention on knowledge, attitude, and practice of pharmacovigilance toward adverse drug reactions reporting among health-care professionals in a tertiary care hospital in South India. J Nat Sci Biol Med. 2017;8:203–9.CrossRef
29.
go back to reference Palaniappan M, Selvarajan S, George M, Subramaniyan G, Dkhar SA, Pillai AA, et al. Pattern of adverse drug reactions reported with cardiovascular drugs in a tertiary care teaching hospital. J Clin Diagn Res. 2015;9:FC01-04. Palaniappan M, Selvarajan S, George M, Subramaniyan G, Dkhar SA, Pillai AA, et al. Pattern of adverse drug reactions reported with cardiovascular drugs in a tertiary care teaching hospital. J Clin Diagn Res. 2015;9:FC01-04.
30.
go back to reference Behera SK, Kishtapati CR, Gunaseelan V, Dubashi B, Chandrasekaran A, Selvarajan S. Chemotherapy induced adverse drug reactions in cancer patients in a tertiary care hospital in South India. J Young Pharm. 2017;9:593–7.CrossRef Behera SK, Kishtapati CR, Gunaseelan V, Dubashi B, Chandrasekaran A, Selvarajan S. Chemotherapy induced adverse drug reactions in cancer patients in a tertiary care hospital in South India. J Young Pharm. 2017;9:593–7.CrossRef
31.
go back to reference Davies EC, Rowe PH, James S, Nickless G, Ganguli A, Danjuma M, et al. An investigation of disagreement in causality assessment of adverse drug reactions. Pharm Med. 2011;25:17–24.CrossRef Davies EC, Rowe PH, James S, Nickless G, Ganguli A, Danjuma M, et al. An investigation of disagreement in causality assessment of adverse drug reactions. Pharm Med. 2011;25:17–24.CrossRef
32.
go back to reference Cantor AB. Sample-size calculations for Cohen’s Kappa. Psychol Methods. 1996;1:350–3.CrossRef Cantor AB. Sample-size calculations for Cohen’s Kappa. Psychol Methods. 1996;1:350–3.CrossRef
33.
go back to reference Byrt T. Sample-size calculations for Cohen’s kappa. Epidemiology. 1996;7:561.CrossRef Byrt T. Sample-size calculations for Cohen’s kappa. Epidemiology. 1996;7:561.CrossRef
34.
go back to reference Macedo AF, Marques FB, Ribeiro CF, Teixeira F. Causality assessment of adverse drug reactions: comparison of the results obtained from published decisional algorithms and from the evaluations of an expert panel, according to different levels of imputability. J Clin Pharm Ther. 2003;28:137–43.CrossRef Macedo AF, Marques FB, Ribeiro CF, Teixeira F. Causality assessment of adverse drug reactions: comparison of the results obtained from published decisional algorithms and from the evaluations of an expert panel, according to different levels of imputability. J Clin Pharm Ther. 2003;28:137–43.CrossRef
35.
go back to reference Lei H, Rehman A, Haq A. Adverse drug reaction reports in Malaysia: comparison of causality assessments. Malays J Pharm Sci. 2007;5:7–17. Lei H, Rehman A, Haq A. Adverse drug reaction reports in Malaysia: comparison of causality assessments. Malays J Pharm Sci. 2007;5:7–17.
Metadata
Title
Comparison of different methods for causality assessment of adverse drug reactions
Authors
Sapan Kumar Behera
Saibal Das
Alphienes Stanley Xavier
Srinivas Velupula
Selvarajan Sandhiya
Publication date
01-08-2018
Publisher
Springer International Publishing
Published in
International Journal of Clinical Pharmacy / Issue 4/2018
Print ISSN: 2210-7703
Electronic ISSN: 2210-7711
DOI
https://doi.org/10.1007/s11096-018-0694-9

Other articles of this Issue 4/2018

International Journal of Clinical Pharmacy 4/2018 Go to the issue