Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2019

Open Access 01-12-2019 | Antibiotic | Research article

Risk factor analysis of device-related infections: value of re-sampling method on the real-world imbalanced dataset

Authors: Xiang-Fei Feng, Ling-Chao Yang, Li-Zhuang Tan, Yi-Gang Li

Published in: BMC Medical Informatics and Decision Making | Issue 1/2019

Login to get access

Abstract

Background

The incidence of cardiac implantable electronic device infection (CIEDI) is low and usually belongs to the typical imbalanced dataset. We sought to describe our experience on the management of the imbalanced CIEDI dataset.

Methods

Database from two centers of patients undergoing device implantation from 2001 to 2016 were reviewed retrospectively. Re-sampling technique was used to improve the classifier accuracy.

Results

CIEDI was identified in 28 out of 4959 procedures (0.56%); a high imbalance existed in the sizes of the patient profiles. In univariate analyses, replacement procedure and male were significantly associated with an increase in CIEDI: (53.6% vs. 23.4, 0.8% vs. 0.3%, P < 0.01). Multivariate logistic regression analysis showed that gender (odds ratio, OR = 3.503), age (OR = 1.032), replacement procedure (OR = 3.503), and use of antibiotics (OR = 0.250) remained as independent predictors of CIEDI (all P < 0.05) after adjustment for diabetes, post-operation fever, and device style, device company.
There were 616 under-sampled cases and 123 over-sampled cases in the analyzed cohort after re-sampling. The re-sampling and bootstrap results were robust and largely like the analysis results prior re-sampling method, while use of antibiotics lost the predicting capacity for CIEDI after re-sampling technique (P > 0.05).

Conclusion

The application of re-sampling techniques can generate useful synthetic samples for the classification of imbalanced data and improve the accuracy of predicting efficacy of CIEDI. The peri-operative assessment should be intensified in male and aged patients as well as patients receiving replacement procedures for the risk of CIEDI.
Literature
1.
go back to reference Traykov V, Bongiorni MG, Boriani G, Burri H, Costa R, Dagres N, Deharo JC, Epstein LM, Erba PA, Snygg-Martin U, et al. Clinical practice and implementation of guidelines for the prevention, diagnosis and management of cardiac implantable electronic device infections: results of a worldwide survey under the auspices of the European heart rhythm association. Europace. 2019;21(8):1270–9.CrossRef Traykov V, Bongiorni MG, Boriani G, Burri H, Costa R, Dagres N, Deharo JC, Epstein LM, Erba PA, Snygg-Martin U, et al. Clinical practice and implementation of guidelines for the prevention, diagnosis and management of cardiac implantable electronic device infections: results of a worldwide survey under the auspices of the European heart rhythm association. Europace. 2019;21(8):1270–9.CrossRef
2.
go back to reference Oh S, Lee MS, Zhang BT. Ensemble learning with active example selection for imbalanced biomedical data classification. IEEE/ACM Trans Comput Biol Bioinform. 2011;8(2):316–25.CrossRef Oh S, Lee MS, Zhang BT. Ensemble learning with active example selection for imbalanced biomedical data classification. IEEE/ACM Trans Comput Biol Bioinform. 2011;8(2):316–25.CrossRef
3.
go back to reference King G, Zeng L. Logistic regression in rare events data. Polit Anal. 2001;9(2):137–63.CrossRef King G, Zeng L. Logistic regression in rare events data. Polit Anal. 2001;9(2):137–63.CrossRef
4.
go back to reference Ranjan C, Mustonen M, Paynabar K, Pourak K. Dataset: rare event classification in multivariate time series. arXiv. 2018;1809:10717. Ranjan C, Mustonen M, Paynabar K, Pourak K. Dataset: rare event classification in multivariate time series. arXiv. 2018;1809:10717.
5.
go back to reference Santos MS, Abreu PH, Garcia-Laencina PJ, Simao A, Carvalho A. A new cluster-based oversampling method for improving survival prediction of hepatocellular carcinoma patients. J Biomed Inform. 2015;58(12):49–59.CrossRef Santos MS, Abreu PH, Garcia-Laencina PJ, Simao A, Carvalho A. A new cluster-based oversampling method for improving survival prediction of hepatocellular carcinoma patients. J Biomed Inform. 2015;58(12):49–59.CrossRef
6.
go back to reference López V, Fernández A, García S, Palade V, Herrera F. An insight into classification with imbalanced data: empirical results and current trends on using data intrinsic characteristics. Inf Sci. 2013;250(11):113–41.CrossRef López V, Fernández A, García S, Palade V, Herrera F. An insight into classification with imbalanced data: empirical results and current trends on using data intrinsic characteristics. Inf Sci. 2013;250(11):113–41.CrossRef
7.
go back to reference He H, Garcia EA. Learning from Imbalanced Data. IEEE Transactions on Knowledge and Data Engineering. 2009;21(9):1263–84.CrossRef He H, Garcia EA. Learning from Imbalanced Data. IEEE Transactions on Knowledge and Data Engineering. 2009;21(9):1263–84.CrossRef
8.
go back to reference Maalouf M, Siddiqi M. Weighted logistic regression for large-scale imbalanced and rare events data. Knowl-Based Syst. 2014;59(15):142–8.CrossRef Maalouf M, Siddiqi M. Weighted logistic regression for large-scale imbalanced and rare events data. Knowl-Based Syst. 2014;59(15):142–8.CrossRef
9.
go back to reference Nakamura M, Kajiwara Y, Otsuka A, Kimura H. LVQ-SMOTE - learning vector quantization based synthetic minority over-sampling technique for biomedical data. BioData Min. 2013;6(1):16.CrossRef Nakamura M, Kajiwara Y, Otsuka A, Kimura H. LVQ-SMOTE - learning vector quantization based synthetic minority over-sampling technique for biomedical data. BioData Min. 2013;6(1):16.CrossRef
10.
go back to reference Gong R, Huang SH. A Kolmogorov–Smirnov statistic based segmentation approach to learning from imbalanced datasets: with application in property refinance prediction. Expert Syst Appl. 2012;39(6):6192–200.CrossRef Gong R, Huang SH. A Kolmogorov–Smirnov statistic based segmentation approach to learning from imbalanced datasets: with application in property refinance prediction. Expert Syst Appl. 2012;39(6):6192–200.CrossRef
11.
go back to reference de Oliveira JC, Martinelli M, Nishioka SA, Varejao T, Uipe D, Pedrosa AA, Costa R, D'Avila A, Danik SB. Efficacy of antibiotic prophylaxis before the implantation of pacemakers and cardioverter-defibrillators: results of a large, prospective, randomized, double-blinded, placebo-controlled trial. Circ Arrhythm Electrophysiol. 2009;2(1):29–34.CrossRef de Oliveira JC, Martinelli M, Nishioka SA, Varejao T, Uipe D, Pedrosa AA, Costa R, D'Avila A, Danik SB. Efficacy of antibiotic prophylaxis before the implantation of pacemakers and cardioverter-defibrillators: results of a large, prospective, randomized, double-blinded, placebo-controlled trial. Circ Arrhythm Electrophysiol. 2009;2(1):29–34.CrossRef
12.
go back to reference Sandoe JA, Barlow G, Chambers JB, Gammage M, Guleri A, Howard P, Olson E, Perry JD, Prendergast BD, Spry MJ, et al. Guidelines for the diagnosis, prevention and management of implantable cardiac electronic device infection. Report of a joint Working Party project on behalf of the British Society for Antimicrobial Chemotherapy (BSAC, host organization), British Heart Rhythm Society (BHRS), British Cardiovascular Society (BCS), British Heart Valve Society (BHVS) and British Society for Echocardiography (BSE). J Antimicrob Chemother. 2015;70(2):325–59.CrossRef Sandoe JA, Barlow G, Chambers JB, Gammage M, Guleri A, Howard P, Olson E, Perry JD, Prendergast BD, Spry MJ, et al. Guidelines for the diagnosis, prevention and management of implantable cardiac electronic device infection. Report of a joint Working Party project on behalf of the British Society for Antimicrobial Chemotherapy (BSAC, host organization), British Heart Rhythm Society (BHRS), British Cardiovascular Society (BCS), British Heart Valve Society (BHVS) and British Society for Echocardiography (BSE). J Antimicrob Chemother. 2015;70(2):325–59.CrossRef
13.
go back to reference Wilkoff BL, Love CJ, Byrd CL, Bongiorni MG, Carrillo RG, Crossley GH 3rd, Epstein LM, Friedman RA, Kennergren CE, Mitkowski P, et al. Transvenous lead extraction: Heart Rhythm Society expert consensus on facilities, training, indications, and patient management: this document was endorsed by the American Heart Association (AHA). Heart Rhythm. 2009;6(7):1085–104.CrossRef Wilkoff BL, Love CJ, Byrd CL, Bongiorni MG, Carrillo RG, Crossley GH 3rd, Epstein LM, Friedman RA, Kennergren CE, Mitkowski P, et al. Transvenous lead extraction: Heart Rhythm Society expert consensus on facilities, training, indications, and patient management: this document was endorsed by the American Heart Association (AHA). Heart Rhythm. 2009;6(7):1085–104.CrossRef
14.
go back to reference Gomes S, Cranney G, Bennett M, Giles R. Lead extraction for treatment of cardiac device infection: a 20-year single Centre experience. Heart Lung Circ. 2017;26(3):240–5.CrossRef Gomes S, Cranney G, Bennett M, Giles R. Lead extraction for treatment of cardiac device infection: a 20-year single Centre experience. Heart Lung Circ. 2017;26(3):240–5.CrossRef
15.
go back to reference Johansen JB, Jorgensen OD, Moller M, Arnsbo P, Mortensen PT, Nielsen JC. Infection after pacemaker implantation: infection rates and risk factors associated with infection in a population-based cohort study of 46299 consecutive patients. Eur Heart J. 2011;32(8):991–8.CrossRef Johansen JB, Jorgensen OD, Moller M, Arnsbo P, Mortensen PT, Nielsen JC. Infection after pacemaker implantation: infection rates and risk factors associated with infection in a population-based cohort study of 46299 consecutive patients. Eur Heart J. 2011;32(8):991–8.CrossRef
16.
go back to reference Walters SJ, Campbell MJ. The use of bootstrap methods for estimating sample size and analysing health-related quality of life outcomes. Stat Med. 2005;24(7):1075–102.CrossRef Walters SJ, Campbell MJ. The use of bootstrap methods for estimating sample size and analysing health-related quality of life outcomes. Stat Med. 2005;24(7):1075–102.CrossRef
17.
go back to reference Chougrad H, Zouaki H, Alheyane O. Deep convolutional neural networks for breast cancer screening. Comput Methods Prog Biomed. 2018;157(4):19–30.CrossRef Chougrad H, Zouaki H, Alheyane O. Deep convolutional neural networks for breast cancer screening. Comput Methods Prog Biomed. 2018;157(4):19–30.CrossRef
18.
go back to reference Khalilia M, Chakraborty S, Popescu M. Predicting disease risks from highly imbalanced data using random forest. BMC Med Inform Decis Mak. 2011;11(1):51.CrossRef Khalilia M, Chakraborty S, Popescu M. Predicting disease risks from highly imbalanced data using random forest. BMC Med Inform Decis Mak. 2011;11(1):51.CrossRef
19.
go back to reference Xu G, Zhang M, Zhu H, Xu J. A 15-gene signature for prediction of colon cancer recurrence and prognosis based on SVM. Gene. 2017;604(3):33–40.CrossRef Xu G, Zhang M, Zhu H, Xu J. A 15-gene signature for prediction of colon cancer recurrence and prognosis based on SVM. Gene. 2017;604(3):33–40.CrossRef
20.
go back to reference Sohail MR, Henrikson CA, Braid-Forbes MJ, Forbes KF, Lerner DJ. Mortality and cost associated with cardiovascular implantable electronic device infections. Arch Intern Med. 2011;171(20):1821–8.CrossRef Sohail MR, Henrikson CA, Braid-Forbes MJ, Forbes KF, Lerner DJ. Mortality and cost associated with cardiovascular implantable electronic device infections. Arch Intern Med. 2011;171(20):1821–8.CrossRef
21.
go back to reference Joy PS, Kumar G, Poole JE, London B, Olshansky B. Cardiac implantable electronic device infections: who is at greatest risk? Heart Rhythm. 2017;14(6):839–45.CrossRef Joy PS, Kumar G, Poole JE, London B, Olshansky B. Cardiac implantable electronic device infections: who is at greatest risk? Heart Rhythm. 2017;14(6):839–45.CrossRef
22.
go back to reference Khan SH, Hayat M, Bennamoun M, Sohel FA, Togneri R. Cost-sensitive learning of deep feature representations from imbalanced data. IEEE Trans Neural Netw Learn Syst. 2018;29(8):3573–87.CrossRef Khan SH, Hayat M, Bennamoun M, Sohel FA, Togneri R. Cost-sensitive learning of deep feature representations from imbalanced data. IEEE Trans Neural Netw Learn Syst. 2018;29(8):3573–87.CrossRef
23.
go back to reference Lin YS, Chen TH, Hung SP, Chen DY, Mao CT, Tsai ML, Chang ST, Wang CC, Wen MS, Chen MC. Impact of pacemaker lead characteristics on pacemaker related infection and heart perforation: a nationwide population-based cohort study. PLoS One. 2015;10(6):e0128320.CrossRef Lin YS, Chen TH, Hung SP, Chen DY, Mao CT, Tsai ML, Chang ST, Wang CC, Wen MS, Chen MC. Impact of pacemaker lead characteristics on pacemaker related infection and heart perforation: a nationwide population-based cohort study. PLoS One. 2015;10(6):e0128320.CrossRef
24.
go back to reference Nery PB, Fernandes R, Nair GM, Sumner GL, Ribas CS, Menon SM, Wang X, Krahn AD, Morillo CA, Connolly SJ, et al. Device-related infection among patients with pacemakers and implantable defibrillators: incidence, risk factors, and consequences. J Cardiovasc Electrophysiol. 2010;21(7):786–90.PubMed Nery PB, Fernandes R, Nair GM, Sumner GL, Ribas CS, Menon SM, Wang X, Krahn AD, Morillo CA, Connolly SJ, et al. Device-related infection among patients with pacemakers and implantable defibrillators: incidence, risk factors, and consequences. J Cardiovasc Electrophysiol. 2010;21(7):786–90.PubMed
25.
go back to reference Klug D, Balde M, Pavin D, Hidden-Lucet F, Clementy J, Sadoul N, Rey JL, Lande G, Lazarus A, Victor J, et al. Risk factors related to infections of implanted pacemakers and cardioverter-defibrillators: results of a large prospective study. Circulation. 2007;116(12):1349–55.CrossRef Klug D, Balde M, Pavin D, Hidden-Lucet F, Clementy J, Sadoul N, Rey JL, Lande G, Lazarus A, Victor J, et al. Risk factors related to infections of implanted pacemakers and cardioverter-defibrillators: results of a large prospective study. Circulation. 2007;116(12):1349–55.CrossRef
26.
go back to reference Klug D, Wallet F, Lacroix D, Marquie C, Kouakam C, Kacet S, Courcol R. Local symptoms at the site of pacemaker implantation indicate latent systemic infection. Heart. 2004;90(8):882–6.CrossRef Klug D, Wallet F, Lacroix D, Marquie C, Kouakam C, Kacet S, Courcol R. Local symptoms at the site of pacemaker implantation indicate latent systemic infection. Heart. 2004;90(8):882–6.CrossRef
27.
go back to reference Dwivedi SK, Saran RK, Khera P, Tripathi N, Kochar AK, Narain VS, Puri VK. Short-term (48 hours) versus long-term (7 days) antibiotic prophylaxis for permanent pacemaker implantation. Indian Heart J. 2001;53(6):740–2.PubMed Dwivedi SK, Saran RK, Khera P, Tripathi N, Kochar AK, Narain VS, Puri VK. Short-term (48 hours) versus long-term (7 days) antibiotic prophylaxis for permanent pacemaker implantation. Indian Heart J. 2001;53(6):740–2.PubMed
28.
go back to reference Senaratne JM, Jayasuriya A, Irwin M, Gulamhusein S, Senaratne MP. A 19-year study on pacemaker-related infections: a claim for using postoperative antibiotics. Pacing Clin Electrophysiol. 2014;37(8):947–54.CrossRef Senaratne JM, Jayasuriya A, Irwin M, Gulamhusein S, Senaratne MP. A 19-year study on pacemaker-related infections: a claim for using postoperative antibiotics. Pacing Clin Electrophysiol. 2014;37(8):947–54.CrossRef
29.
go back to reference Baddour LM, Epstein AE, Erickson CC, Knight BP, Levison ME, Lockhart PB, Masoudi FA, Okum EJ, Wilson WR, Beerman LB, et al. Update on cardiovascular implantable electronic device infections and their management: a scientific statement from the American Heart Association. Circulation. 2010;121(3):458–77.CrossRef Baddour LM, Epstein AE, Erickson CC, Knight BP, Levison ME, Lockhart PB, Masoudi FA, Okum EJ, Wilson WR, Beerman LB, et al. Update on cardiovascular implantable electronic device infections and their management: a scientific statement from the American Heart Association. Circulation. 2010;121(3):458–77.CrossRef
30.
go back to reference Uslan DZ, Sohail MR, St Sauver JL, Friedman PA, Hayes DL, Stoner SM, Wilson WR, Steckelberg JM, Baddour LM. Permanent pacemaker and implantable cardioverter defibrillator infection: a population-based study. Arch Intern Med. 2007;167(7):669–75.CrossRef Uslan DZ, Sohail MR, St Sauver JL, Friedman PA, Hayes DL, Stoner SM, Wilson WR, Steckelberg JM, Baddour LM. Permanent pacemaker and implantable cardioverter defibrillator infection: a population-based study. Arch Intern Med. 2007;167(7):669–75.CrossRef
31.
go back to reference Lekkerkerker JC, van Nieuwkoop C, Trines SA, van der Bom JG, Bernards A, van de Velde ET, Bootsma M, Zeppenfeld K, Jukema JW, Borleffs JW, et al. Risk factors and time delay associated with cardiac device infections: Leiden device registry. Heart. 2009;95(9):715–20.CrossRef Lekkerkerker JC, van Nieuwkoop C, Trines SA, van der Bom JG, Bernards A, van de Velde ET, Bootsma M, Zeppenfeld K, Jukema JW, Borleffs JW, et al. Risk factors and time delay associated with cardiac device infections: Leiden device registry. Heart. 2009;95(9):715–20.CrossRef
32.
go back to reference Buda M, Maki A, Mazurowski MA. A systematic study of the class imbalance problem in convolutional neural networks. Neural Netw. 2018;106(10):249–59.CrossRef Buda M, Maki A, Mazurowski MA. A systematic study of the class imbalance problem in convolutional neural networks. Neural Netw. 2018;106(10):249–59.CrossRef
Metadata
Title
Risk factor analysis of device-related infections: value of re-sampling method on the real-world imbalanced dataset
Authors
Xiang-Fei Feng
Ling-Chao Yang
Li-Zhuang Tan
Yi-Gang Li
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2019
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-019-0899-4

Other articles of this Issue 1/2019

BMC Medical Informatics and Decision Making 1/2019 Go to the issue