Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2012

Open Access 01-12-2012 | Research article

Is increasing complexity of algorithms the price for higher accuracy? virtual comparison of three algorithms for tertiary level management of chronic cough in people living with HIV in a low-income country

Authors: Constance Mukabatsinda, Jasmine Nguyen, Bettina Bisig, Lutgarde Lynen, Yerma D Coppens, Anita Asiimwe, Jef Van den Ende

Published in: BMC Medical Informatics and Decision Making | Issue 1/2012

Login to get access

Abstract

Background

The algorithmic approach to guidelines has been introduced and promoted on a large scale since the 1970s. This study aims at comparing the performance of three algorithms for the management of chronic cough in patients with HIV infection, and at reassessing the current position of algorithmic guidelines in clinical decision making through an analysis of accuracy, harm and complexity.

Methods

Data were collected at the University Hospital of Kigali (CHUK) in a total of 201 HIV-positive hospitalised patients with chronic cough. We simulated management of each patient following the three algorithms. The first was locally tailored by clinicians from CHUK, the second and third were drawn from publications by Médecins sans Frontières (MSF) and the World Health Organisation (WHO). Semantic analysis techniques known as Clinical Algorithm Nosology were used to compare them in terms of complexity and similarity. For each of them, we assessed the sensitivity, delay to diagnosis and hypothetical harm of false positives and false negatives.

Results

The principal diagnoses were tuberculosis (21%) and pneumocystosis (19%). Sensitivity, representing the proportion of correct diagnoses made by each algorithm, was 95.7%, 88% and 70% for CHUK, MSF and WHO, respectively. Mean time to appropriate management was 1.86 days for CHUK and 3.46 for the MSF algorithm. The CHUK algorithm was the most complex, followed by MSF and WHO. Total harm was by far the highest for the WHO algorithm, followed by MSF and CHUK.

Conclusions

This study confirms our hypothesis that sensitivity and patient safety (i.e. less expected harm) are proportional to the complexity of algorithms, though increased complexity may make them difficult to use in practice.
Appendix
Available only for authorised users
Literature
1.
go back to reference Haegeman F, Ledecq JL, Wyffels A, Dama K: [Evaluation of the use of diagnostic/treatment algorithms in the health centers of North Cameroon]. Ann Soc Belg Med Trop. 1994, 74: 231-247.PubMed Haegeman F, Ledecq JL, Wyffels A, Dama K: [Evaluation of the use of diagnostic/treatment algorithms in the health centers of North Cameroon]. Ann Soc Belg Med Trop. 1994, 74: 231-247.PubMed
2.
go back to reference Barak N, Margolis CZ, Gottlieb LK: Text-to-algorithm conversion to facilitate comparison of competing clinical guidelines. Med Decis Making. 1998, 18: 304-310. 10.1177/0272989X9801800308.CrossRefPubMed Barak N, Margolis CZ, Gottlieb LK: Text-to-algorithm conversion to facilitate comparison of competing clinical guidelines. Med Decis Making. 1998, 18: 304-310. 10.1177/0272989X9801800308.CrossRefPubMed
3.
go back to reference Wabitsch R, Margolis CZ, Malkin JE, Abu-Saad K, Waksman J: Evaluating the process of tailoring the global HIV/AIDS practice guidelines for use in developing countries. Int J Qual Health Care. 1998, 10: 147-154. 10.1093/intqhc/10.2.147.CrossRefPubMed Wabitsch R, Margolis CZ, Malkin JE, Abu-Saad K, Waksman J: Evaluating the process of tailoring the global HIV/AIDS practice guidelines for use in developing countries. Int J Qual Health Care. 1998, 10: 147-154. 10.1093/intqhc/10.2.147.CrossRefPubMed
4.
go back to reference Saranchuk P, Boulle A, Hilderbrand K, Coetzee D, Bedelu M, van CG, Meintjes G: Evaluation of a diagnostic algorithm for smear-negative pulmonary tuberculosis in HIV-infected adults. S Afr Med J. 2007, 97: 517-523.PubMed Saranchuk P, Boulle A, Hilderbrand K, Coetzee D, Bedelu M, van CG, Meintjes G: Evaluation of a diagnostic algorithm for smear-negative pulmonary tuberculosis in HIV-infected adults. S Afr Med J. 2007, 97: 517-523.PubMed
5.
go back to reference Ferrand RA, Weiss HA, Nathoo K, Ndhlovu CE, Mungofa S, Munyati S, Bandason T, Gibb DM, Corbett EL: A primary care level algorithm for identifying HIV-infected adolescents in populations at high risk through mother-to-child transmission. Trop Med Int Health. 2011, 16: 349-355. 10.1111/j.1365-3156.2010.02708.x.CrossRefPubMedPubMedCentral Ferrand RA, Weiss HA, Nathoo K, Ndhlovu CE, Mungofa S, Munyati S, Bandason T, Gibb DM, Corbett EL: A primary care level algorithm for identifying HIV-infected adolescents in populations at high risk through mother-to-child transmission. Trop Med Int Health. 2011, 16: 349-355. 10.1111/j.1365-3156.2010.02708.x.CrossRefPubMedPubMedCentral
6.
go back to reference Horwood C, Vermaak K, Rollins N, Haskins L, Nkosi P, Qazi S: Paediatric HIV management at primary care level: an evaluation of the integrated management of childhood illness (IMCI) guidelines for HIV. BMC Pediatr. 2009, 9: 59-10.1186/1471-2431-9-59.CrossRefPubMedPubMedCentral Horwood C, Vermaak K, Rollins N, Haskins L, Nkosi P, Qazi S: Paediatric HIV management at primary care level: an evaluation of the integrated management of childhood illness (IMCI) guidelines for HIV. BMC Pediatr. 2009, 9: 59-10.1186/1471-2431-9-59.CrossRefPubMedPubMedCentral
7.
go back to reference Horwood C, Liebeschuetz S, Blaauw D, Cassol S, Qazi S: Diagnosis of paediatric HIV infection in a primary health care setting with a clinical algorithm. Bull World Health Organ. 2003, 81: 858-866.PubMed Horwood C, Liebeschuetz S, Blaauw D, Cassol S, Qazi S: Diagnosis of paediatric HIV infection in a primary health care setting with a clinical algorithm. Bull World Health Organ. 2003, 81: 858-866.PubMed
8.
go back to reference Pearson SD, Margolis CZ, Davis S, Schreier LK, Gottlieb LK: The clinical algorithm nosology: a method for comparing algorithmic guidelines. Med Decis Making. 1992, 12: 123-131. 10.1177/0272989X9201200205.CrossRefPubMed Pearson SD, Margolis CZ, Davis S, Schreier LK, Gottlieb LK: The clinical algorithm nosology: a method for comparing algorithmic guidelines. Med Decis Making. 1992, 12: 123-131. 10.1177/0272989X9201200205.CrossRefPubMed
9.
go back to reference UNAIDS: HIV and AIDS estimates of 2007. 2008, UNAIDS UNAIDS: HIV and AIDS estimates of 2007. 2008, UNAIDS
10.
go back to reference ONUSIDA/OMS: Le point sur l'épidémie de SIDA. 2005, ONUSIDA/OMS ONUSIDA/OMS: Le point sur l'épidémie de SIDA. 2005, ONUSIDA/OMS
11.
go back to reference WHO: Interim proposal for a WHO Staging System for HIV infection and Disease. Wkly Epidemiol Rec. 1990, 65: 221-224. WHO: Interim proposal for a WHO Staging System for HIV infection and Disease. Wkly Epidemiol Rec. 1990, 65: 221-224.
12.
go back to reference Lynen L: Clinical AIDS Care Guidelines For Resource poor Settings. 2001, MSF Belgium-Luxembourg Lynen L: Clinical AIDS Care Guidelines For Resource poor Settings. 2001, MSF Belgium-Luxembourg
13.
go back to reference Lynen L: Treatment and Prevention of opportunistic infections at the level of Referral Hospital in Resource-limited Settings. 2005, MSF Belgium-Luxembourg Lynen L: Treatment and Prevention of opportunistic infections at the level of Referral Hospital in Resource-limited Settings. 2005, MSF Belgium-Luxembourg
14.
go back to reference WHO: WHO, Guidelines for the clinical management of HIV infection in adult. 2008, WHO/GPA/IDS/HCS/91.6 WHO: WHO, Guidelines for the clinical management of HIV infection in adult. 2008, WHO/GPA/IDS/HCS/91.6
15.
go back to reference Tsalatsanis A, Hozo I, Vickers A, Djulbegovic B: A regret theory approach to decision curve analysis: a novel method for eliciting decision makers' preferences and decision-making. BMC Med Inform Decis Mak. 2010, 10: 51-10.1186/1472-6947-10-51.CrossRefPubMedPubMedCentral Tsalatsanis A, Hozo I, Vickers A, Djulbegovic B: A regret theory approach to decision curve analysis: a novel method for eliciting decision makers' preferences and decision-making. BMC Med Inform Decis Mak. 2010, 10: 51-10.1186/1472-6947-10-51.CrossRefPubMedPubMedCentral
16.
go back to reference Batungwanayo J, Taelman H, Lucas S, Bogaerts J, Alard D, Kagame A, Blanche P, Clerinx J, van de PP, Allen S: Pulmonary disease associated with the human immunodeficiency virus in Kigali, Rwanda. A fiberoptic bronchoscopic study of 111 cases of undetermined etiology. Am J Respir Crit Care Med. 1994, 149: 1591-1596.CrossRefPubMed Batungwanayo J, Taelman H, Lucas S, Bogaerts J, Alard D, Kagame A, Blanche P, Clerinx J, van de PP, Allen S: Pulmonary disease associated with the human immunodeficiency virus in Kigali, Rwanda. A fiberoptic bronchoscopic study of 111 cases of undetermined etiology. Am J Respir Crit Care Med. 1994, 149: 1591-1596.CrossRefPubMed
17.
go back to reference Worodria W, Okot-Nwang M, Yoo SD, Aisu T: Causes of lower respiratory infection in HIV-infected Ugandan adults who are sputum AFB smear-negative. Int J Tuberc Lung Dis. 2003, 7: 117-123.PubMed Worodria W, Okot-Nwang M, Yoo SD, Aisu T: Causes of lower respiratory infection in HIV-infected Ugandan adults who are sputum AFB smear-negative. Int J Tuberc Lung Dis. 2003, 7: 117-123.PubMed
18.
go back to reference Mootsikapun P, Chetchotisakd P, Intarapoka B: Pulmonary infections in HIV infected patients. J Med Assoc Thai. 1996, 79: 477-485.PubMed Mootsikapun P, Chetchotisakd P, Intarapoka B: Pulmonary infections in HIV infected patients. J Med Assoc Thai. 1996, 79: 477-485.PubMed
19.
go back to reference Martinson NA, Karstaedt A, Venter WD, Omar T, King P, Mbengo T, Marais E, McIntyre J, Chaisson RE, Hale M: Causes of death in hospitalized adults with a premortem diagnosis of tuberculosis: an autopsy study. AIDS. 2007, 21: 2043-2050. 10.1097/QAD.0b013e3282eea47f.CrossRefPubMed Martinson NA, Karstaedt A, Venter WD, Omar T, King P, Mbengo T, Marais E, McIntyre J, Chaisson RE, Hale M: Causes of death in hospitalized adults with a premortem diagnosis of tuberculosis: an autopsy study. AIDS. 2007, 21: 2043-2050. 10.1097/QAD.0b013e3282eea47f.CrossRefPubMed
20.
go back to reference Moreira J, Bisig B, Muwawenimana P, Basinga P, Bisoffi Z, Haegeman F, Kishore P, Van den Ende J: Weighing harm in therapeutic decisions of smear-negative pulmonary tuberculosis. Med Decis Making. 2009, 29: 380-390. 10.1177/0272989X08327330.CrossRefPubMed Moreira J, Bisig B, Muwawenimana P, Basinga P, Bisoffi Z, Haegeman F, Kishore P, Van den Ende J: Weighing harm in therapeutic decisions of smear-negative pulmonary tuberculosis. Med Decis Making. 2009, 29: 380-390. 10.1177/0272989X08327330.CrossRefPubMed
21.
go back to reference Van den Ende J, Bisoffi Z, Van Puymbroek H, Van der SP, Van Gompel A, Derese A, Lynen L, Moreira J, Janssen PA: Bridging the gap between clinical practice and diagnostic clinical epidemiology: pilot experiences with a didactic model based on a logarithmic scale. J Eval Clin Pract. 2007, 13: 374-380. 10.1111/j.1365-2753.2006.00710.x.CrossRefPubMed Van den Ende J, Bisoffi Z, Van Puymbroek H, Van der SP, Van Gompel A, Derese A, Lynen L, Moreira J, Janssen PA: Bridging the gap between clinical practice and diagnostic clinical epidemiology: pilot experiences with a didactic model based on a logarithmic scale. J Eval Clin Pract. 2007, 13: 374-380. 10.1111/j.1365-2753.2006.00710.x.CrossRefPubMed
22.
go back to reference Van Puymbroeck H, Remmen R, Denekens J, Scherpbier A, Bisoffi Z, Van den Ende J: Teaching problem solving and decision making in undergraduate medical education: an instructional strategy. Med Teach. 2003, 25: 547-550.PubMed Van Puymbroeck H, Remmen R, Denekens J, Scherpbier A, Bisoffi Z, Van den Ende J: Teaching problem solving and decision making in undergraduate medical education: an instructional strategy. Med Teach. 2003, 25: 547-550.PubMed
23.
go back to reference Bisoffi Z, Sirima BS, Angheben A, Lodesani C, Gobbi F, Tinto H, Van den Ende J: Rapid malaria diagnostic tests vs. clinical management of malaria in rural Burkina Faso: safety and effect on clinical decisions. A randomized trial. Trop Med Int Health. 2009, 14: 491-498. 10.1111/j.1365-3156.2009.02246.x.CrossRefPubMed Bisoffi Z, Sirima BS, Angheben A, Lodesani C, Gobbi F, Tinto H, Van den Ende J: Rapid malaria diagnostic tests vs. clinical management of malaria in rural Burkina Faso: safety and effect on clinical decisions. A randomized trial. Trop Med Int Health. 2009, 14: 491-498. 10.1111/j.1365-3156.2009.02246.x.CrossRefPubMed
24.
go back to reference Pauker SG, Kassirer JP: The threshold approach to clinical decision making. N Engl J Med. 1980, 302: 1109-1117. 10.1056/NEJM198005153022003.CrossRefPubMed Pauker SG, Kassirer JP: The threshold approach to clinical decision making. N Engl J Med. 1980, 302: 1109-1117. 10.1056/NEJM198005153022003.CrossRefPubMed
25.
go back to reference Pauker SG, Pauker SP, Wong JB: The utility of thresholds and the threshold utility. Med Decis Making. 1987, 7: 201-202. 10.1177/0272989X8700700401.CrossRefPubMed Pauker SG, Pauker SP, Wong JB: The utility of thresholds and the threshold utility. Med Decis Making. 1987, 7: 201-202. 10.1177/0272989X8700700401.CrossRefPubMed
26.
go back to reference Kassirer JP: Our stubborn quest for diagnostic certainty. A cause of excessive testing [see comments]. N Engl J Med. 1989, 320: 1489-1491. 10.1056/NEJM198906013202211.CrossRefPubMed Kassirer JP: Our stubborn quest for diagnostic certainty. A cause of excessive testing [see comments]. N Engl J Med. 1989, 320: 1489-1491. 10.1056/NEJM198906013202211.CrossRefPubMed
Metadata
Title
Is increasing complexity of algorithms the price for higher accuracy? virtual comparison of three algorithms for tertiary level management of chronic cough in people living with HIV in a low-income country
Authors
Constance Mukabatsinda
Jasmine Nguyen
Bettina Bisig
Lutgarde Lynen
Yerma D Coppens
Anita Asiimwe
Jef Van den Ende
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2012
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-12-2

Other articles of this Issue 1/2012

BMC Medical Informatics and Decision Making 1/2012 Go to the issue