Skip to main content
Top
Published in: European Radiology 9/2013

Open Access 01-09-2013 | Chest

The effect of a tuberculosis chest X-ray image reference set on non-expert reader performance

Authors: Catriona J. Waitt, Elizabeth C. Joekes, Natasha Jesudason, Peter I. Waitt, Patrick Goodson, Ganizani Likumbo, Samuel Kampondeni, E. Brian Faragher, S. Bertel Squire

Published in: European Radiology | Issue 9/2013

Login to get access

Abstract

Objectives

In low-resource settings, limitations in diagnostic accuracy of chest X-rays (CXR) for pulmonary tuberculosis (PTB) relate partly to non-expert interpretation. We piloted a TB CXR Image Reference Set (TIRS) to improve non-expert performance in an operational setting in Malawi.

Methods

Nineteen doctors and clinical officers read 60 CXR of patients with suspected PTB, at baseline and using TIRS. Two officers also used the CXR Reading and Recording System (CRRS). Correct treatment decisions were assessed against a “gold standard” of mycobacterial culture and expert performance.

Results

TIRS significantly increased overall non-expert sensitivity from 67.6 (SD 14.9) to 75.5 (SD 11.1, P = 0.013), approaching expert values of 84.2 (SD 5.2). Among doctors, correct decisions increased from 60.7 % (SD 7.9) to 67.1 % (SD 8.0, P = 0.054). Clinical officers increased in sensitivity from 68.0 % (SD 15) to 77.4 % (SD 10.7, P = 0.056), but decreased in specificity from 55.0 % (SD 23.9) to 40.8 % (SD 10.4, P = 0.049). Two officers made correct treatment decisions with TIRS in 62.7 %. CRRS training increased this to 67.8 %.

Conclusion

Use of a CXR image reference set increased correct decisions by doctors to treat PTB. This tool may provide a low-cost intervention improving non-expert performance, translating into improved clinical care. Further evaluation is warranted.

Key Points

Tuberculosis treatment decisions are influenced by CXR findings, despite improved laboratory diagnostics.
In low-resource settings, CXR interpretation is performed largely by non-experts.
We piloted the effect of a simple reference training set of CXRs.
Use of the reference set increased the number of correct treatment decisions. This effect was more marked for doctors than clinical officers.
Further evaluation of this simple training tool is warranted.
Appendix
Available only for authorised users
Literature
3.
go back to reference Cain KP, McCarthy KD, Heilig CM et al (2010) An algorithm for tuberculosis screening and diagnosis in people with HIV. N Engl J Med 362:707–716PubMedCrossRef Cain KP, McCarthy KD, Heilig CM et al (2010) An algorithm for tuberculosis screening and diagnosis in people with HIV. N Engl J Med 362:707–716PubMedCrossRef
4.
go back to reference Tamhane A, Chheng P, Dobbs T, Mak S, Sar B, Kimerling ME (2009) Predictors of smear-negative pulmonary tuberculosis in HIV-infected patients, Battambang, Cambodia. Int J Tuberc Lung Dis 13:347–354PubMed Tamhane A, Chheng P, Dobbs T, Mak S, Sar B, Kimerling ME (2009) Predictors of smear-negative pulmonary tuberculosis in HIV-infected patients, Battambang, Cambodia. Int J Tuberc Lung Dis 13:347–354PubMed
5.
go back to reference Hanifa Y, Fielding KL, Charalambous S et al (2012) Tuberculosis among adults starting antiretroviral therapy in South Africa: the need for routine case finding. Int J Tuberc Lung Dis 16:1252–1259PubMedCrossRef Hanifa Y, Fielding KL, Charalambous S et al (2012) Tuberculosis among adults starting antiretroviral therapy in South Africa: the need for routine case finding. Int J Tuberc Lung Dis 16:1252–1259PubMedCrossRef
6.
go back to reference Mundy CJ, Harries AD, Banerjee A, Salaniponi FM, Gilks CF, Squire SB (2002) Quality assessment of sputum transportation, smear preparation and AFB microscopy in a rural district in Malawi. Int J Tuberc Lung Dis 6:47–54PubMed Mundy CJ, Harries AD, Banerjee A, Salaniponi FM, Gilks CF, Squire SB (2002) Quality assessment of sputum transportation, smear preparation and AFB microscopy in a rural district in Malawi. Int J Tuberc Lung Dis 6:47–54PubMed
7.
go back to reference Zellweger JP, Heinzer R, Touray M, Vidondo B, Altpeter E (2006) Intra-observer and overall agreement in the radiological assessment of tuberculosis. Int J Tuberc Lung Dis 10:1123–1126PubMed Zellweger JP, Heinzer R, Touray M, Vidondo B, Altpeter E (2006) Intra-observer and overall agreement in the radiological assessment of tuberculosis. Int J Tuberc Lung Dis 10:1123–1126PubMed
8.
go back to reference Hoog AH, Meme HK, van Deutekom H et al (2011) High sensitivity of chest radiograph reading by clinical officers in a tuberculosis prevalence survey. Int J Tuberc Lung Dis 15:1308–1314PubMedCrossRef Hoog AH, Meme HK, van Deutekom H et al (2011) High sensitivity of chest radiograph reading by clinical officers in a tuberculosis prevalence survey. Int J Tuberc Lung Dis 15:1308–1314PubMedCrossRef
9.
go back to reference Waitt CJ, Peter KBN, White SA et al (2011) Early deaths during tuberculosis treatment are associated with depressed innate responses, bacterial infection, and tuberculosis progression. J Infect Dis 204:358–362PubMedCrossRef Waitt CJ, Peter KBN, White SA et al (2011) Early deaths during tuberculosis treatment are associated with depressed innate responses, bacterial infection, and tuberculosis progression. J Infect Dis 204:358–362PubMedCrossRef
10.
go back to reference Szot A, Jacobson FL, Munn S et al (2004) Diagnostic accuracy of chest X-rays acquired using a digital camera for low-cost teleradiology. Int J Med Inform Feb 73:65–73CrossRef Szot A, Jacobson FL, Munn S et al (2004) Diagnostic accuracy of chest X-rays acquired using a digital camera for low-cost teleradiology. Int J Med Inform Feb 73:65–73CrossRef
11.
go back to reference Potchen EJ (2006) Measuring observer performance in chest radiology: some experiences. J Am Coll Radiol 3:423–432PubMedCrossRef Potchen EJ (2006) Measuring observer performance in chest radiology: some experiences. J Am Coll Radiol 3:423–432PubMedCrossRef
12.
go back to reference Davis JL, Worodria W, Kisembo H et al (2010) Clinical and radiographic factors do not accurately diagnose smear-negative tuberculosis in HIV-infected inpatients in Uganda: a cross-sectional study. PLoS One 5:e9859PubMedCrossRef Davis JL, Worodria W, Kisembo H et al (2010) Clinical and radiographic factors do not accurately diagnose smear-negative tuberculosis in HIV-infected inpatients in Uganda: a cross-sectional study. PLoS One 5:e9859PubMedCrossRef
13.
go back to reference Agizew T, Bachhuber MA, Nyirenda S et al (2010) Association of chest radiographic abnormalities with tuberculosis disease in asymptomatic HIV-infected adults. Int J Tuberc Lung Dis 14:324–331PubMed Agizew T, Bachhuber MA, Nyirenda S et al (2010) Association of chest radiographic abnormalities with tuberculosis disease in asymptomatic HIV-infected adults. Int J Tuberc Lung Dis 14:324–331PubMed
14.
go back to reference Balabanova Y, Coker R, Fedorin I et al (2005) Variability in interpretation of chest radiographs among Russian clinicians and implications for screening programmes: observational study. BMJ 331:379–382PubMedCrossRef Balabanova Y, Coker R, Fedorin I et al (2005) Variability in interpretation of chest radiographs among Russian clinicians and implications for screening programmes: observational study. BMJ 331:379–382PubMedCrossRef
15.
go back to reference Dawson R, Masuka P, Edwards DJ et al (2010) Chest radiograph reading and recording system: evaluation for tuberculosis screening in patients with advanced HIV. Int J Tuberc Lung Dis 14:52–58PubMed Dawson R, Masuka P, Edwards DJ et al (2010) Chest radiograph reading and recording system: evaluation for tuberculosis screening in patients with advanced HIV. Int J Tuberc Lung Dis 14:52–58PubMed
16.
go back to reference Den Boon S, Bateman ED, Enarson et al (2005) Development and evaluation of a new chest radiograph reading and recording system for epidemiological surveys of tuberculosis and lung disease. Int J Tuberc Lung Dis 9:1088–1096 Den Boon S, Bateman ED, Enarson et al (2005) Development and evaluation of a new chest radiograph reading and recording system for epidemiological surveys of tuberculosis and lung disease. Int J Tuberc Lung Dis 9:1088–1096
17.
go back to reference Kumar N, Bhargava SK, Agrawal CS, George K, Karki P, Baral D (2005) Chest radiographs and their reliability in the diagnosis of tuberculosis. JNMA J Nepal Med Assoc 44:138–142PubMed Kumar N, Bhargava SK, Agrawal CS, George K, Karki P, Baral D (2005) Chest radiographs and their reliability in the diagnosis of tuberculosis. JNMA J Nepal Med Assoc 44:138–142PubMed
18.
go back to reference Nyirenda TE, Harries AD, Banerjee A, Salaniponi FM (1999) Accuracy of chest radiograph diagnosis for smear-negative pulmonary tuberculosis suspects by hospital clinical staff in Malawi. Trop Doct 29:219–220PubMed Nyirenda TE, Harries AD, Banerjee A, Salaniponi FM (1999) Accuracy of chest radiograph diagnosis for smear-negative pulmonary tuberculosis suspects by hospital clinical staff in Malawi. Trop Doct 29:219–220PubMed
19.
go back to reference van Cleeff MR, Kivihya-Ndugga LE, Meme H, Odhiambo JA, Klatser PR (2005) The role and performance of chest X-ray for the diagnosis of tuberculosis: a cost-effectiveness analysis in Nairobi, Kenya. BMC Infect Dis 5:111PubMedCrossRef van Cleeff MR, Kivihya-Ndugga LE, Meme H, Odhiambo JA, Klatser PR (2005) The role and performance of chest X-ray for the diagnosis of tuberculosis: a cost-effectiveness analysis in Nairobi, Kenya. BMC Infect Dis 5:111PubMedCrossRef
20.
go back to reference Bossuyt PM, Reitsma JB, Bruns DE et al (2003) Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. AJR Am J Roentgenol 181:51–55PubMedCrossRef Bossuyt PM, Reitsma JB, Bruns DE et al (2003) Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. AJR Am J Roentgenol 181:51–55PubMedCrossRef
Metadata
Title
The effect of a tuberculosis chest X-ray image reference set on non-expert reader performance
Authors
Catriona J. Waitt
Elizabeth C. Joekes
Natasha Jesudason
Peter I. Waitt
Patrick Goodson
Ganizani Likumbo
Samuel Kampondeni
E. Brian Faragher
S. Bertel Squire
Publication date
01-09-2013
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 9/2013
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-013-2840-z

Other articles of this Issue 9/2013

European Radiology 9/2013 Go to the issue