Skip to main content
Top
Published in: BMC Health Services Research 1/2014

Open Access 01-12-2014 | Research article

The exit interview as a proxy measure of malaria case management practice: sensitivity and specificity relative to direct observation

Authors: Justin Pulford, Peter M Siba, Ivo Mueller, Manuel W Hetzel

Published in: BMC Health Services Research | Issue 1/2014

Login to get access

Abstract

Background

This paper aims to assess the sensitivity and specificity of exit interviews as a measure of malaria case management practice as compared to direct observation.

Methods

The malaria case management of 1654 febrile patients attending 110 health facilities from across Papua New Guinea was directly observed by a trained research officer as part of a repeat cross sectional survey. Patient recall of 5 forms of clinical advice and 5 forms of clinical action were then assessed at service exit and statistical analyses on matched observation/exit interview data conducted.

Results

The sensitivity of exit interviews with respect to clinical advice ranged from 36.2% to 96.4% and specificity from 53.5% to 98.6%. With respect to clinical actions, sensitivity of the exit interviews ranged from 83.9% to 98.3% and specificity from 70.6% to 98.1%.

Conclusion

The exit interview appears to be a valid measure of objective malaria case management practices such as the completion of a diagnostic test or the provision of antimalarial medication, but may be a less valid measure of low frequency, subjective practices such as the provision of malaria prevention advice.
Literature
1.
go back to reference Guidelines for the Treatment of Malaria. 2010, WHO, Geneva, 2 Guidelines for the Treatment of Malaria. 2010, WHO, Geneva, 2
2.
go back to reference Pulford J, Kurumop S, Ura Y, Siba P, Mueller I, Hetzel MW: Malaria case management in Papua New Guinea following the introduction of a revised treatment protocol. Malar J. 2013, 12: 433-10.1186/1475-2875-12-433.CrossRefPubMedPubMedCentral Pulford J, Kurumop S, Ura Y, Siba P, Mueller I, Hetzel MW: Malaria case management in Papua New Guinea following the introduction of a revised treatment protocol. Malar J. 2013, 12: 433-10.1186/1475-2875-12-433.CrossRefPubMedPubMedCentral
3.
4.
go back to reference Abdelgader TM, Ibrahim AM, Elmardi KA, Githinji S, Zurovac D, Snow RW, Noor AM: Progress towards implementation of ACT malaria case-management in public health facilities in the Republic of Sudan: a cluster-sample survey. BMC Public Health. 2012, 12: 11-10.1186/1471-2458-12-11.CrossRefPubMedPubMedCentral Abdelgader TM, Ibrahim AM, Elmardi KA, Githinji S, Zurovac D, Snow RW, Noor AM: Progress towards implementation of ACT malaria case-management in public health facilities in the Republic of Sudan: a cluster-sample survey. BMC Public Health. 2012, 12: 11-10.1186/1471-2458-12-11.CrossRefPubMedPubMedCentral
5.
go back to reference Martins JS, Zwi AB, Hobday K, Bonaparte F, Kelly PM: The implementation of a new Malaria Treatment Protocol in Timor-Leste: challenges and constraints. Health Policy Plan. 2012, 27 (8): 677-686. 10.1093/heapol/czs019.CrossRefPubMedPubMedCentral Martins JS, Zwi AB, Hobday K, Bonaparte F, Kelly PM: The implementation of a new Malaria Treatment Protocol in Timor-Leste: challenges and constraints. Health Policy Plan. 2012, 27 (8): 677-686. 10.1093/heapol/czs019.CrossRefPubMedPubMedCentral
6.
go back to reference Zurovac D, Sudoi RK, Akhwale WS, Ndiritu M, Hamer DH, Rowe AK, Snow RW: The effect of mobile phone text-message reminders on Kenyan health workers’ adherence to malaria treatment guidelines: a cluster randomised trial. Lancet. 2011, 378 (9793): 795-803. 10.1016/S0140-6736(11)60783-6.CrossRefPubMedPubMedCentral Zurovac D, Sudoi RK, Akhwale WS, Ndiritu M, Hamer DH, Rowe AK, Snow RW: The effect of mobile phone text-message reminders on Kenyan health workers’ adherence to malaria treatment guidelines: a cluster randomised trial. Lancet. 2011, 378 (9793): 795-803. 10.1016/S0140-6736(11)60783-6.CrossRefPubMedPubMedCentral
7.
go back to reference Wasunna B, Zurovac D, Bruce J, Jones C, Webster J, Snow RW: Health worker performance in the management of paediatric fevers following in-service training and exposure to job aids in Kenya. Malar J. 2010, 9: 261.PubMedPubMedCentral Wasunna B, Zurovac D, Bruce J, Jones C, Webster J, Snow RW: Health worker performance in the management of paediatric fevers following in-service training and exposure to job aids in Kenya. Malar J. 2010, 9: 261.PubMedPubMedCentral
8.
go back to reference Namagembe A, Ssekabira U, Weaver MR, Blum N, Burnett S, Dorsey G, Sebuyira LM, Ojaku A, Schneider G, Willis K, Yeka A: Improved clinical and laboratory skills after team-based, malaria case management training of health care professionals in Uganda. Malar J. 2012, 11: 44-10.1186/1475-2875-11-44.CrossRefPubMedPubMedCentral Namagembe A, Ssekabira U, Weaver MR, Blum N, Burnett S, Dorsey G, Sebuyira LM, Ojaku A, Schneider G, Willis K, Yeka A: Improved clinical and laboratory skills after team-based, malaria case management training of health care professionals in Uganda. Malar J. 2012, 11: 44-10.1186/1475-2875-11-44.CrossRefPubMedPubMedCentral
9.
go back to reference Pulford J, Mueller I, Siba PM, Hetzel MW: Malaria case management in Papua New Guinea prior to the introduction of a revised treatment protocol. Malar J. 2012, 11: 157-10.1186/1475-2875-11-157.CrossRefPubMedPubMedCentral Pulford J, Mueller I, Siba PM, Hetzel MW: Malaria case management in Papua New Guinea prior to the introduction of a revised treatment protocol. Malar J. 2012, 11: 157-10.1186/1475-2875-11-157.CrossRefPubMedPubMedCentral
10.
go back to reference Lange S, Mwisongo A, Maestad O: Why don’t clinicians adhere more consistently to guidelines for the Integrated Management of Childhood Illness (IMCI)?. Soc Sci Med. 2014, 104: 56-63. 10.1016/j.socscimed.2013.12.020.CrossRefPubMed Lange S, Mwisongo A, Maestad O: Why don’t clinicians adhere more consistently to guidelines for the Integrated Management of Childhood Illness (IMCI)?. Soc Sci Med. 2014, 104: 56-63. 10.1016/j.socscimed.2013.12.020.CrossRefPubMed
11.
go back to reference Masanja IM, Selemani M, Khatib RA, Amuri B, Kuepfer I, Kajungu D, de Savigny D, Kachur SP, Skarbinski J: Correct dosing of artemether-lumefantrine for management of uncomplicated malaria in rural Tanzania: do facility and patient characteristics matter?. Malar J. 2013, 12: 446-10.1186/1475-2875-12-446.CrossRefPubMedPubMedCentral Masanja IM, Selemani M, Khatib RA, Amuri B, Kuepfer I, Kajungu D, de Savigny D, Kachur SP, Skarbinski J: Correct dosing of artemether-lumefantrine for management of uncomplicated malaria in rural Tanzania: do facility and patient characteristics matter?. Malar J. 2013, 12: 446-10.1186/1475-2875-12-446.CrossRefPubMedPubMedCentral
12.
go back to reference Kyabayinze DJ, Asiimwe C, Nakanjako D, Nabakooza J, Counihan H, Tibenderana JK: Use of RDTs to improve malaria diagnosis and fever case management at primary health care facilities in Uganda. Malar J. 2010, 9: 200-10.1186/1475-2875-9-200.CrossRefPubMedPubMedCentral Kyabayinze DJ, Asiimwe C, Nakanjako D, Nabakooza J, Counihan H, Tibenderana JK: Use of RDTs to improve malaria diagnosis and fever case management at primary health care facilities in Uganda. Malar J. 2010, 9: 200-10.1186/1475-2875-9-200.CrossRefPubMedPubMedCentral
13.
go back to reference Onwujekwe O, Uzochukwu B, Dike N, Uguru N, Nwobi E, Shu E: Malaria treatment perceptions, practices and influences on provider behaviour: comparing hospitals and non-hospitals in south-east Nigeria. Malar J. 2009, 8: 246-10.1186/1475-2875-8-246.CrossRefPubMedPubMedCentral Onwujekwe O, Uzochukwu B, Dike N, Uguru N, Nwobi E, Shu E: Malaria treatment perceptions, practices and influences on provider behaviour: comparing hospitals and non-hospitals in south-east Nigeria. Malar J. 2009, 8: 246-10.1186/1475-2875-8-246.CrossRefPubMedPubMedCentral
14.
go back to reference Hrisos S, Eccles MP, Francis JJ, Dickinson HO, Kaner EF, Beyer F, Johnston M: Are there valid proxy measures of clinical behaviour? A systematic review. Implementation Sci. 2009, 4: 37-10.1186/1748-5908-4-37.CrossRef Hrisos S, Eccles MP, Francis JJ, Dickinson HO, Kaner EF, Beyer F, Johnston M: Are there valid proxy measures of clinical behaviour? A systematic review. Implementation Sci. 2009, 4: 37-10.1186/1748-5908-4-37.CrossRef
15.
go back to reference Nicholson JM, Hennrikus DJ, Lando HA, McCarty MC, Vessey J: Patient recall versus physician documentation in report of smoking cessation counselling performed in the inpatient setting. Tob Control. 2000, 9 (4): 382-388. 10.1136/tc.9.4.382.CrossRefPubMedPubMedCentral Nicholson JM, Hennrikus DJ, Lando HA, McCarty MC, Vessey J: Patient recall versus physician documentation in report of smoking cessation counselling performed in the inpatient setting. Tob Control. 2000, 9 (4): 382-388. 10.1136/tc.9.4.382.CrossRefPubMedPubMedCentral
16.
go back to reference Shaikh U, Nettiksimmons J, Bell RA, Tancredi D, Romano PS: Accuracy of parental report and electronic health record documentation as measures of diet and physical activity counseling. Acad Pediatr. 2012, 12 (2): 81-87. 10.1016/j.acap.2011.10.004.CrossRefPubMed Shaikh U, Nettiksimmons J, Bell RA, Tancredi D, Romano PS: Accuracy of parental report and electronic health record documentation as measures of diet and physical activity counseling. Acad Pediatr. 2012, 12 (2): 81-87. 10.1016/j.acap.2011.10.004.CrossRefPubMed
17.
go back to reference Corser W, Sikorskii A, Olomu A, Stommel M, Proden C, Holmes-Rovner M: Concordance between comorbidity data from patient self-report interviews and medical record documentation. BMC Health Serv Res. 2008, 8: 85-10.1186/1472-6963-8-85.CrossRefPubMedPubMedCentral Corser W, Sikorskii A, Olomu A, Stommel M, Proden C, Holmes-Rovner M: Concordance between comorbidity data from patient self-report interviews and medical record documentation. BMC Health Serv Res. 2008, 8: 85-10.1186/1472-6963-8-85.CrossRefPubMedPubMedCentral
18.
go back to reference Flocke SA, Stange KC: Direct observation and patient recall of health behavior advice. Prev Med. 2004, 38 (3): 343-349. 10.1016/j.ypmed.2003.11.004.CrossRefPubMed Flocke SA, Stange KC: Direct observation and patient recall of health behavior advice. Prev Med. 2004, 38 (3): 343-349. 10.1016/j.ypmed.2003.11.004.CrossRefPubMed
19.
go back to reference Stange KC, Zyzanski SJ, Smith TF, Kelly R, Langa DM, Flocke SA, Jaen CR: How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison with direct observation of patients visits. Med Care. 1998, 36 (6): 851-867. 10.1097/00005650-199806000-00009.CrossRefPubMed Stange KC, Zyzanski SJ, Smith TF, Kelly R, Langa DM, Flocke SA, Jaen CR: How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison with direct observation of patients visits. Med Care. 1998, 36 (6): 851-867. 10.1097/00005650-199806000-00009.CrossRefPubMed
20.
go back to reference Dickinson HO, Hrisos S, Eccles MP, Francis J, Johnston M: Statistical considerations in a systematic review of proxy measures of clinical behaviour. Implementation Sci. 2010, 5: 20-10.1186/1748-5908-5-20.CrossRef Dickinson HO, Hrisos S, Eccles MP, Francis J, Johnston M: Statistical considerations in a systematic review of proxy measures of clinical behaviour. Implementation Sci. 2010, 5: 20-10.1186/1748-5908-5-20.CrossRef
21.
go back to reference Hetzel MW, Pulford J, Maraga S, Barnedas C, Reimer L, Tavul L, Jamea-Maiasa S, Tandrapah A, Maalsen A, Makita L, Siba PM, Mueller I: Evaluation of the Global Fund-supported National Malaria Control Program in Papua New Guinea, 2009–2014. P N G Med J, in press.. Hetzel MW, Pulford J, Maraga S, Barnedas C, Reimer L, Tavul L, Jamea-Maiasa S, Tandrapah A, Maalsen A, Makita L, Siba PM, Mueller I: Evaluation of the Global Fund-supported National Malaria Control Program in Papua New Guinea, 2009–2014. P N G Med J, in press..
22.
go back to reference Kurumop SF, Pulford J, Mueller I, Siba P, Hetzel MW: Diagnostic capacity and anti-malarial availability in Papua New Guinea prior to the introduction of a revised national malaria treatment protocol. P N G Med J, in press.. Kurumop SF, Pulford J, Mueller I, Siba P, Hetzel MW: Diagnostic capacity and anti-malarial availability in Papua New Guinea prior to the introduction of a revised national malaria treatment protocol. P N G Med J, in press..
23.
go back to reference National Malaria Treatment Protocol. 2009, PNG NDoH, Port Moresby, 1 National Malaria Treatment Protocol. 2009, PNG NDoH, Port Moresby, 1
24.
go back to reference Sciamanna CN, Goldstein MG, Marcus BH, Lawrence K, Pinto BM: Accuracy of recall of exercise counseling among primary care patients. Prev Med. 2004, 39 (6): 1063-1067. 10.1016/j.ypmed.2004.02.005.CrossRefPubMed Sciamanna CN, Goldstein MG, Marcus BH, Lawrence K, Pinto BM: Accuracy of recall of exercise counseling among primary care patients. Prev Med. 2004, 39 (6): 1063-1067. 10.1016/j.ypmed.2004.02.005.CrossRefPubMed
25.
go back to reference Gerbert B, Stone G, Stulbarg M, Gullion DS, Greenfield S: Agreement among physician assessment methods. Searching for the truth among fallible methods. Med Care. 1988, 26 (6): 519-535. 10.1097/00005650-198806000-00001.CrossRefPubMed Gerbert B, Stone G, Stulbarg M, Gullion DS, Greenfield S: Agreement among physician assessment methods. Searching for the truth among fallible methods. Med Care. 1988, 26 (6): 519-535. 10.1097/00005650-198806000-00001.CrossRefPubMed
26.
go back to reference Wilson A, McDonald P: Comparison of patient questionnaire, medical record, and audio tape in assessment of health promotion in general practice consultations. BMJ. 1994, 309 (6967): 1483-1485. 10.1136/bmj.309.6967.1483.CrossRefPubMedPubMedCentral Wilson A, McDonald P: Comparison of patient questionnaire, medical record, and audio tape in assessment of health promotion in general practice consultations. BMJ. 1994, 309 (6967): 1483-1485. 10.1136/bmj.309.6967.1483.CrossRefPubMedPubMedCentral
27.
go back to reference Pbert L, Adams A, Quirk M, Hebert JR, Ockene JK, Luippold RS: The patient exit interview as an assessment of physician-delivered smoking intervention: a validation study. Health Psychol. 1999, 18 (2): 183-188. 10.1037/0278-6133.18.2.183.CrossRefPubMed Pbert L, Adams A, Quirk M, Hebert JR, Ockene JK, Luippold RS: The patient exit interview as an assessment of physician-delivered smoking intervention: a validation study. Health Psychol. 1999, 18 (2): 183-188. 10.1037/0278-6133.18.2.183.CrossRefPubMed
28.
go back to reference Reif S, Horgan CM, Ritter GA: Treatment services: triangulation of methods when there is no gold standard. Subst Use Misuse. 2011, 46 (5): 620-632. 10.3109/10826084.2010.528119.CrossRefPubMed Reif S, Horgan CM, Ritter GA: Treatment services: triangulation of methods when there is no gold standard. Subst Use Misuse. 2011, 46 (5): 620-632. 10.3109/10826084.2010.528119.CrossRefPubMed
29.
go back to reference Tisnado DM, Adams JL, Liu H, Damberg CL, Chen WP, Hu FA, Carlisle DM, Mangione CM, Kahn KL: What is the concordance between the medical record and patient self-report as data sources for ambulatory care?. Med Care. 2006, 44 (2): 132-140. 10.1097/01.mlr.0000196952.15921.bf.CrossRefPubMed Tisnado DM, Adams JL, Liu H, Damberg CL, Chen WP, Hu FA, Carlisle DM, Mangione CM, Kahn KL: What is the concordance between the medical record and patient self-report as data sources for ambulatory care?. Med Care. 2006, 44 (2): 132-140. 10.1097/01.mlr.0000196952.15921.bf.CrossRefPubMed
30.
go back to reference Berkman ND, Davis TC, McCormack L: Health literacy: what is it?. J Health Commun. 2010, 15 (Suppl 2): 9-19. 10.1080/10810730.2010.499985.CrossRefPubMed Berkman ND, Davis TC, McCormack L: Health literacy: what is it?. J Health Commun. 2010, 15 (Suppl 2): 9-19. 10.1080/10810730.2010.499985.CrossRefPubMed
31.
go back to reference Wilson EA, Wolf MS, Curtis LM, Clayman ML, Cameron KA, Eigen KV, Makoul G: Literacy, cognitive ability, and the retention of health-related information about colorectal cancer screening. J Health Commun. 2010, 15 (Suppl 2): 116-125. 10.1080/10810730.2010.499984.CrossRefPubMed Wilson EA, Wolf MS, Curtis LM, Clayman ML, Cameron KA, Eigen KV, Makoul G: Literacy, cognitive ability, and the retention of health-related information about colorectal cancer screening. J Health Commun. 2010, 15 (Suppl 2): 116-125. 10.1080/10810730.2010.499984.CrossRefPubMed
32.
go back to reference Sheridan SL, Halpern DJ, Viera AJ, Berkman ND, Donahue KE, Crotty K: Interventions for individuals with low health literacy: a systematic review. J Health Commun. 2011, 16 (Suppl 3): 30-54. 10.1080/10810730.2011.604391.CrossRefPubMed Sheridan SL, Halpern DJ, Viera AJ, Berkman ND, Donahue KE, Crotty K: Interventions for individuals with low health literacy: a systematic review. J Health Commun. 2011, 16 (Suppl 3): 30-54. 10.1080/10810730.2011.604391.CrossRefPubMed
Metadata
Title
The exit interview as a proxy measure of malaria case management practice: sensitivity and specificity relative to direct observation
Authors
Justin Pulford
Peter M Siba
Ivo Mueller
Manuel W Hetzel
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2014
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-014-0628-8

Other articles of this Issue 1/2014

BMC Health Services Research 1/2014 Go to the issue