Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2018

Open Access 01-12-2018 | Research article

Validation of verbal autopsy methods using hospital medical records: a case study in Vietnam

Authors: Hong Thi Tran, Hoa Phuong Nguyen, Sue M. Walker, Peter S. Hill, Chalapati Rao

Published in: BMC Medical Research Methodology | Issue 1/2018

Login to get access

Abstract

Background

Information on causes of death (COD) is crucial for measuring the health outcomes of populations and progress towards the Sustainable Development Goals. In many countries such as Vietnam where the civil registration and vital statistics (CRVS) system is dysfunctional, information on vital events will continue to rely on verbal autopsy (VA) methods. This study assesses the validity of VA methods used in Vietnam, and provides recommendations on methods for implementing VA validation studies in Vietnam.

Methods

This validation study was conducted on a sample of 670 deaths from a recent VA study in Quang Ninh province. The study covered 116 cases from this sample, which met three inclusion criteria: a) the death occurred within 30 days of discharge after last hospitalisation, and b) medical records (MRs) for the deceased were available from respective hospitals, and c) the medical record mentioned that the patient was terminally ill at discharge. For each death, the underlying cause of death (UCOD) identified from MRs was compared to the UCOD from VA. The validity of VA diagnoses for major causes of death was measured using sensitivity, specificity and positive predictive value (PPV).

Results

The sensitivity of VA was at least 75% in identifying some leading CODs such as stroke, road traffic accidents and several site-specific cancers. However, sensitivity was less than 50% for other important causes including ischemic heart disease, chronic obstructive pulmonary diseases, and diabetes. Overall, there was 57% agreement between UCOD from VA and MR, which increased to 76% when multiple causes from VA were compared to UCOD from MR.

Conclusions

Our findings suggest that VA is a valid method to ascertain UCOD in contexts such as Vietnam. Furthermore, within cultural contexts in which patients prefer to die at home instead of a healthcare facility, using the available MRs as the gold standard may be meaningful to the extent that recall bias from the interval between last hospital discharge and death can be minimized. Therefore, future studies should evaluate validity of MRs as a gold standard for VA studies in contexts similar to the Vietnamese context.
Appendix
Available only for authorised users
Literature
2.
go back to reference Editorial. Towards 2030: counting and accountability matter. Lancet. 2015;386(10001):1312. Editorial. Towards 2030: counting and accountability matter. Lancet. 2015;386(10001):1312.
4.
go back to reference Fottrell E, Byass P. Verbal Autosy: methods in transition. Epidemiol Rev. 2010;32:8.CrossRef Fottrell E, Byass P. Verbal Autosy: methods in transition. Epidemiol Rev. 2010;32:8.CrossRef
6.
go back to reference Rao C, Osterberger B, Anh TD, MacDonald M, Chuc NT, Hill PS. Compiling mortality statistics from civil registration systems in Vietnam: the long road ahead. Bull World Health Organ. 2010;88(1):58–65.CrossRefPubMed Rao C, Osterberger B, Anh TD, MacDonald M, Chuc NT, Hill PS. Compiling mortality statistics from civil registration systems in Vietnam: the long road ahead. Bull World Health Organ. 2010;88(1):58–65.CrossRefPubMed
7.
go back to reference Lanh LT. The current situation of birth and death reporting system by Ministry of Justice. In: National Conference on health management information system: 2012; Hanoi, Vietnam; 2012. p. 9. Lanh LT. The current situation of birth and death reporting system by Ministry of Justice. In: National Conference on health management information system: 2012; Hanoi, Vietnam; 2012. p. 9.
8.
go back to reference Hoa NP, Rao C, Hoy DG, Hinh ND, Chuc NT, Ngo DA. Mortality measures from sample-based surveillance: evidence of the epidemiological transition in Vietnam. Bull World Health Organ. 2012;90(10):764–72.CrossRefPubMedPubMedCentral Hoa NP, Rao C, Hoy DG, Hinh ND, Chuc NT, Ngo DA. Mortality measures from sample-based surveillance: evidence of the epidemiological transition in Vietnam. Bull World Health Organ. 2012;90(10):764–72.CrossRefPubMedPubMedCentral
9.
go back to reference D'Ambruoso L, Boerma T, Byass P, Fottrell E, Herbst K, Källander K, Mullan Z. The case for verbal autopsy in health systems strengthening. Lancet Glob Health. 2017;5(1):e20–1.CrossRefPubMed D'Ambruoso L, Boerma T, Byass P, Fottrell E, Herbst K, Källander K, Mullan Z. The case for verbal autopsy in health systems strengthening. Lancet Glob Health. 2017;5(1):e20–1.CrossRefPubMed
10.
go back to reference de Savigny D, Riley I, Chandramohan D, Odhiambo F, Nichols E, Notzon S, AbouZahr C, Mitra R, Cobos Munoz D, Firth S, et al. Integrating community-based verbal autopsy into civil registration and vital statistics (CRVS): system-level considerations. Glob Health Action. 2017;10(1):1272882.CrossRefPubMedPubMedCentral de Savigny D, Riley I, Chandramohan D, Odhiambo F, Nichols E, Notzon S, AbouZahr C, Mitra R, Cobos Munoz D, Firth S, et al. Integrating community-based verbal autopsy into civil registration and vital statistics (CRVS): system-level considerations. Glob Health Action. 2017;10(1):1272882.CrossRefPubMedPubMedCentral
11.
go back to reference Gupta S, Khieu TQ, Rao C, Anh N, Hoa NP. Assessing the quality of evidence for verbal autopsy diagnosis of stroke in Vietnam. J Neurosci Rural Pract. 2012;3(3):267–75.CrossRefPubMedPubMedCentral Gupta S, Khieu TQ, Rao C, Anh N, Hoa NP. Assessing the quality of evidence for verbal autopsy diagnosis of stroke in Vietnam. J Neurosci Rural Pract. 2012;3(3):267–75.CrossRefPubMedPubMedCentral
12.
go back to reference Quyen BTT, Cuong PV. Patterns of mortality in elderly in chi Linh, Hai Duong, Vietnam period 2004-2012. AIMS Public Health. 2016;3(3):615–28.CrossRef Quyen BTT, Cuong PV. Patterns of mortality in elderly in chi Linh, Hai Duong, Vietnam period 2004-2012. AIMS Public Health. 2016;3(3):615–28.CrossRef
14.
go back to reference Rao C. Mortality estimates for South East Asia, and INDEPTH mortality surveillance: necessary but not sufficient? Int J Epidemiol. 2013;42(4):1196–9.CrossRefPubMed Rao C. Mortality estimates for South East Asia, and INDEPTH mortality surveillance: necessary but not sufficient? Int J Epidemiol. 2013;42(4):1196–9.CrossRefPubMed
15.
go back to reference Tran BH, Nguyen HT, Ho HT, Pham CV, Le VT, Le AV. The chi Linh health and demographic surveillance system (CHILILAB HDSS). Int J Epidemiol. 2013;42(3):750–7.CrossRefPubMed Tran BH, Nguyen HT, Ho HT, Pham CV, Le VT, Le AV. The chi Linh health and demographic surveillance system (CHILILAB HDSS). Int J Epidemiol. 2013;42(3):750–7.CrossRefPubMed
16.
go back to reference Tran TK, Eriksson B, Nguyen CT, Horby P, Bondjers G, Petzold M. DodaLab: an urban health and demographic surveillance site, the first three years in Hanoi, Vietnam. Scand J Public Health. 2012;40(8):765–72.CrossRefPubMed Tran TK, Eriksson B, Nguyen CT, Horby P, Bondjers G, Petzold M. DodaLab: an urban health and demographic surveillance site, the first three years in Hanoi, Vietnam. Scand J Public Health. 2012;40(8):765–72.CrossRefPubMed
17.
go back to reference Huong DL, Minh HV, Byass P. Applying verbal autopsy to determine cause of death in rural Vietnam. Scand J Public Health Suppl. 2003;62:19–25.CrossRefPubMed Huong DL, Minh HV, Byass P. Applying verbal autopsy to determine cause of death in rural Vietnam. Scand J Public Health Suppl. 2003;62:19–25.CrossRefPubMed
18.
go back to reference Stevenson M, Hung DV, Hoang TH, Mai Anh L, Nguyen Thi Hong T, Le Tran N. Evaluation of the Vietnamese A6 mortality reporting system: all-cause mortality. Asia Pac J Public Health. 2015;27(7):733–42.CrossRefPubMed Stevenson M, Hung DV, Hoang TH, Mai Anh L, Nguyen Thi Hong T, Le Tran N. Evaluation of the Vietnamese A6 mortality reporting system: all-cause mortality. Asia Pac J Public Health. 2015;27(7):733–42.CrossRefPubMed
19.
go back to reference Yang G, Rao C, Ma J, Wang L, Wan X, Dubrovsky G, Lopez AD. Validation of verbal autopsy procedures for adult deaths in China. Int J Epidemiol. 2006;35(3):741–8.CrossRefPubMed Yang G, Rao C, Ma J, Wang L, Wan X, Dubrovsky G, Lopez AD. Validation of verbal autopsy procedures for adult deaths in China. Int J Epidemiol. 2006;35(3):741–8.CrossRefPubMed
21.
go back to reference Misganaw A, Mariam DH, Araya T, Aneneh A. Validity of verbal autopsy method to determine causes of death among adults in the urban setting of Ethiopia. BMC Med Res Methodol. 2012;12:130.CrossRefPubMedPubMedCentral Misganaw A, Mariam DH, Araya T, Aneneh A. Validity of verbal autopsy method to determine causes of death among adults in the urban setting of Ethiopia. BMC Med Res Methodol. 2012;12:130.CrossRefPubMedPubMedCentral
22.
go back to reference Soofi SB, Ariff S, Khan U, Turab A, Khan GN, Habib A, Sadiq K, Suhag Z, Bhatti Z, Ahmed I, et al. Diagnostic accuracy of WHO verbal autopsy tool for ascertaining causes of neonatal deaths in the urban setting of Pakistan: a hospital-based prospective study. BMC Pediatr. 2015;15:144.CrossRefPubMedPubMedCentral Soofi SB, Ariff S, Khan U, Turab A, Khan GN, Habib A, Sadiq K, Suhag Z, Bhatti Z, Ahmed I, et al. Diagnostic accuracy of WHO verbal autopsy tool for ascertaining causes of neonatal deaths in the urban setting of Pakistan: a hospital-based prospective study. BMC Pediatr. 2015;15:144.CrossRefPubMedPubMedCentral
23.
go back to reference Department of Medical Services Administration. Summary statistics from hospital routine reporting system. Hanoi: Vietnamese Ministry of Health; 2017. Department of Medical Services Administration. Summary statistics from hospital routine reporting system. Hanoi: Vietnamese Ministry of Health; 2017.
24.
go back to reference Hong TT, Phuong Hoa N, Walker SM, Hill PS, Rao C. Completeness and reliability of mortality data in Vietnam: implications for the national routine health management information system. PLoS One. 2018;13(1):e0190755.CrossRefPubMedPubMedCentral Hong TT, Phuong Hoa N, Walker SM, Hill PS, Rao C. Completeness and reliability of mortality data in Vietnam: implications for the national routine health management information system. PLoS One. 2018;13(1):e0190755.CrossRefPubMedPubMedCentral
25.
go back to reference Ngo AD, Rao C, Hoa NP, Adair T, Chuc NT. Mortality patterns in Vietnam, 2006: findings from a national verbal autopsy survey. BMC Res Notes. 2010;3:78.CrossRefPubMedPubMedCentral Ngo AD, Rao C, Hoa NP, Adair T, Chuc NT. Mortality patterns in Vietnam, 2006: findings from a national verbal autopsy survey. BMC Res Notes. 2010;3:78.CrossRefPubMedPubMedCentral
26.
go back to reference Ngo AD, Rao C, Hoa NP, Hoy DG, Trang KT, Hill PS. Road traffic related mortality in Vietnam: evidence for policy from a national sample mortality surveillance system. BMC Public Health. 2012;12:561.CrossRefPubMedPubMedCentral Ngo AD, Rao C, Hoa NP, Hoy DG, Trang KT, Hill PS. Road traffic related mortality in Vietnam: evidence for policy from a national sample mortality surveillance system. BMC Public Health. 2012;12:561.CrossRefPubMedPubMedCentral
27.
go back to reference Chuc NTK, Hoa NP, Rao C, Anh ND. Xác định nguyên nhân tử vong qua phỏng vấn: Tài liệu tập huấn dành cho điều tra viên (Identification of cause of death using interview: Training document for interviewers). Hanoi: Medical Publishing House; 2011. Chuc NTK, Hoa NP, Rao C, Anh ND. Xác định nguyên nhân tử vong qua phỏng vấn: Tài liệu tập huấn dành cho điều tra viên (Identification of cause of death using interview: Training document for interviewers). Hanoi: Medical Publishing House; 2011.
31.
go back to reference WHO. International statistical classification of diseases and related health problems 10th revision. Volume 1- tabular list. Fifth edition. Geneva: WHO Press; 2016. WHO. International statistical classification of diseases and related health problems 10th revision. Volume 1- tabular list. Fifth edition. Geneva: WHO Press; 2016.
32.
go back to reference Chandramohan D, Maude GH, Rodrigues LC, Hayes RJ. Verbal autopsies for adult deaths: issues in their development and validation. Int J Epidemiol. 1994;23(2):213–22.CrossRefPubMed Chandramohan D, Maude GH, Rodrigues LC, Hayes RJ. Verbal autopsies for adult deaths: issues in their development and validation. Int J Epidemiol. 1994;23(2):213–22.CrossRefPubMed
33.
go back to reference Aggarwal AK, Kumar P, Pandit S, Kumar R. Accuracy of WHO verbal autopsy tool in determining major causes of neonatal deaths in India. PLoS One. 2013;8(1):e54865.CrossRefPubMedPubMedCentral Aggarwal AK, Kumar P, Pandit S, Kumar R. Accuracy of WHO verbal autopsy tool in determining major causes of neonatal deaths in India. PLoS One. 2013;8(1):e54865.CrossRefPubMedPubMedCentral
34.
go back to reference Khademi H, Etemadi A, Kamangar F, Nouraie M, Shakeri R, Abaie B, Pourshams A, Bagheri M, Hooshyar A, Islami F, et al. Verbal autopsy: reliability and validity estimates for causes of death in the Golestan cohort study in Iran. PLoS One. 2010;5(6):e11183.CrossRefPubMedPubMedCentral Khademi H, Etemadi A, Kamangar F, Nouraie M, Shakeri R, Abaie B, Pourshams A, Bagheri M, Hooshyar A, Islami F, et al. Verbal autopsy: reliability and validity estimates for causes of death in the Golestan cohort study in Iran. PLoS One. 2010;5(6):e11183.CrossRefPubMedPubMedCentral
35.
go back to reference Mpimbaza A, Filler S, Katureebe A, Kinara SO, Nzabandora E, Quick L, Ratcliffe A, Wabwire-Mangen F, Chandramohan D, Staedke SG. Validity of verbal autopsy procedures for determining malaria deaths in different epidemiological settings in Uganda. PLoS One. 2011;6(10):e26892.CrossRefPubMedPubMedCentral Mpimbaza A, Filler S, Katureebe A, Kinara SO, Nzabandora E, Quick L, Ratcliffe A, Wabwire-Mangen F, Chandramohan D, Staedke SG. Validity of verbal autopsy procedures for determining malaria deaths in different epidemiological settings in Uganda. PLoS One. 2011;6(10):e26892.CrossRefPubMedPubMedCentral
36.
go back to reference Ganapathy SS, Khoo YY, Azahadi MO, Fuad MAM, Jeevananthan C, Rao C. Validation of verbal autopsy: determination of cause of deaths in Malaysia 2013. BMC Public Health. 2017;17:653.CrossRefPubMedPubMedCentral Ganapathy SS, Khoo YY, Azahadi MO, Fuad MAM, Jeevananthan C, Rao C. Validation of verbal autopsy: determination of cause of deaths in Malaysia 2013. BMC Public Health. 2017;17:653.CrossRefPubMedPubMedCentral
37.
go back to reference Murray CJ, Lozano R, Flaxman AD, Serina P, Phillips D, Stewart A, James SL, Vahdatpour A, Atkinson C, Freeman MK, et al. Using verbal autopsy to measure causes of death: the comparative performance of existing methods. BMC Med. 2014;12:5.CrossRefPubMedPubMedCentral Murray CJ, Lozano R, Flaxman AD, Serina P, Phillips D, Stewart A, James SL, Vahdatpour A, Atkinson C, Freeman MK, et al. Using verbal autopsy to measure causes of death: the comparative performance of existing methods. BMC Med. 2014;12:5.CrossRefPubMedPubMedCentral
38.
go back to reference Stevenson MR, Ngoan le T, Hung DV, Huong Tu NT, Mai AL, Ivers RQ, Huong HT. Evaluation of the Vietnamese A6 mortality reporting system: injury as a cause of death. Inj Prev. 2012;18(6):360–4.CrossRefPubMed Stevenson MR, Ngoan le T, Hung DV, Huong Tu NT, Mai AL, Ivers RQ, Huong HT. Evaluation of the Vietnamese A6 mortality reporting system: injury as a cause of death. Inj Prev. 2012;18(6):360–4.CrossRefPubMed
39.
go back to reference Moriyama IM, Baum WS, Haenszel WM, Mattison BF. Inquiry into diagnostic evidence supporting medical certifications of death. Am J Public Health Nations Health. 1958;48(10):1376–87.CrossRefPubMedPubMedCentral Moriyama IM, Baum WS, Haenszel WM, Mattison BF. Inquiry into diagnostic evidence supporting medical certifications of death. Am J Public Health Nations Health. 1958;48(10):1376–87.CrossRefPubMedPubMedCentral
40.
go back to reference Rao C, Yang G, Hu J, Ma J, Xia W, Lopez AD. Validation of cause-of-death statistics in urban China. Int J Epidemiol. 2007;36(3):642–51.CrossRefPubMed Rao C, Yang G, Hu J, Ma J, Xia W, Lopez AD. Validation of cause-of-death statistics in urban China. Int J Epidemiol. 2007;36(3):642–51.CrossRefPubMed
41.
go back to reference Qureshi JS, Samuel JC, Mulima G, Kakoulides S, Cairns B, Charles AG. Validating a verbal autopsy tool to assess pre-hospital trauma mortality burden in a resource-poor setting. Tropical Med Int Health. 2014;19(4):407–12.CrossRef Qureshi JS, Samuel JC, Mulima G, Kakoulides S, Cairns B, Charles AG. Validating a verbal autopsy tool to assess pre-hospital trauma mortality burden in a resource-poor setting. Tropical Med Int Health. 2014;19(4):407–12.CrossRef
42.
go back to reference Polprasert W, Rao C, Adair T, Pattaraarchachai J, Porapakkham Y, Lopez AD. Cause-of-death ascertainment for deaths that occur outside hospitals in Thailand: application of verbal autopsy methods. Popul Health Metr. 2010;8:13.CrossRefPubMedPubMedCentral Polprasert W, Rao C, Adair T, Pattaraarchachai J, Porapakkham Y, Lopez AD. Cause-of-death ascertainment for deaths that occur outside hospitals in Thailand: application of verbal autopsy methods. Popul Health Metr. 2010;8:13.CrossRefPubMedPubMedCentral
43.
go back to reference Omar A, Yi K, Fuad M, Ganapathy S, Jeevananthan C, Yusoff AF, Mustaffa AN, Rao C: A study on determination of causes of death in Malaysia. A report published by the Institute of Public Health, Ministry of Health, Malaysia. ISBN: 978-983-2387-32-9. 2017. Pgs. 1-167. 2017. Omar A, Yi K, Fuad M, Ganapathy S, Jeevananthan C, Yusoff AF, Mustaffa AN, Rao C: A study on determination of causes of death in Malaysia. A report published by the Institute of Public Health, Ministry of Health, Malaysia. ISBN: 978-983-2387-32-9. 2017. Pgs. 1-167. 2017.
Metadata
Title
Validation of verbal autopsy methods using hospital medical records: a case study in Vietnam
Authors
Hong Thi Tran
Hoa Phuong Nguyen
Sue M. Walker
Peter S. Hill
Chalapati Rao
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2018
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-018-0497-7

Other articles of this Issue 1/2018

BMC Medical Research Methodology 1/2018 Go to the issue