Skip to main content
Top
Published in: Population Health Metrics 1/2018

Open Access 01-12-2018 | Research

Collecting verbal autopsies: improving and streamlining data collection processes using electronic tablets

Authors: Abraham D. Flaxman, Andrea Stewart, Jonathan C. Joseph, Nurul Alam, Sayed Saidul Alam, Hafizur Chowdhury, Meghan D. Mooney, Rasika Rampatige, Hazel Remolador, Diozele Sanvictores, Peter T. Serina, Peter Kim Streatfield, Veronica Tallo, Christopher J. L. Murray, Bernardo Hernandez, Alan D. Lopez, Ian Douglas Riley

Published in: Population Health Metrics | Issue 1/2018

Login to get access

Abstract

Background

There is increasing interest in using verbal autopsy to produce nationally representative population-level estimates of causes of death. However, the burden of processing a large quantity of surveys collected with paper and pencil has been a barrier to scaling up verbal autopsy surveillance. Direct electronic data capture has been used in other large-scale surveys and can be used in verbal autopsy as well, to reduce time and cost of going from collected data to actionable information.

Methods

We collected verbal autopsy interviews using paper and pencil and using electronic tablets at two sites, and measured the cost and time required to process the surveys for analysis. From these cost and time data, we extrapolated costs associated with conducting large-scale surveillance with verbal autopsy.

Results

We found that the median time between data collection and data entry for surveys collected on paper and pencil was approximately 3 months. For surveys collected on electronic tablets, this was less than 2 days. For small-scale surveys, we found that the upfront costs of purchasing electronic tablets was the primary cost and resulted in a higher total cost. For large-scale surveys, the costs associated with data entry exceeded the cost of the tablets, so electronic data capture provides both a quicker and cheaper method of data collection.

Conclusions

As countries increase verbal autopsy surveillance, it is important to consider the best way to design sustainable systems for data collection. Electronic data capture has the potential to greatly reduce the time and costs associated with data collection. For long-term, large-scale surveillance required by national vital statistical systems, electronic data capture reduces costs and allows data to be available sooner.
Literature
2.
go back to reference Mahapatra P, Shibuya K, Lopez AD, Coullare F, Notzon FC, Rao C, et al. Civil registration systems and vital statistics: successes and missed opportunities. Lancet. 2007 Nov;370(9599):1653–63.CrossRefPubMed Mahapatra P, Shibuya K, Lopez AD, Coullare F, Notzon FC, Rao C, et al. Civil registration systems and vital statistics: successes and missed opportunities. Lancet. 2007 Nov;370(9599):1653–63.CrossRefPubMed
3.
go back to reference AbouZahr C, de Savigny D, Mikkelsen L, Setel PW, Lozano R, Nichols E, et al. Civil registration and vital statistics: progress in the data revolution for counting and accountability. Lancet. 2015 Oct;386(10001):1373–85.CrossRefPubMed AbouZahr C, de Savigny D, Mikkelsen L, Setel PW, Lozano R, Nichols E, et al. Civil registration and vital statistics: progress in the data revolution for counting and accountability. Lancet. 2015 Oct;386(10001):1373–85.CrossRefPubMed
4.
go back to reference Mikkelsen L, Phillips DE, AbouZahr C, Setel PW, de Savigny D, Lozano R, et al. A global assessment of civil registration and vital statistics systems: monitoring data quality and progress. Lancet. 2015 Oct;386(10001):1395–406.CrossRefPubMed Mikkelsen L, Phillips DE, AbouZahr C, Setel PW, de Savigny D, Lozano R, et al. A global assessment of civil registration and vital statistics systems: monitoring data quality and progress. Lancet. 2015 Oct;386(10001):1395–406.CrossRefPubMed
5.
go back to reference Hill K, Lopez AD, Shibuya K, Jha P. Interim measures for meeting needs for health sector data: births, deaths, and causes of death. Lancet. 2007 Nov 23;370(9600):1726–35.CrossRefPubMed Hill K, Lopez AD, Shibuya K, Jha P. Interim measures for meeting needs for health sector data: births, deaths, and causes of death. Lancet. 2007 Nov 23;370(9600):1726–35.CrossRefPubMed
6.
go back to reference Indian Council of Medical Research (ICMR). Study on causes of death by verbal autopsy in India. New Delhi, India: ICMR; 2009. Indian Council of Medical Research (ICMR). Study on causes of death by verbal autopsy in India. New Delhi, India: ICMR; 2009.
7.
go back to reference Baqui AH, Black RE, Arifeen SE, Hill K, Mitra SN, al Sabir A. Causes of childhood deaths in Bangladesh: results of a nationwide verbal autopsy study. Bull World Health Organ. 1998;76(2):161–71.PubMedPubMedCentral Baqui AH, Black RE, Arifeen SE, Hill K, Mitra SN, al Sabir A. Causes of childhood deaths in Bangladesh: results of a nationwide verbal autopsy study. Bull World Health Organ. 1998;76(2):161–71.PubMedPubMedCentral
8.
go back to reference França E, Campos D, Guimarães MD, de FM SM. Use of verbal autopsy in a national health information system: effects of the investigation of ill-defined causes of death on proportional mortality due to injury in small municipalities in Brazil. Popul Health Metr. 2011;9:39.CrossRefPubMedPubMedCentral França E, Campos D, Guimarães MD, de FM SM. Use of verbal autopsy in a national health information system: effects of the investigation of ill-defined causes of death on proportional mortality due to injury in small municipalities in Brazil. Popul Health Metr. 2011;9:39.CrossRefPubMedPubMedCentral
9.
go back to reference Dharmaratne SD, Jayasuriya RL, Perera BY, Gunesekera E, Sathasivayyar A. Opportunities and challenges for verbal autopsy in the national death registration system in Sri Lanka: past and future. Popul Health Metr. 2011;9:21.CrossRefPubMedPubMedCentral Dharmaratne SD, Jayasuriya RL, Perera BY, Gunesekera E, Sathasivayyar A. Opportunities and challenges for verbal autopsy in the national death registration system in Sri Lanka: past and future. Popul Health Metr. 2011;9:21.CrossRefPubMedPubMedCentral
10.
go back to reference Yang G, Hu J, Rao KQ, Ma J, Rao C, Lopez AD. Mortality registration and surveillance in China: history, current situation and challenges. Popul Health Metr. 2005 Mar 16;3(1):3.CrossRefPubMedPubMedCentral Yang G, Hu J, Rao KQ, Ma J, Rao C, Lopez AD. Mortality registration and surveillance in China: history, current situation and challenges. Popul Health Metr. 2005 Mar 16;3(1):3.CrossRefPubMedPubMedCentral
11.
go back to reference Setel PW, Whiting DR, Hemed Y, Chandramohan D, Wolfson LJ, KGMM A, et al. Validity of verbal autopsy procedures for determining cause of death in Tanzania. Tropical Med Int Health. 2006 May 1;11(5):681–96.CrossRef Setel PW, Whiting DR, Hemed Y, Chandramohan D, Wolfson LJ, KGMM A, et al. Validity of verbal autopsy procedures for determining cause of death in Tanzania. Tropical Med Int Health. 2006 May 1;11(5):681–96.CrossRef
12.
go back to reference World Health Organization. Verbal autopsy standards: ascertaining and attributing causes of death. Geneva, Switzerland: WHO; 2007. World Health Organization. Verbal autopsy standards: ascertaining and attributing causes of death. Geneva, Switzerland: WHO; 2007.
13.
go back to reference Serina P, Riley I, Stewart A, Flaxman AD, Lozano R, Mooney MD, et al. A shortened verbal autopsy instrument for use in routine mortality surveillance systems. BMC Med. 2015;13:302.CrossRefPubMedPubMedCentral Serina P, Riley I, Stewart A, Flaxman AD, Lozano R, Mooney MD, et al. A shortened verbal autopsy instrument for use in routine mortality surveillance systems. BMC Med. 2015;13:302.CrossRefPubMedPubMedCentral
14.
go back to reference Murray CJ, Lozano R, Flaxman AD, Serina P, Phillips D, Stewart A, et al. Using verbal autopsy to measure causes of death: the comparative performance of existing methods. BMC Med. 2014;12:5.CrossRefPubMedPubMedCentral Murray CJ, Lozano R, Flaxman AD, Serina P, Phillips D, Stewart A, et al. Using verbal autopsy to measure causes of death: the comparative performance of existing methods. BMC Med. 2014;12:5.CrossRefPubMedPubMedCentral
15.
go back to reference Serina P, Riley I, Stewart A, James SL, Flaxman AD, Lozano R, et al. Improving performance of the tariff method for assigning causes of death to verbal autopsies. BMC Med. 2015;13:291.CrossRefPubMedPubMedCentral Serina P, Riley I, Stewart A, James SL, Flaxman AD, Lozano R, et al. Improving performance of the tariff method for assigning causes of death to verbal autopsies. BMC Med. 2015;13:291.CrossRefPubMedPubMedCentral
16.
go back to reference King C, Hall J, Banda M, Beard J, Bird J, Kazembe P, et al. Electronic data capture in a rural African setting: evaluating experiences with different systems in Malawi. Glob Health Action. 2014 Oct 30;7(0) King C, Hall J, Banda M, Beard J, Bird J, Kazembe P, et al. Electronic data capture in a rural African setting: evaluating experiences with different systems in Malawi. Glob Health Action. 2014 Oct 30;7(0)
17.
go back to reference Zhang S, Wu Q, van Velthoven MH, Chen L, Car J, Rudan I, et al. Smartphone versus pen-and-paper data collection of infant feeding practices in rural China. J Med Internet Res. 2012 Sep 18;14(5) Zhang S, Wu Q, van Velthoven MH, Chen L, Car J, Rudan I, et al. Smartphone versus pen-and-paper data collection of infant feeding practices in rural China. J Med Internet Res. 2012 Sep 18;14(5)
18.
go back to reference Yu P, de Courten M, Pan E, Galea G, Pryor J. The development and evaluation of a PDA-based method for public health surveillance data collection in developing countries. Int J Med Inf. 2009 Aug;78(8):532–42.CrossRef Yu P, de Courten M, Pan E, Galea G, Pryor J. The development and evaluation of a PDA-based method for public health surveillance data collection in developing countries. Int J Med Inf. 2009 Aug;78(8):532–42.CrossRef
19.
go back to reference Byass P, Hounton S, Ouédraogo M, Somé H, Diallo I, Fottrell E, et al. Direct data capture using hand-held computers in rural Burkina Faso: experiences, benefits and lessons learnt. Tropical Med Int Health. 2008 Jul 1;13:25–30.CrossRef Byass P, Hounton S, Ouédraogo M, Somé H, Diallo I, Fottrell E, et al. Direct data capture using hand-held computers in rural Burkina Faso: experiences, benefits and lessons learnt. Tropical Med Int Health. 2008 Jul 1;13:25–30.CrossRef
20.
go back to reference Rajput ZA, Mbugua S, Amadi D, Chepnǵeno V, Saleem JJ, Anokwa Y, et al. Evaluation of an android-based mHealth system for population surveillance in developing countries. J Am Med Inform Assoc. 2012 Jul 1;19(4):655–9.CrossRefPubMedPubMedCentral Rajput ZA, Mbugua S, Amadi D, Chepnǵeno V, Saleem JJ, Anokwa Y, et al. Evaluation of an android-based mHealth system for population surveillance in developing countries. J Am Med Inform Assoc. 2012 Jul 1;19(4):655–9.CrossRefPubMedPubMedCentral
21.
go back to reference King JD, Buolamwini J, Cromwell EA, Panfel A, Teferi T, Zerihun M, et al. A novel electronic data collection system for large-scale surveys of neglected tropical diseases. PLoS One. 2013 Sep 16;8(9) King JD, Buolamwini J, Cromwell EA, Panfel A, Teferi T, Zerihun M, et al. A novel electronic data collection system for large-scale surveys of neglected tropical diseases. PLoS One. 2013 Sep 16;8(9)
23.
go back to reference Fottrell E, Byass P. Verbal autopsy: methods in transition. Epidemiol Rev. 2010 Jan;1:mxq003. Fottrell E, Byass P. Verbal autopsy: methods in transition. Epidemiol Rev. 2010 Jan;1:mxq003.
25.
go back to reference Hartung C, Lerer A, Anokwa Y, Tseng C, Brunette W, Borriello G. Open data kit: tools to build information Services for Developing Regions. In: Proceedings of the 4th ACM/IEEE international conference on information and communication technologies and development. New York, NY, USA: ACM; 2010. p. 18:1–18:12. (ICTD ‘10). Hartung C, Lerer A, Anokwa Y, Tseng C, Brunette W, Borriello G. Open data kit: tools to build information Services for Developing Regions. In: Proceedings of the 4th ACM/IEEE international conference on information and communication technologies and development. New York, NY, USA: ACM; 2010. p. 18:1–18:12. (ICTD ‘10).
26.
go back to reference Van den Broeck J, Cunningham SA, Eeckels R, Herbst K. Data cleaning: detecting, diagnosing, and editing data abnormalities. PLoS Med. 2005 Sep 6;2(10):e267.CrossRefPubMedPubMedCentral Van den Broeck J, Cunningham SA, Eeckels R, Herbst K. Data cleaning: detecting, diagnosing, and editing data abnormalities. PLoS Med. 2005 Sep 6;2(10):e267.CrossRefPubMedPubMedCentral
27.
go back to reference Murray CJ, Lopez AD, Black R, Ahuja R, Ali SM, Baqui A, et al. Population health metrics research consortium gold standard verbal autopsy validation study: design, implementation, and development of analysis datasets. Popul Health Metr. 2011;9:27.CrossRefPubMedPubMedCentral Murray CJ, Lopez AD, Black R, Ahuja R, Ali SM, Baqui A, et al. Population health metrics research consortium gold standard verbal autopsy validation study: design, implementation, and development of analysis datasets. Popul Health Metr. 2011;9:27.CrossRefPubMedPubMedCentral
28.
go back to reference Aanensen DM, Huntley DM, Feil EJ, Al-Own F, Spratt BG. EpiCollect: linking Smartphones to web applications for epidemiology, ecology and community data collection. PLoS One. 2009 Sep 16;4(9) Aanensen DM, Huntley DM, Feil EJ, Al-Own F, Spratt BG. EpiCollect: linking Smartphones to web applications for epidemiology, ecology and community data collection. PLoS One. 2009 Sep 16;4(9)
29.
go back to reference Fletcher LA, Erickson DJ, Toomey TL, Wagenaar AC. Handheld computers a feasible alternative to paper forms for field data collection. Eval Rev. 2003 Apr 1;27(2):165–78.CrossRefPubMed Fletcher LA, Erickson DJ, Toomey TL, Wagenaar AC. Handheld computers a feasible alternative to paper forms for field data collection. Eval Rev. 2003 Apr 1;27(2):165–78.CrossRefPubMed
30.
go back to reference Medhi I, Jain M, Tewari A, Bhavsar M, Matheke-Fischer M, Cutrell E. Combating rural child malnutrition through inexpensive mobile phones. In: Proceedings of the 7th Nordic conference on human-computer interaction: making sense through design. New York, NY, USA: ACM; 2012. p. 635–644. (NordiCHI ‘12). Medhi I, Jain M, Tewari A, Bhavsar M, Matheke-Fischer M, Cutrell E. Combating rural child malnutrition through inexpensive mobile phones. In: Proceedings of the 7th Nordic conference on human-computer interaction: making sense through design. New York, NY, USA: ACM; 2012. p. 635–644. (NordiCHI ‘12).
31.
go back to reference Tomlinson M, Solomon W, Singh Y, Doherty T, Chopra M, Ijumba P, et al. The use of mobile phones as a data collection tool: a report from a household survey in South Africa. BMC Med Inform Decis Mak. 2009 Dec 23;9(1):51.CrossRefPubMedPubMedCentral Tomlinson M, Solomon W, Singh Y, Doherty T, Chopra M, Ijumba P, et al. The use of mobile phones as a data collection tool: a report from a household survey in South Africa. BMC Med Inform Decis Mak. 2009 Dec 23;9(1):51.CrossRefPubMedPubMedCentral
32.
go back to reference Were MC, Kariuki J, Chepng’eno V, Wandabwa M, Ndege S, Braitstein P, et al. Leapfrogging paper-based records using handheld technology: experience from western Kenya. Stud Health Technol Inform. 2010;160(Pt 1):525–9.PubMed Were MC, Kariuki J, Chepng’eno V, Wandabwa M, Ndege S, Braitstein P, et al. Leapfrogging paper-based records using handheld technology: experience from western Kenya. Stud Health Technol Inform. 2010;160(Pt 1):525–9.PubMed
33.
go back to reference Forster D, Behrens RH, Campbell H, Byass P. Evaluation of a computerized field data collection system for health surveys. Bull World Health Organ. 1991;69(1):107–11.PubMedPubMedCentral Forster D, Behrens RH, Campbell H, Byass P. Evaluation of a computerized field data collection system for health surveys. Bull World Health Organ. 1991;69(1):107–11.PubMedPubMedCentral
34.
go back to reference Thriemer K, Ley B, Ame SM, Puri MK, Hashim R, Chang NY, et al. Replacing paper data collection forms with electronic data entry in the field: findings from a study of community-acquired bloodstream infections in Pemba, Zanzibar. BMC Res Notes. 2012;5:113.CrossRefPubMedPubMedCentral Thriemer K, Ley B, Ame SM, Puri MK, Hashim R, Chang NY, et al. Replacing paper data collection forms with electronic data entry in the field: findings from a study of community-acquired bloodstream infections in Pemba, Zanzibar. BMC Res Notes. 2012;5:113.CrossRefPubMedPubMedCentral
36.
go back to reference Bird J, Byass P, Kahn K, Mee P, Fottrell E. A matter of life and death: practical and ethical constraints in the development of a mobile verbal autopsy tool. In: Proceedings of the SIGCHI conference on human factors in computing systems. New York, NY, USA: ACM; 2013. p. 1489–1498. (CHI ‘13). Bird J, Byass P, Kahn K, Mee P, Fottrell E. A matter of life and death: practical and ethical constraints in the development of a mobile verbal autopsy tool. In: Proceedings of the SIGCHI conference on human factors in computing systems. New York, NY, USA: ACM; 2013. p. 1489–1498. (CHI ‘13).
37.
go back to reference Cobb C, Sudar S, Reiter N, Anderson R, Roesner F, Kohno T. Computer security for data collection technologies. In: Proceedings of the eighth international conference on information and communication technologies and development. New York, NY, USA: ACM; 2016. p. 2:1–2:11. (ICTD ‘16). Cobb C, Sudar S, Reiter N, Anderson R, Roesner F, Kohno T. Computer security for data collection technologies. In: Proceedings of the eighth international conference on information and communication technologies and development. New York, NY, USA: ACM; 2016. p. 2:1–2:11. (ICTD ‘16).
Metadata
Title
Collecting verbal autopsies: improving and streamlining data collection processes using electronic tablets
Authors
Abraham D. Flaxman
Andrea Stewart
Jonathan C. Joseph
Nurul Alam
Sayed Saidul Alam
Hafizur Chowdhury
Meghan D. Mooney
Rasika Rampatige
Hazel Remolador
Diozele Sanvictores
Peter T. Serina
Peter Kim Streatfield
Veronica Tallo
Christopher J. L. Murray
Bernardo Hernandez
Alan D. Lopez
Ian Douglas Riley
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Population Health Metrics / Issue 1/2018
Electronic ISSN: 1478-7954
DOI
https://doi.org/10.1186/s12963-018-0161-9

Other articles of this Issue 1/2018

Population Health Metrics 1/2018 Go to the issue