Skip to main content
Top
Published in: Reproductive Health 1/2024

Open Access 01-12-2024 | Miscarriage | Research

Exploring women’s interpretations of survey questions on pregnancy and pregnancy outcomes: cognitive interviews in Iganga Mayuge, Uganda

Authors: Doris Kwesiga, Mats Malqvist, Christopher Garimoi Orach, Leif Eriksson, Hannah Blencowe, Peter Waiswa

Published in: Reproductive Health | Issue 1/2024

Login to get access

Abstract

Background

In 2021, Uganda’s neonatal mortality rate was approximately 19 deaths per 1000 live births, with an estimated stillbirth rate of 15.1 per 1000 total births. Data are critical for indicating areas where deaths occur and why, hence driving improvements. Many countries rely on surveys like Demographic and Health Surveys (DHS), which face challenges with respondents’ misinterpretation of questions. However, little is documented about this in Uganda. Cognitive interviews aim to improve questionnaires and assess participants’ comprehension of items. Through cognitive interviews we explored women’s interpretations of questions on pregnancy and pregnancy outcomes.

Methods

In November 2021, we conducted cognitive interviews with 20 women in Iganga Mayuge health and demographic surveillance system site in eastern Uganda. We adapted the reproductive section of the DHS VIII women’s questionnaire, purposively selected questions and used concurrent verbal probing. Participants had secondary school education and were English speaking. Cognition was measured through comparing instructions in the DHS interviewers’ manual to participants’ responses and researcher’s knowledge. A qualitative descriptive approach to analysis was undertaken.

Results

We report findings under the cognitive aspect of comprehension. Some questions were correctly understood, especially those with less technical terms or without multiple sections. Most participants struggled with questions asking whether the woman has her living biological children residing with her or not. Indeed, some thought it referred to how many living children they had. There were comprehension difficulties with long questions like 210 that asks about miscarriages, newborn deaths, and stillbirths together. Participants had varying meanings for miscarriages, while many misinterpreted stillbirth, not linking it to gestational age. Furthermore, even amongst educated women some survey questions were misunderstood.

Conclusions

Population surveys may misclassify, over or under report events around pregnancy and pregnancy outcomes. Interviewers should begin with a standard definition of key terms and ensure respondents understand these. Questions can be simplified through breaking up long sentences, while interviewer training should be modified to ensure they thoroughly understand key terms. We recommend cognitive interviews while developing survey tools, beyond basic pre-testing. Improving respondents’ comprehension and thus response accuracy will increase reporting and data quality.
Appendix
Available only for authorised users
Literature
1.
go back to reference UN-IGME. Levels & Trends in Child Mortality: Report 2022, Estimates developed by the United Nations Inter-agency Group for Child Mortality Estimation. New York; 2023. UN-IGME. Levels & Trends in Child Mortality: Report 2022, Estimates developed by the United Nations Inter-agency Group for Child Mortality Estimation. New York; 2023.
7.
go back to reference Akuze J, Blencowe H, Waiswa P, Baschieri A, Gordeev VS, Kwesiga D, et al. Randomised comparison of two household survey modules for measuring stillbirths and neonatal deaths in five countries: the Every Newborn-INDEPTH study. Lancet Glob Heal. 2020;8:555–66.CrossRef Akuze J, Blencowe H, Waiswa P, Baschieri A, Gordeev VS, Kwesiga D, et al. Randomised comparison of two household survey modules for measuring stillbirths and neonatal deaths in five countries: the Every Newborn-INDEPTH study. Lancet Glob Heal. 2020;8:555–66.CrossRef
9.
go back to reference Beatty PC, Willis GB. Research synthesis: the practice of cognitive interviewing. Public Opin Q. 2007;71:287–311.CrossRef Beatty PC, Willis GB. Research synthesis: the practice of cognitive interviewing. Public Opin Q. 2007;71:287–311.CrossRef
10.
go back to reference Boeije H, Willis G. The cognitive interviewing reporting framework (CIRF): towards the harmonization of cognitive testing reports. Methodology. 2013;9:87–95.CrossRef Boeije H, Willis G. The cognitive interviewing reporting framework (CIRF): towards the harmonization of cognitive testing reports. Methodology. 2013;9:87–95.CrossRef
11.
go back to reference Willis GB. Cognitive Interviewing. A “How To” Guide. 1999. Willis GB. Cognitive Interviewing. A “How To” Guide. 1999.
12.
go back to reference Ericsson KA, Simon HA. Verbal reports as Data. Psychol Rev. 1980;87:215–51.CrossRef Ericsson KA, Simon HA. Verbal reports as Data. Psychol Rev. 1980;87:215–51.CrossRef
13.
go back to reference Anderson S, Barry M, Frerichs L, Wheeler SB, Halpern CT, Kaysin A, et al. Cognitive interviews to improve a patient-centered contraceptive effectiveness poster. Contraception. 2018;98:528–34.CrossRefPubMedPubMedCentral Anderson S, Barry M, Frerichs L, Wheeler SB, Halpern CT, Kaysin A, et al. Cognitive interviews to improve a patient-centered contraceptive effectiveness poster. Contraception. 2018;98:528–34.CrossRefPubMedPubMedCentral
14.
go back to reference Hannan A, Heckert J, James-Hawkins L, Yount KM. Cognitive interviewing to improve women’s empowerment questions in surveys: application to the health and nutrition and intrahousehold relationships modules for the project-level Women’s Empowerment in Agriculture Index. Matern Child Nutr. 2020;16:1–13.CrossRef Hannan A, Heckert J, James-Hawkins L, Yount KM. Cognitive interviewing to improve women’s empowerment questions in surveys: application to the health and nutrition and intrahousehold relationships modules for the project-level Women’s Empowerment in Agriculture Index. Matern Child Nutr. 2020;16:1–13.CrossRef
15.
go back to reference Rau NM, Basir MA, Flynn KE. Parental understanding of crucial medical jargon used in prenatal prematurity counseling. BMC Med Inform Decis Mak. 2020;20:1–7.CrossRef Rau NM, Basir MA, Flynn KE. Parental understanding of crucial medical jargon used in prenatal prematurity counseling. BMC Med Inform Decis Mak. 2020;20:1–7.CrossRef
16.
go back to reference Natamba BK, Kilama H, Arbach A, Achan J, Griffiths JK, Young SL. Reliability and validity of an individually focused food insecurity access scale for assessing inadequate access to food among pregnant Ugandan women of mixed HIV status. Public Health Nutr. 2014;18:2895–905.CrossRefPubMedPubMedCentral Natamba BK, Kilama H, Arbach A, Achan J, Griffiths JK, Young SL. Reliability and validity of an individually focused food insecurity access scale for assessing inadequate access to food among pregnant Ugandan women of mixed HIV status. Public Health Nutr. 2014;18:2895–905.CrossRefPubMedPubMedCentral
17.
go back to reference Malapit H, Sproule K, Kovarik C. Using Cognitive Interviewing to Improve the Women’s Empowerment in Agriculture Index Survey Instruments. Evidence from Bangladesh and Uganda. 2016. Malapit H, Sproule K, Kovarik C. Using Cognitive Interviewing to Improve the Women’s Empowerment in Agriculture Index Survey Instruments. Evidence from Bangladesh and Uganda. 2016.
18.
go back to reference Blencowe H, Bottecchia M, Kwesiga D, Akuze J, Haider MM, Galiwango E, et al. Stillbirth outcome capture and classification in population-based surveys: EN-INDEPTH study. Popul Health Metr. 2021;19. Blencowe H, Bottecchia M, Kwesiga D, Akuze J, Haider MM, Galiwango E, et al. Stillbirth outcome capture and classification in population-based surveys: EN-INDEPTH study. Popul Health Metr. 2021;19.
20.
go back to reference Kajungu D, Hirose A, Rutebemberwa E, Pariyo GW, Peterson S, Guwatudde D, et al. Cohort Profile: the Iganga-Mayuge Health and Demographic Surveillance Site, Uganda (IMHDSS, Uganda). Int J Epidemiol. Oxford University Press; 2020. p. 1082–1082G. Kajungu D, Hirose A, Rutebemberwa E, Pariyo GW, Peterson S, Guwatudde D, et al. Cohort Profile: the Iganga-Mayuge Health and Demographic Surveillance Site, Uganda (IMHDSS, Uganda). Int J Epidemiol. Oxford University Press; 2020. p. 1082–1082G.
22.
go back to reference ICF. Demographic and Health Survey. Interviewer’s Manual. Rockville, Maryland, U.S.A.; 2020. ICF. Demographic and Health Survey. Interviewer’s Manual. Rockville, Maryland, U.S.A.; 2020.
23.
go back to reference Sandelowski M. Focus on research methods: whatever happened to qualitative description? Res Nurs Heal. 2000;23:334.CrossRef Sandelowski M. Focus on research methods: whatever happened to qualitative description? Res Nurs Heal. 2000;23:334.CrossRef
25.
go back to reference Tobin GA, Begley CM. Methodological rigour within a qualitative framework. J Adv Nurs. 2004;48:388–96.CrossRefPubMed Tobin GA, Begley CM. Methodological rigour within a qualitative framework. J Adv Nurs. 2004;48:388–96.CrossRefPubMed
26.
go back to reference Nowell LS, Norris JM, White DE, Moules NJ. Thematic analysis: striving to meet the trustworthiness criteria. Int J Qual Methods. 2017;16:1–13.CrossRef Nowell LS, Norris JM, White DE, Moules NJ. Thematic analysis: striving to meet the trustworthiness criteria. Int J Qual Methods. 2017;16:1–13.CrossRef
27.
go back to reference Farmer T, Robinson K, Elliott SJ, Eyles J. Developing and implementing a triangulation protocol for qualitative health research. Qual Health Res. 2006;16:377–94.CrossRefPubMed Farmer T, Robinson K, Elliott SJ, Eyles J. Developing and implementing a triangulation protocol for qualitative health research. Qual Health Res. 2006;16:377–94.CrossRefPubMed
28.
go back to reference Liu L, Kalter HD, Chu Y, Kazmi N, Koffi AK, Amouzou A, et al. Understanding misclassification between neonatal deaths and stillbirths: empirical evidence from Malawi. PLoS ONE. 2016;11:e0168743.CrossRefPubMedPubMedCentral Liu L, Kalter HD, Chu Y, Kazmi N, Koffi AK, Amouzou A, et al. Understanding misclassification between neonatal deaths and stillbirths: empirical evidence from Malawi. PLoS ONE. 2016;11:e0168743.CrossRefPubMedPubMedCentral
29.
go back to reference Ashok S, Kim SS, Heidkamp RA, Munos MK, Menon P, Avula R. Using cognitive interviewing to bridge the intent-interpretation gap for nutrition coverage survey questions in India. Matern Child Nutr. 2022;18:1–14.CrossRef Ashok S, Kim SS, Heidkamp RA, Munos MK, Menon P, Avula R. Using cognitive interviewing to bridge the intent-interpretation gap for nutrition coverage survey questions in India. Matern Child Nutr. 2022;18:1–14.CrossRef
30.
go back to reference Graesser AC, Wiemer-Hastings K, Kreuz R, Wiemer-Hastings P, Marquis K. QUAID: a questionnaire evaluation aid for survey methodologists. Behav Res Methods Instruments Comput. 2000;32:254–62.CrossRef Graesser AC, Wiemer-Hastings K, Kreuz R, Wiemer-Hastings P, Marquis K. QUAID: a questionnaire evaluation aid for survey methodologists. Behav Res Methods Instruments Comput. 2000;32:254–62.CrossRef
32.
go back to reference Christou A, Alam A, Murtaza S, Hofiani S, Rasooly MH, Mubasher A, et al. How community and healthcare provider perceptions, practices and experiences influence reporting, disclosure and data collection on stillbirth: findings of a qualitative study in Afghanistan. Soc Sci Med. 2019;236:112413.CrossRefPubMed Christou A, Alam A, Murtaza S, Hofiani S, Rasooly MH, Mubasher A, et al. How community and healthcare provider perceptions, practices and experiences influence reporting, disclosure and data collection on stillbirth: findings of a qualitative study in Afghanistan. Soc Sci Med. 2019;236:112413.CrossRefPubMed
33.
go back to reference Yoder PS, Rosato M, Mahmud R, Fort A, Rahman F, Armstrong A, et al. Women’s recall of delivery and neonatal care in Bangladesh and Malawi. A study of terms, concepts and survey questions. Calverton, Maryland, USA; 2010. Yoder PS, Rosato M, Mahmud R, Fort A, Rahman F, Armstrong A, et al. Women’s recall of delivery and neonatal care in Bangladesh and Malawi. A study of terms, concepts and survey questions. Calverton, Maryland, USA; 2010.
Metadata
Title
Exploring women’s interpretations of survey questions on pregnancy and pregnancy outcomes: cognitive interviews in Iganga Mayuge, Uganda
Authors
Doris Kwesiga
Mats Malqvist
Christopher Garimoi Orach
Leif Eriksson
Hannah Blencowe
Peter Waiswa
Publication date
01-12-2024
Publisher
BioMed Central
Keyword
Miscarriage
Published in
Reproductive Health / Issue 1/2024
Electronic ISSN: 1742-4755
DOI
https://doi.org/10.1186/s12978-024-01745-w

Other articles of this Issue 1/2024

Reproductive Health 1/2024 Go to the issue