Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Human Immunodeficiency Virus | Research article

The influence of interviewers on survey responses among female sex workers in Zambia

Authors: Guy Harling, Michael M. Chanda, Katrina F. Ortblad, Magdalene Mwale, Steven Chongo, Catherine Kanchele, Nyambe Kamungoma, Leah G. Barresi, Till Bärnighausen, Catherine E. Oldenburg

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

Interviewers can substantially affect self-reported data. This may be due to random variation in interviewers’ ability to put respondents at ease or in how they frame questions. It may also be due to systematic differences such as social distance between interviewer and respondent (e.g., by age, gender, ethnicity) or different perceptions of what interviewers consider socially desirable responses. Exploration of such variation is limited, especially in stigmatized populations.

Methods

We analyzed data from a randomized controlled trial of HIV self-testing amongst 965 female sex workers (FSWs) in Zambian towns. In the trial, 16 interviewers were randomly assigned to respondents. We used hierarchical regression models to examine how interviewers may both affect responses on more and less sensitive topics, and confound associations between key risk factors and HIV self-test use.

Results

Model variance (ICC) at the interviewer level was over 15% for most topics. ICC was lower for socio-demographic and cognitively simple questions, and highest for sexual behaviour, substance use, violence and psychosocial wellbeing questions. Respondents reported significantly lower socioeconomic status and more sex-work related violence to female interviewers. Not accounting for interviewer identity in regressions predicting HIV self-test behaviour led to coefficients moving from non-significant to significant.

Conclusions

We found substantial interviewer-level effects for prevalence and associational outcomes among Zambian FSWs, particularly for sensitive questions. Our findings highlight the importance of careful training and response monitoring to minimize inter-interviewer variation, of considering social distance when selecting interviewers and of evaluating whether interviewers are driving key findings in self-reported data.

Trial registration

clinicaltrials.gov NCT02827240. Registered 11 July 2016.
Appendix
Available only for authorised users
Literature
1.
go back to reference Tourangeau R, Yan T. Sensitive questions in surveys. Psychol Bull. 2007;133:859–83.CrossRef Tourangeau R, Yan T. Sensitive questions in surveys. Psychol Bull. 2007;133:859–83.CrossRef
2.
go back to reference Dijkstra W. How interviewer variance can bias the results of research on interviewer effects. Qual Quant. 1983;17:179–87.CrossRef Dijkstra W. How interviewer variance can bias the results of research on interviewer effects. Qual Quant. 1983;17:179–87.CrossRef
3.
go back to reference West BT, Blom AG. Explaining interviewer effects: a research synthesis. J Survey Stat Method. 2016;5:175–211. West BT, Blom AG. Explaining interviewer effects: a research synthesis. J Survey Stat Method. 2016;5:175–211.
4.
go back to reference Tu S-H, Liao P-S. Social distance, respondent cooperation and item nonresponse in sex survey. Qual Quant. 2007;41:177–99.CrossRef Tu S-H, Liao P-S. Social distance, respondent cooperation and item nonresponse in sex survey. Qual Quant. 2007;41:177–99.CrossRef
5.
go back to reference Krumpal I. Determinants of social desirability bias in sensitive surveys: a literature review. Qual Quant. 2013;47:2025–47.CrossRef Krumpal I. Determinants of social desirability bias in sensitive surveys: a literature review. Qual Quant. 2013;47:2025–47.CrossRef
6.
go back to reference Diekman AB, Schneider MC. A social role theory perspective on gender gaps in political attitudes. Psychol Women Q. 2010;34:486–97.CrossRef Diekman AB, Schneider MC. A social role theory perspective on gender gaps in political attitudes. Psychol Women Q. 2010;34:486–97.CrossRef
7.
go back to reference Lipps O, Lutz G. Gender of Interviewer Effects in a Multi-topic Centralized CATI Panel Survey. Methods Data, Anal. 2017;11:67–86. Lipps O, Lutz G. Gender of Interviewer Effects in a Multi-topic Centralized CATI Panel Survey. Methods Data, Anal. 2017;11:67–86.
8.
go back to reference Paulhus DL. Socially desirable responding: The evolution of a construct. In: Braun HI, Jackson DN, Wiley DE, editors. The role of constructs in psychological and educational measurement. Mahwah: Lawrence Erlbaum Associates; 2002. p. 49–69. Paulhus DL. Socially desirable responding: The evolution of a construct. In: Braun HI, Jackson DN, Wiley DE, editors. The role of constructs in psychological and educational measurement. Mahwah: Lawrence Erlbaum Associates; 2002. p. 49–69.
9.
go back to reference Pollner M. The effects of interviewer gender in mental health interviews. J Nerv Ment Dis. 1998;186:369–73.CrossRef Pollner M. The effects of interviewer gender in mental health interviews. J Nerv Ment Dis. 1998;186:369–73.CrossRef
10.
go back to reference Nass C, Robles E, Heenan C, Bienstock H, Treinen M. Speech-based disclosure systems: effects of modality, gender of prompt, and gender of user. Int J Speech Technol. 2003;6:113–21.CrossRef Nass C, Robles E, Heenan C, Bienstock H, Treinen M. Speech-based disclosure systems: effects of modality, gender of prompt, and gender of user. Int J Speech Technol. 2003;6:113–21.CrossRef
11.
go back to reference Dykema J, Diloreto K, Price JL, White E, Schaeffer NC. ACASI gender-of-interviewer voice effects on reports to questions about sensitive behaviors among young adults. Public Opin Q. 2012;76:311–25.CrossRef Dykema J, Diloreto K, Price JL, White E, Schaeffer NC. ACASI gender-of-interviewer voice effects on reports to questions about sensitive behaviors among young adults. Public Opin Q. 2012;76:311–25.CrossRef
12.
go back to reference Davis RE, Couper MP, Janz NK, Caldwell CH, Resnicow K. Interviewer effects in public health surveys. Health Educ Res. 2010;25:14–26.CrossRef Davis RE, Couper MP, Janz NK, Caldwell CH, Resnicow K. Interviewer effects in public health surveys. Health Educ Res. 2010;25:14–26.CrossRef
13.
go back to reference Wilson SR, Brown NL, Mejia C, Lavori PW. Effects of interviewer characteristics on reported sexual behavior of California Latino couples. Hisp J Behav Sci. 2002;24:38–62.CrossRef Wilson SR, Brown NL, Mejia C, Lavori PW. Effects of interviewer characteristics on reported sexual behavior of California Latino couples. Hisp J Behav Sci. 2002;24:38–62.CrossRef
14.
go back to reference Catania JA, Binson D, Canchola J, Pollack LM, Hauck W, Coates TJ. Effects of interviewer gender, interviewer choice, and item wording on responses to questions concerning sexual behaviour. Public Opin Q. 1996;60:345–75.CrossRef Catania JA, Binson D, Canchola J, Pollack LM, Hauck W, Coates TJ. Effects of interviewer gender, interviewer choice, and item wording on responses to questions concerning sexual behaviour. Public Opin Q. 1996;60:345–75.CrossRef
15.
go back to reference Johnson TP, Parsons JA. Interviewer effects on self-reported substance use among homeless persons. Addict Behav. 1994;19:83–93.CrossRef Johnson TP, Parsons JA. Interviewer effects on self-reported substance use among homeless persons. Addict Behav. 1994;19:83–93.CrossRef
16.
go back to reference Fuchs M. Gender-of-interviewer effects in a video-enhanced web survey: results from a randomized field experiment. Soc Psychol. 2009;40:37–42.CrossRef Fuchs M. Gender-of-interviewer effects in a video-enhanced web survey: results from a randomized field experiment. Soc Psychol. 2009;40:37–42.CrossRef
17.
go back to reference Chun H, Tavarez MI, Dann GE, Anastario MP. Interviewer gender and self-reported sexual behavior and mental health among male military personnel. Int J Public Health. 2011;56:225–9.CrossRef Chun H, Tavarez MI, Dann GE, Anastario MP. Interviewer gender and self-reported sexual behavior and mental health among male military personnel. Int J Public Health. 2011;56:225–9.CrossRef
18.
go back to reference McCombie SC, Anarfi JK. The influence of sex of interviewer on the results of an AIDS survey in Ghana. Hum Organ. 2002;61:51–7.CrossRef McCombie SC, Anarfi JK. The influence of sex of interviewer on the results of an AIDS survey in Ghana. Hum Organ. 2002;61:51–7.CrossRef
19.
go back to reference Houle B, Angotti N, Clark SJ, Williams J, Gómez-Olivé FX, Menken J, et al. Let’s talk about sex, maybe interviewers, respondents, and sexual behavior reporting in rural South Africa. Field Methods. 2016;28:112–32.CrossRef Houle B, Angotti N, Clark SJ, Williams J, Gómez-Olivé FX, Menken J, et al. Let’s talk about sex, maybe interviewers, respondents, and sexual behavior reporting in rural South Africa. Field Methods. 2016;28:112–32.CrossRef
20.
go back to reference Agula J, Barrett JB, Tobi H. The other side of rapport: data collection mode and interviewer gender effects on sexual health reporting in Ghana. Afr J Reprod Health. 2015;19:111–7.PubMed Agula J, Barrett JB, Tobi H. The other side of rapport: data collection mode and interviewer gender effects on sexual health reporting in Ghana. Afr J Reprod Health. 2015;19:111–7.PubMed
21.
go back to reference Fraga S. Methodological and ethical challenges in violence research. Porto Biomed J. 2016;1:77–80.CrossRef Fraga S. Methodological and ethical challenges in violence research. Porto Biomed J. 2016;1:77–80.CrossRef
22.
go back to reference Ellsberg M, Heise L, Pena R, Agurto S, Winkvist A. Researching domestic violence against women: methodological and ethical considerations. Stud Fam Plan. 2001;32:1–16.CrossRef Ellsberg M, Heise L, Pena R, Agurto S, Winkvist A. Researching domestic violence against women: methodological and ethical considerations. Stud Fam Plan. 2001;32:1–16.CrossRef
23.
go back to reference Jewkes R, Watts C, Abrahams N, Penn-Kekana L, Garcia-Moreno C. Ethical and methodological issues in conducting research on gender-based violence in southern Africa. Reprod Health Matters. 2000;8:93–103.CrossRef Jewkes R, Watts C, Abrahams N, Penn-Kekana L, Garcia-Moreno C. Ethical and methodological issues in conducting research on gender-based violence in southern Africa. Reprod Health Matters. 2000;8:93–103.CrossRef
24.
go back to reference Jewkes RK, Levin JB, Penn-Kekana LA. Gender inequalities, intimate partner violence and HIV preventive practices: findings of a south African cross-sectional study. Soc Sci Med. 2003;56:125–34.CrossRef Jewkes RK, Levin JB, Penn-Kekana LA. Gender inequalities, intimate partner violence and HIV preventive practices: findings of a south African cross-sectional study. Soc Sci Med. 2003;56:125–34.CrossRef
25.
go back to reference Abramsky T, Watts CH, Garcia-Moreno C, Devries K, Kiss L, Ellsberg M, et al. What factors are associated with recent intimate partner violence? Findings from the WHO multi-country study on women's health and domestic violence. BMC Public Health. 2011;11:109.CrossRef Abramsky T, Watts CH, Garcia-Moreno C, Devries K, Kiss L, Ellsberg M, et al. What factors are associated with recent intimate partner violence? Findings from the WHO multi-country study on women's health and domestic violence. BMC Public Health. 2011;11:109.CrossRef
26.
go back to reference Fincher D, VanderEnde K, Colbert K, Houry D, Smith LS, Yount KM. Effect of face-to-face interview versus computer-assisted self-interview on disclosure of intimate partner violence among African American women in WIC clinics. J Interpers Violence. 2015;30:818–38.CrossRef Fincher D, VanderEnde K, Colbert K, Houry D, Smith LS, Yount KM. Effect of face-to-face interview versus computer-assisted self-interview on disclosure of intimate partner violence among African American women in WIC clinics. J Interpers Violence. 2015;30:818–38.CrossRef
27.
go back to reference Oldenburg CE, Ortblad KF, Chanda MM, Mwanda K, Nicodemus W, Sikaundi R, et al. Zambian peer educators for HIV self-testing (ZEST) study: rationale and design of a cluster randomised trial of HIV self-testing among female sex workers in Zambia. BMJ Open. 2017;7:e014780.CrossRef Oldenburg CE, Ortblad KF, Chanda MM, Mwanda K, Nicodemus W, Sikaundi R, et al. Zambian peer educators for HIV self-testing (ZEST) study: rationale and design of a cluster randomised trial of HIV self-testing among female sex workers in Zambia. BMJ Open. 2017;7:e014780.CrossRef
28.
go back to reference Chanda MM, Ortblad KF, Mwale M, Chongo S, Kanchele C, Kamungoma N, et al. HIV self-testing among female sex workers in Zambia: a randomized controlled trial. PLoS Med. 2017;14:e1002442.CrossRef Chanda MM, Ortblad KF, Mwale M, Chongo S, Kanchele C, Kamungoma N, et al. HIV self-testing among female sex workers in Zambia: a randomized controlled trial. PLoS Med. 2017;14:e1002442.CrossRef
29.
go back to reference Jain S, Greene M, Douglas Z, Betron M, Fritz K. Risky business made safer - corridors of Hope: an HIV prevention program in Zambian border and transit towns. Case study series: task order 1. Arlington: USAID’s AIDS Support and Technical Assistance Resources, AIDSTAR-One; 2011. Jain S, Greene M, Douglas Z, Betron M, Fritz K. Risky business made safer - corridors of Hope: an HIV prevention program in Zambian border and transit towns. Case study series: task order 1. Arlington: USAID’s AIDS Support and Technical Assistance Resources, AIDSTAR-One; 2011.
30.
go back to reference Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B. 1995;57:289–300. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B. 1995;57:289–300.
31.
go back to reference Collins M. Interviewer variability: a review of the problem. J Mark Res Soc. 1980;22:77–95. Collins M. Interviewer variability: a review of the problem. J Mark Res Soc. 1980;22:77–95.
32.
go back to reference O’Muircheartaigh C, Campanelli P. The relative impact of interviewer effects and sample design effects on survey precision. J R Stat Soc: Ser A (Stat Soc). 1998;161:63–77.CrossRef O’Muircheartaigh C, Campanelli P. The relative impact of interviewer effects and sample design effects on survey precision. J R Stat Soc: Ser A (Stat Soc). 1998;161:63–77.CrossRef
33.
go back to reference Marra G, Radice R, Bärnighausen T, Wood SN, McGovern ME. A simultaneous equation approach to estimating HIV prevalence with non-ignorable missing responses. J Am Stat Assoc. 2016;112:484–96.CrossRef Marra G, Radice R, Bärnighausen T, Wood SN, McGovern ME. A simultaneous equation approach to estimating HIV prevalence with non-ignorable missing responses. J Am Stat Assoc. 2016;112:484–96.CrossRef
34.
go back to reference Harling G, Moyo S, McGovern ME, Mabaso M, Marra G, Bärnighausen T, et al. National South African HIV prevalence estimates robust despite substantial test non-participation. S Afr Med J. 2017;107:590–4.CrossRef Harling G, Moyo S, McGovern ME, Mabaso M, Marra G, Bärnighausen T, et al. National South African HIV prevalence estimates robust despite substantial test non-participation. S Afr Med J. 2017;107:590–4.CrossRef
Metadata
Title
The influence of interviewers on survey responses among female sex workers in Zambia
Authors
Guy Harling
Michael M. Chanda
Katrina F. Ortblad
Magdalene Mwale
Steven Chongo
Catherine Kanchele
Nyambe Kamungoma
Leah G. Barresi
Till Bärnighausen
Catherine E. Oldenburg
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0703-2

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue