Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

The impact of self-interviews on response patterns for sensitive topics: a randomized trial of electronic delivery methods for a sexual behaviour questionnaire in rural South Africa

Authors: Guy Harling, Dumile Gumede, Tinofa Mutevedzi, Nuala McGrath, Janet Seeley, Deenan Pillay, Till W. Bärnighausen, Abraham J. Herbst

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

Self-interviews, where the respondent rather than the interviewer enters answers to questions, have been proposed as a way to reduce social desirability bias associated with interviewer-led interviews. Computer-assisted self-interviews (CASI) are commonly proposed since the computer programme can guide respondents; however they require both language and computer literacy. We evaluated the feasibility and acceptability of using electronic methods to administer quantitative sexual behaviour questionnaires in the Somkhele demographic surveillance area (DSA) in rural KwaZulu-Natal, South Africa.

Methods

We conducted a four-arm randomized trial of paper-and-pen-interview, computer-assisted personal-interview (CAPI), CASI and audio-CASI with an age-sex-urbanicity stratified sample of 504 adults resident in the DSA in 2015. We compared respondents’ answers to their responses to the same questions in previous surveillance rounds. We also conducted 48 cognitive interviews, dual-coding responses using the Framework approach.

Results

Three hundred forty (67%) individuals were interviewed and covariates and participation rates were balanced across arms. CASI and audio-CASI were significantly slower than interviewer-led interviews. Item non-response rates were higher in self-interview arms. In single-paper meta-analysis, self-interviewed individuals reported more socially undesirable sexual behaviours. Cognitive interviews found high acceptance of both self-interviews and the use of electronic methods, with some concerns that self-interview methods required more participant effort and literacy.

Conclusions

Electronic data collection methods, including self-interview methods, proved feasible and acceptable for completing quantitative sexual behaviour questionnaires in a poor, rural South African setting. However, each method had both benefits and costs, and the choice of method should be based on context-specific criteria.
Appendix
Available only for authorised users
Literature
1.
go back to reference Dare OO, Cleland JG. Reliability and validity of survey data on sexual behaviour. Health Transit Rev. 1994;4(Suppl):93–110.PubMed Dare OO, Cleland JG. Reliability and validity of survey data on sexual behaviour. Health Transit Rev. 1994;4(Suppl):93–110.PubMed
3.
go back to reference Nnko S, Boerma JT, Urassa M, Mwaluko G, Zaba B. Secretive females or swaggering males? An assessment of the quality of sexual partnership reporting in rural Tanzania. Soc Sci Med. 2004;59:299–310.CrossRefPubMed Nnko S, Boerma JT, Urassa M, Mwaluko G, Zaba B. Secretive females or swaggering males? An assessment of the quality of sexual partnership reporting in rural Tanzania. Soc Sci Med. 2004;59:299–310.CrossRefPubMed
4.
go back to reference Eagle DE, Proeschold-Bell RJ. Methodological considerations in the use of name generators and interpreters. Soc Networks. 2015;40:75–83.CrossRef Eagle DE, Proeschold-Bell RJ. Methodological considerations in the use of name generators and interpreters. Soc Networks. 2015;40:75–83.CrossRef
5.
go back to reference Warren JR, Halpern-Manners A. Panel conditioning in longitudinal social science surveys. Sociol Methods Res. 2012;41:491–534.CrossRef Warren JR, Halpern-Manners A. Panel conditioning in longitudinal social science surveys. Sociol Methods Res. 2012;41:491–534.CrossRef
6.
go back to reference Wringe A, Cremin I, Todd J, McGrath N, Kasamba I, Herbst K, et al. Comparative assessment of the quality of age-at-event reporting in three HIV cohort studies in sub-Saharan Africa. Sex Transm Infect. 2009;85:i56–63.CrossRefPubMedPubMedCentral Wringe A, Cremin I, Todd J, McGrath N, Kasamba I, Herbst K, et al. Comparative assessment of the quality of age-at-event reporting in three HIV cohort studies in sub-Saharan Africa. Sex Transm Infect. 2009;85:i56–63.CrossRefPubMedPubMedCentral
7.
go back to reference Shafer LA, Nsubuga RN, Seeley J, Levin J, Grosskurth H. Examining the components of population-level sexual behavior trends from 1993 to 2007 in an open Ugandan cohort. Sex Transm Dis. 2011;38:697–704.PubMed Shafer LA, Nsubuga RN, Seeley J, Levin J, Grosskurth H. Examining the components of population-level sexual behavior trends from 1993 to 2007 in an open Ugandan cohort. Sex Transm Dis. 2011;38:697–704.PubMed
8.
go back to reference Schwitters A, Swaminathan M, Serwadda D, Muyonga M, Shiraishi RW, Benech I, et al. Prevalence of rape and client-initiated gender-based violence among female sex workers: Kampala, Uganda, 2012. AIDS Behav. 2015;19:68–76.CrossRef Schwitters A, Swaminathan M, Serwadda D, Muyonga M, Shiraishi RW, Benech I, et al. Prevalence of rape and client-initiated gender-based violence among female sex workers: Kampala, Uganda, 2012. AIDS Behav. 2015;19:68–76.CrossRef
9.
go back to reference Al-Tayyib AA, Rogers SM, Gribble JN, Villarroel M, Turner CF. Effect of low medical literacy on health survey measurements. Am J Public Health. 2002;92:1478–80.CrossRefPubMedPubMedCentral Al-Tayyib AA, Rogers SM, Gribble JN, Villarroel M, Turner CF. Effect of low medical literacy on health survey measurements. Am J Public Health. 2002;92:1478–80.CrossRefPubMedPubMedCentral
10.
go back to reference Langhaug LF, Cheung YB, Pascoe SJ, Chirawu P, Woelk G, Hayes RJ, et al. How you ask really matters: randomised comparison of four sexual behaviour questionnaire delivery modes in Zimbabwean youth. Sex Transm Infect. 2011;87:165.CrossRefPubMed Langhaug LF, Cheung YB, Pascoe SJ, Chirawu P, Woelk G, Hayes RJ, et al. How you ask really matters: randomised comparison of four sexual behaviour questionnaire delivery modes in Zimbabwean youth. Sex Transm Infect. 2011;87:165.CrossRefPubMed
11.
go back to reference Phillips AE, Gomez GB, Boily MC, Garnett GP. A systematic review and meta-analysis of quantitative interviewing tools to investigate self-reported HIV and STI associated behaviours in low- and middle-income countries. Int J Epidemiol. 2010;39:1541–55.CrossRefPubMed Phillips AE, Gomez GB, Boily MC, Garnett GP. A systematic review and meta-analysis of quantitative interviewing tools to investigate self-reported HIV and STI associated behaviours in low- and middle-income countries. Int J Epidemiol. 2010;39:1541–55.CrossRefPubMed
12.
go back to reference McCallum EB, Peterson ZD. Investigating the impact of inquiry mode on self-reported sexual behavior: theoretical considerations and review of the literature. J Sex Res. 2012;49:212–26.CrossRefPubMed McCallum EB, Peterson ZD. Investigating the impact of inquiry mode on self-reported sexual behavior: theoretical considerations and review of the literature. J Sex Res. 2012;49:212–26.CrossRefPubMed
13.
go back to reference Gnambs T, Kaspar K. Disclosure of sensitive behaviors across self-administered survey modes: a meta-analysis. Behav Res Methods. 2015;47:1237–59.CrossRefPubMed Gnambs T, Kaspar K. Disclosure of sensitive behaviors across self-administered survey modes: a meta-analysis. Behav Res Methods. 2015;47:1237–59.CrossRefPubMed
14.
go back to reference Gregson S, Mushati P, White P, Mlilo M, Mundandi C, Nyamukapa C. Informal confidential voting interview methods and temporal changes in reported sexual risk behaviour for HIV transmission in sub-Saharan Africa. Sex Transm Infect. 2004;80:ii36–42.CrossRefPubMedPubMedCentral Gregson S, Mushati P, White P, Mlilo M, Mundandi C, Nyamukapa C. Informal confidential voting interview methods and temporal changes in reported sexual risk behaviour for HIV transmission in sub-Saharan Africa. Sex Transm Infect. 2004;80:ii36–42.CrossRefPubMedPubMedCentral
15.
go back to reference Hewett PC, Mensch BS, Erulkar AS. Consistency in the reporting of sexual behaviour by adolescent girls in Kenya: a comparison of interviewing methods. Sex Transm Infect. 2004;80:ii43–8.CrossRefPubMedPubMedCentral Hewett PC, Mensch BS, Erulkar AS. Consistency in the reporting of sexual behaviour by adolescent girls in Kenya: a comparison of interviewing methods. Sex Transm Infect. 2004;80:ii43–8.CrossRefPubMedPubMedCentral
16.
go back to reference Langhaug LF, Sherr L, Cowan F. How to improve the validity of sexual behaviour reporting: systematic review of questionnaire delivery modes in developing countries. Tropical Med Int Health. 2010;15:362–81.CrossRef Langhaug LF, Sherr L, Cowan F. How to improve the validity of sexual behaviour reporting: systematic review of questionnaire delivery modes in developing countries. Tropical Med Int Health. 2010;15:362–81.CrossRef
17.
go back to reference Gorbach PM, Mensch BS, Husnik M, Coly A, Mâsse B, Makanani B, et al. Effect of computer-assisted interviewing on self-reported sexual behavior data in a Microbicide clinical trial. AIDS Behav. 2013;17:790–800.CrossRefPubMedPubMedCentral Gorbach PM, Mensch BS, Husnik M, Coly A, Mâsse B, Makanani B, et al. Effect of computer-assisted interviewing on self-reported sexual behavior data in a Microbicide clinical trial. AIDS Behav. 2013;17:790–800.CrossRefPubMedPubMedCentral
18.
go back to reference Houle B, Angotti N, Clark SJ, Williams J, Gómez-Olivé FX, Menken J, et al. Let’s talk about sex, maybe interviewers, respondents, and sexual behavior reporting in rural South Africa. Field Methods 2016;28(2):112–132 Houle B, Angotti N, Clark SJ, Williams J, Gómez-Olivé FX, Menken J, et al. Let’s talk about sex, maybe interviewers, respondents, and sexual behavior reporting in rural South Africa. Field Methods 2016;28(2):112–132
19.
go back to reference Poulin M. Reporting on first sexual experience: the importance of interviewer-respondent interaction. Demog Res. 2010;22:237.CrossRef Poulin M. Reporting on first sexual experience: the importance of interviewer-respondent interaction. Demog Res. 2010;22:237.CrossRef
20.
go back to reference Beauclair R, Meng F, Deprez N, Temmerman M, Welte A, Hens N, et al. Evaluating audio computer assisted self-interviews in urban south African communities: evidence for good suitability and reduced social desirability bias of a cross-sectional survey on sexual behaviour. BMC Med Res Methodol. 2013;13:1.CrossRef Beauclair R, Meng F, Deprez N, Temmerman M, Welte A, Hens N, et al. Evaluating audio computer assisted self-interviews in urban south African communities: evidence for good suitability and reduced social desirability bias of a cross-sectional survey on sexual behaviour. BMC Med Res Methodol. 2013;13:1.CrossRef
21.
go back to reference Adebajo S, Obianwu O, Eluwa G, Vu L, Oginni A, Tun W, et al. Comparison of audio computer assisted self-interview and face-to-face interview methods in eliciting HIV-related risks among men who have sex with men and men who inject drugs in Nigeria. PLoS One. 2014;9:e81981.CrossRefPubMedPubMedCentral Adebajo S, Obianwu O, Eluwa G, Vu L, Oginni A, Tun W, et al. Comparison of audio computer assisted self-interview and face-to-face interview methods in eliciting HIV-related risks among men who have sex with men and men who inject drugs in Nigeria. PLoS One. 2014;9:e81981.CrossRefPubMedPubMedCentral
22.
go back to reference Mensch BS, Hewett PC, Abbott S, Rankin J, Littlefield S, Ahmed K, et al. Assessing the reporting of adherence and sexual activity in a simulated microbicide trial in South Africa: an interview mode experiment using a placebo gel. AIDS Behav. 2011;15:407–21.CrossRefPubMed Mensch BS, Hewett PC, Abbott S, Rankin J, Littlefield S, Ahmed K, et al. Assessing the reporting of adherence and sexual activity in a simulated microbicide trial in South Africa: an interview mode experiment using a placebo gel. AIDS Behav. 2011;15:407–21.CrossRefPubMed
23.
go back to reference Kelly CA, Hewett PC, Mensch BS, Rankin JC, Nsobya SL, Kalibala S, et al. Using biomarkers to assess the validity of sexual behavior reporting across interview modes among young women in Kampala. Uganda Stud Fam Plann. 2014;45:43–58.CrossRefPubMed Kelly CA, Hewett PC, Mensch BS, Rankin JC, Nsobya SL, Kalibala S, et al. Using biomarkers to assess the validity of sexual behavior reporting across interview modes among young women in Kampala. Uganda Stud Fam Plann. 2014;45:43–58.CrossRefPubMed
24.
go back to reference Tanser F, Hosegood V, Bärnighausen T, Herbst K, Nyirenda M, Muhwava W, et al. Cohort profile: Africa Centre demographic information system (ACDIS) and population-based HIV survey. Int J Epidemiol. 2008;37:956–62.CrossRefPubMed Tanser F, Hosegood V, Bärnighausen T, Herbst K, Nyirenda M, Muhwava W, et al. Cohort profile: Africa Centre demographic information system (ACDIS) and population-based HIV survey. Int J Epidemiol. 2008;37:956–62.CrossRefPubMed
25.
go back to reference McGrath N, Eaton JW, Bärnighausen TW, Tanser F, Newell ML. Sexual behaviour in a rural high HIV prevalence south African community: time trends in the antiretroviral treatment era. AIDS. 2013;27:2461–70.CrossRefPubMedPubMedCentral McGrath N, Eaton JW, Bärnighausen TW, Tanser F, Newell ML. Sexual behaviour in a rural high HIV prevalence south African community: time trends in the antiretroviral treatment era. AIDS. 2013;27:2461–70.CrossRefPubMedPubMedCentral
26.
go back to reference Shisana O, Rehle T, Simbayi LC, Zuma K, Jooste S, Zungu N, et al. South African national HIV prevalence, incidence and behaviour survey, 2012. Cape Town: Human Sciences Research Council; 2014. Shisana O, Rehle T, Simbayi LC, Zuma K, Jooste S, Zungu N, et al. South African national HIV prevalence, incidence and behaviour survey, 2012. Cape Town: Human Sciences Research Council; 2014.
28.
go back to reference Hartung C, Lerer A, Anokwa Y, Tseng C, Brunette W, Borriello G. Open data kit: tools to build information services for developing regions. In Proceedings of the 4th ACM/IEEE International Conference on Information and Communication Technologies and Development. ACM. 2010;18. http://dx.doi.org/10.1145/2369220.2369236. Hartung C, Lerer A, Anokwa Y, Tseng C, Brunette W, Borriello G. Open data kit: tools to build information services for developing regions. In Proceedings of the 4th ACM/IEEE International Conference on Information and Communication Technologies and Development. ACM. 2010;18. http://​dx.​doi.​org/​10.​1145/​2369220.​2369236.
29.
go back to reference Beatty PC, Willis GB. Research synthesis: the practice of cognitive interviewing. Public Opin Q. 2007;71:287–311.CrossRef Beatty PC, Willis GB. Research synthesis: the practice of cognitive interviewing. Public Opin Q. 2007;71:287–311.CrossRef
30.
go back to reference Tourangeau R. Cognitive sciences and survey methods. In: Jabine TB, Straf M, Tanur J, Tourangeau R, editors. Cognitive aspects of survey methodology: building a bridge between disciplines. Washington, DC: National Academy Press; 1984. p. 73–100. Tourangeau R. Cognitive sciences and survey methods. In: Jabine TB, Straf M, Tanur J, Tourangeau R, editors. Cognitive aspects of survey methodology: building a bridge between disciplines. Washington, DC: National Academy Press; 1984. p. 73–100.
31.
go back to reference Aicken CR, Gray M, Clifton S, Tanton C, Field N, Sonnenberg P, et al. Improving questions on sexual partnerships: lessons learned from cognitive interviews for Britain’s third National Survey of sexual attitudes and lifestyles (“Natsal-3”). Arch Sex Behav. 2013;42:173–85.CrossRefPubMed Aicken CR, Gray M, Clifton S, Tanton C, Field N, Sonnenberg P, et al. Improving questions on sexual partnerships: lessons learned from cognitive interviews for Britain’s third National Survey of sexual attitudes and lifestyles (“Natsal-3”). Arch Sex Behav. 2013;42:173–85.CrossRefPubMed
32.
go back to reference Mavhu W, Langhaug L, Manyonga B, Power R, Cowan F. What is ‘sex’exactly? Using cognitive interviewing to improve the validity of sexual behaviour reporting among young people in rural Zimbabwe. Cult Health Sex. 2008;10:563–72.CrossRefPubMed Mavhu W, Langhaug L, Manyonga B, Power R, Cowan F. What is ‘sex’exactly? Using cognitive interviewing to improve the validity of sexual behaviour reporting among young people in rural Zimbabwe. Cult Health Sex. 2008;10:563–72.CrossRefPubMed
33.
go back to reference McShane BB, Böckenhold U. Single paper meta-analysis: benefits for study summary, theory-testing, and replicability. J Consum Res. 2017;43:1048–63. McShane BB, Böckenhold U. Single paper meta-analysis: benefits for study summary, theory-testing, and replicability. J Consum Res. 2017;43:1048–63.
34.
go back to reference Ndinda C, Chimbwete C, McGrath N, Pool R. Perceptions of anal sex in rural South Africa. Cult Health Sex. 2008;10:205–12.CrossRefPubMed Ndinda C, Chimbwete C, McGrath N, Pool R. Perceptions of anal sex in rural South Africa. Cult Health Sex. 2008;10:205–12.CrossRefPubMed
35.
36.
go back to reference Ryan RM, Deci EL. Intrinsic and extrinsic motivations: classic definitions and new directions. Contemp Educ Psychol. 2000;25:54–67.CrossRefPubMed Ryan RM, Deci EL. Intrinsic and extrinsic motivations: classic definitions and new directions. Contemp Educ Psychol. 2000;25:54–67.CrossRefPubMed
Metadata
Title
The impact of self-interviews on response patterns for sensitive topics: a randomized trial of electronic delivery methods for a sexual behaviour questionnaire in rural South Africa
Authors
Guy Harling
Dumile Gumede
Tinofa Mutevedzi
Nuala McGrath
Janet Seeley
Deenan Pillay
Till W. Bärnighausen
Abraham J. Herbst
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0403-8

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue