Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2014

Open Access 01-12-2014 | Research article

Survey mode and asking about future intentions did not impact self-reported colorectal cancer screening accuracy

Authors: Timothy J Beebe, Jeanette Y Ziegenfuss, Sarah M Jenkins, Kandace A Lackore, Timothy P Johnson

Published in: BMC Medical Research Methodology | Issue 1/2014

Login to get access

Abstract

Background

Self-reported colorectal cancer (CRC) screening behavior is often subject to over-reporting bias. We examined how the inclusion of a future intention to screen item (viz. asking about future intentions to get screened before asking about past screening) and mode of survey administration impacted the accuracy of self-reported CRC screening.

Methods

The target population was men and women between 49 and 85 years of age who lived in Olmsted County, MN, for at least 10 years at the time of the study. Eligible residents were randomized into four groups representing the presence or absence the future intention to screen item in the questionnaire and administration mode (mail vs. telephone). A total of 3,638 cases were available for analysis with 914, 838, 956, and 930 in the mail/future intention, mail/no future intention, telephone/future intention, and telephone/no future intention conditions, respectively. False positives were defined as self-reporting being screened among those with no documented history of screening in medical records and false negatives as not self-reporting screening among those with history of screening.

Results

Comparing false positive and false negative reporting rates for each specific screening test among the responders at the bivariate level, regardless of mode, there were no statistically significant differences by the presence or absence of a preceding future intention question. When considering all tests combined, the percentage of false negatives within the telephone mode was slightly higher for those with the future intention question (6.7% vs 4.2%, p = 0.04). Multivariate models that considered the independent impact of the future intention question and mode, affirmed the results observed at the bivariate level. However, individuals in the telephone arm (compared to mail) were slightly (though not significantly) more likely to report a false positive (36.4% vs 31.8%, OR = 1.11, p = 0.55).

Conclusion

It may be that in the context of a questionnaire that is clearly focused on CRC and with specific descriptions of the various CRC screening tests, certain design features such as including intention to screen items or mode of administration will have very little impact on the accuracy of self-reported CRC screening.
Literature
1.
go back to reference Vernon SW, Briss PA, Tiro JA, Warnecke RB: Some methodologic lessons learned from cancer screening research. Cancer. 2004, 101 (5 Suppl): 1131-1145.CrossRefPubMed Vernon SW, Briss PA, Tiro JA, Warnecke RB: Some methodologic lessons learned from cancer screening research. Cancer. 2004, 101 (5 Suppl): 1131-1145.CrossRefPubMed
2.
go back to reference Warnecke RB, Sudman S, Johnson TP, O’Rourke D, Davis AM, Jobe JB: Cognitive aspects of recalling and reporting health-related events: Papanicolaou smears, clinical breast examinations, and mammograms. Am J Epidemiol. 1997, 146 (11): 982-992. 10.1093/oxfordjournals.aje.a009226.CrossRefPubMed Warnecke RB, Sudman S, Johnson TP, O’Rourke D, Davis AM, Jobe JB: Cognitive aspects of recalling and reporting health-related events: Papanicolaou smears, clinical breast examinations, and mammograms. Am J Epidemiol. 1997, 146 (11): 982-992. 10.1093/oxfordjournals.aje.a009226.CrossRefPubMed
3.
go back to reference Baier M, Calonge N, Cutter G, McClatchey M, Schoentgen S, Hines S, Marcus A, Ahnen D: Validity of self-reported colorectal cancer screening behavior. Cancer Epidemiol Biomarkers Prev. 2000, 9 (2): 229-232.PubMed Baier M, Calonge N, Cutter G, McClatchey M, Schoentgen S, Hines S, Marcus A, Ahnen D: Validity of self-reported colorectal cancer screening behavior. Cancer Epidemiol Biomarkers Prev. 2000, 9 (2): 229-232.PubMed
4.
go back to reference Madlensky L, McLaughlin J, Goel V: A comparison of self-reported colorectal cancer screening with medical records. Cancer Epidemiol Biomarkers Prev. 2003, 12 (7): 656-659.PubMed Madlensky L, McLaughlin J, Goel V: A comparison of self-reported colorectal cancer screening with medical records. Cancer Epidemiol Biomarkers Prev. 2003, 12 (7): 656-659.PubMed
5.
go back to reference Rauscher GH, Johnson TP, Cho YI, Walk JA: Accuracy of self-reported cancer-screening histories: a meta-analysis. Cancer Epidemiol Biomarkers Prev. 2008, 17 (4): 748-757. 10.1158/1055-9965.EPI-07-2629.CrossRefPubMed Rauscher GH, Johnson TP, Cho YI, Walk JA: Accuracy of self-reported cancer-screening histories: a meta-analysis. Cancer Epidemiol Biomarkers Prev. 2008, 17 (4): 748-757. 10.1158/1055-9965.EPI-07-2629.CrossRefPubMed
6.
go back to reference Johnson TP, O’Rourke DP, Burris JE, Warnecke RB: An investigation of the effects of social desirability on the validity of self-reports of cancer screening behaviors. Med Care. 2005, 43 (6): 565-573. 10.1097/01.mlr.0000163648.26493.70.CrossRefPubMed Johnson TP, O’Rourke DP, Burris JE, Warnecke RB: An investigation of the effects of social desirability on the validity of self-reports of cancer screening behaviors. Med Care. 2005, 43 (6): 565-573. 10.1097/01.mlr.0000163648.26493.70.CrossRefPubMed
7.
go back to reference Beebe TJ, Jenkins SM, Anderson KJ, Davern ME, Rockwood TH: The effects of survey mode and asking about future intentions on self-reports of colorectal cancer screening. Cancer Epidemiol Biomarkers Prev. 2008, 17 (4): 785-790. 10.1158/1055-9965.EPI-07-2622.CrossRefPubMed Beebe TJ, Jenkins SM, Anderson KJ, Davern ME, Rockwood TH: The effects of survey mode and asking about future intentions on self-reports of colorectal cancer screening. Cancer Epidemiol Biomarkers Prev. 2008, 17 (4): 785-790. 10.1158/1055-9965.EPI-07-2622.CrossRefPubMed
8.
go back to reference Vernon SW, Meissner H, Klabunde C, Rimer BK, Ahnen DJ, Bastani R, Mandelson MT, Nadel MR, Sheinfeld-Gorin S, Zapka J: Measures for ascertaining use of colorectal cancer screening in behavioral, health services, and epidemiologic research. Cancer Epidemiol Biomarkers Prev. 2004, 13 (6): 898-905.PubMed Vernon SW, Meissner H, Klabunde C, Rimer BK, Ahnen DJ, Bastani R, Mandelson MT, Nadel MR, Sheinfeld-Gorin S, Zapka J: Measures for ascertaining use of colorectal cancer screening in behavioral, health services, and epidemiologic research. Cancer Epidemiol Biomarkers Prev. 2004, 13 (6): 898-905.PubMed
9.
go back to reference St Sauver JL, Grossardt BR, Leibson CL, Yawn BP, Melton LJ, Rocca WA: Generalizability of epidemiological findings and public health decisions: an illustration from the Rochester Epidemiology Project. Mayo Clin Proc. 2012, 87 (2): 151-160. 10.1016/j.mayocp.2011.11.009.CrossRefPubMedPubMedCentral St Sauver JL, Grossardt BR, Leibson CL, Yawn BP, Melton LJ, Rocca WA: Generalizability of epidemiological findings and public health decisions: an illustration from the Rochester Epidemiology Project. Mayo Clin Proc. 2012, 87 (2): 151-160. 10.1016/j.mayocp.2011.11.009.CrossRefPubMedPubMedCentral
10.
go back to reference St Sauver JL, Grossardt BR, Yawn BP, Melton LJ, Pankratz JJ, Brue SM, Rocca WA: Data resource profile: the Rochester Epidemiology Project (REP) medical records-linkage system. Int J Epidemiol. 2012, 41 (6): 1614-1624. 10.1093/ije/dys195.CrossRefPubMedPubMedCentral St Sauver JL, Grossardt BR, Yawn BP, Melton LJ, Pankratz JJ, Brue SM, Rocca WA: Data resource profile: the Rochester Epidemiology Project (REP) medical records-linkage system. Int J Epidemiol. 2012, 41 (6): 1614-1624. 10.1093/ije/dys195.CrossRefPubMedPubMedCentral
11.
go back to reference St Sauver JL, Grossardt BR, Yawn BP, Melton LJ, Rocca WA: Use of a medical records linkage system to enumerate a dynamic population over time: the Rochester epidemiology project. Am J Epidemiol. 2011, 173 (9): 1059-1068. 10.1093/aje/kwq482.CrossRefPubMedPubMedCentral St Sauver JL, Grossardt BR, Yawn BP, Melton LJ, Rocca WA: Use of a medical records linkage system to enumerate a dynamic population over time: the Rochester epidemiology project. Am J Epidemiol. 2011, 173 (9): 1059-1068. 10.1093/aje/kwq482.CrossRefPubMedPubMedCentral
12.
go back to reference Dillman DA: Mail and Internet Surveys: The Tailored Design Method 2edn. 2007, John WIley & Sons: Hoboken, NJ Dillman DA: Mail and Internet Surveys: The Tailored Design Method 2edn. 2007, John WIley & Sons: Hoboken, NJ
13.
go back to reference American Association for Public Opinion Research (AAPOR): Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. 7th. 2011, AAPOR American Association for Public Opinion Research (AAPOR): Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. 7th. 2011, AAPOR
14.
go back to reference Vernon SW, Abotchie PN, McQueen A, White A, Eberth JM, Coan SP: Is the accuracy of self-reported colorectal cancer screening associated with social desirability?. Cancer Epidemiol Biomarkers Prev. 2012, 21 (1): 61-65. 10.1158/1055-9965.EPI-11-0552.CrossRefPubMed Vernon SW, Abotchie PN, McQueen A, White A, Eberth JM, Coan SP: Is the accuracy of self-reported colorectal cancer screening associated with social desirability?. Cancer Epidemiol Biomarkers Prev. 2012, 21 (1): 61-65. 10.1158/1055-9965.EPI-11-0552.CrossRefPubMed
15.
go back to reference Jones RM, Mongin SJ, Lazovich D, Church TR, Yeazel MW: Validity of four self-reported colorectal cancer screening modalities in a general population: differences over time and by intervention assignment. Cancer Epidemiol Biomarkers Prev. 2008, 17 (4): 777-784. 10.1158/1055-9965.EPI-07-0441.CrossRefPubMed Jones RM, Mongin SJ, Lazovich D, Church TR, Yeazel MW: Validity of four self-reported colorectal cancer screening modalities in a general population: differences over time and by intervention assignment. Cancer Epidemiol Biomarkers Prev. 2008, 17 (4): 777-784. 10.1158/1055-9965.EPI-07-0441.CrossRefPubMed
16.
go back to reference Partin MR, Grill J, Noorbaloochi S, Powell AA, Burgess DJ, Vernon SW, Halek K, Griffin JM, van Ryn M, Fisher DA: Validation of self-reported colorectal cancer screening behavior from a mixed-mode survey of veterans. Cancer Epidemiol Biomarkers Prev. 2008, 17 (4): 768-776. 10.1158/1055-9965.EPI-07-0759.CrossRefPubMed Partin MR, Grill J, Noorbaloochi S, Powell AA, Burgess DJ, Vernon SW, Halek K, Griffin JM, van Ryn M, Fisher DA: Validation of self-reported colorectal cancer screening behavior from a mixed-mode survey of veterans. Cancer Epidemiol Biomarkers Prev. 2008, 17 (4): 768-776. 10.1158/1055-9965.EPI-07-0759.CrossRefPubMed
17.
go back to reference Matthews BAN AB, Anderson RC: Accuracy and certainty of self-report for colorectal cancer screening among ambulatory patients. Psychol Health Med. 2005, 10 (1): 1-15. 10.1080/1354850042000267049.CrossRef Matthews BAN AB, Anderson RC: Accuracy and certainty of self-report for colorectal cancer screening among ambulatory patients. Psychol Health Med. 2005, 10 (1): 1-15. 10.1080/1354850042000267049.CrossRef
Metadata
Title
Survey mode and asking about future intentions did not impact self-reported colorectal cancer screening accuracy
Authors
Timothy J Beebe
Jeanette Y Ziegenfuss
Sarah M Jenkins
Kandace A Lackore
Timothy P Johnson
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2014
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-14-19

Other articles of this Issue 1/2014

BMC Medical Research Methodology 1/2014 Go to the issue