Skip to main content
Top
Published in: Population Health Metrics 1/2010

Open Access 01-12-2010 | Research

Consistency and precision of cancer reporting in a multiwave national panel survey

Authors: Anna Zajacova, Jennifer Beam Dowd, Robert F Schoeni, Robert B Wallace

Published in: Population Health Metrics | Issue 1/2010

Login to get access

Abstract

Background

Many epidemiological studies rely on self-reported information, the accuracy of which is critical for unbiased estimates of population health. Previously, accuracy has been analyzed by comparing self-reports to other sources, such as cancer registries. Cancer is believed to be a well-reported condition. This paper uses novel panel data to test the consistency of cancer reports for respondents with repeated self-reports.

Methods

Data come from 978 adults who reported having been diagnosed with cancer in at least one of four waves of the Panel Study of Income Dynamics, 1999-2005. Consistency of cancer occurrence reports and precision of timing of onset were studied as a function of individual and cancer-related characteristics using logistic and ordered logistic models.

Results

Almost 30% of respondents gave inconsistent cancer reports, meaning they said they never had cancer after having said they did have cancer in a previous interview; 50% reported the year of diagnosis with a discrepancy of two or more years. More recent cancers were reported with a higher consistency and timing precision; cervical cancer was reported more inaccurately than other cancer types. Demographic and socio-economic factors were only weak predictors of reporting quality.

Conclusions

Results suggest that retrospective reports of cancer contain significant measurement error. The errors, however, are fairly random across different social groups, meaning that the results based on the data are not systematically biased by socio-economic factors. Even for health events as salient as cancer, researchers should exercise caution about the presumed accuracy of self-reports, especially if the timing of diagnosis is an important covariate.
Appendix
Available only for authorised users
Literature
1.
go back to reference Beckett M, et al.: The Quality of Retrospective Data: An Examination of Long-Term Recall in a Developing Country. Journal of Human Resources 2001,36(3):593-625. 10.2307/3069631CrossRef Beckett M, et al.: The Quality of Retrospective Data: An Examination of Long-Term Recall in a Developing Country. Journal of Human Resources 2001,36(3):593-625. 10.2307/3069631CrossRef
2.
go back to reference Schrijvers CTM, et al.: Validation of Cancer Prevalence Data from a Postal Survey by Comparison with Cancer Registry Records. American Journal of Epidemiology 1994,139(4):408-414.PubMed Schrijvers CTM, et al.: Validation of Cancer Prevalence Data from a Postal Survey by Comparison with Cancer Registry Records. American Journal of Epidemiology 1994,139(4):408-414.PubMed
3.
go back to reference Merkin SS, et al.: Agreement of self-reported comorbid conditions with medical and physician reports varied by disease among end-stage renal disease patients. Journal of Clinical Epidemiology 2007,60(6):634-642. 10.1016/j.jclinepi.2006.09.003CrossRefPubMed Merkin SS, et al.: Agreement of self-reported comorbid conditions with medical and physician reports varied by disease among end-stage renal disease patients. Journal of Clinical Epidemiology 2007,60(6):634-642. 10.1016/j.jclinepi.2006.09.003CrossRefPubMed
4.
go back to reference Goldman N, et al.: Evaluating the Quality of Self-Reports of Hypertension and Diabetes. Journal of Clinical Epidemiology 2003,56(2):148-54. 10.1016/S0895-4356(02)00580-2CrossRefPubMed Goldman N, et al.: Evaluating the Quality of Self-Reports of Hypertension and Diabetes. Journal of Clinical Epidemiology 2003,56(2):148-54. 10.1016/S0895-4356(02)00580-2CrossRefPubMed
5.
go back to reference Smith B, et al.: Challenges of self-reported medical conditions and electronic medical records among members of a large military cohort. BMC Medical Research Methodology 2008, 8: 10. 10.1186/1471-2288-8-10CrossRef Smith B, et al.: Challenges of self-reported medical conditions and electronic medical records among members of a large military cohort. BMC Medical Research Methodology 2008, 8: 10. 10.1186/1471-2288-8-10CrossRef
6.
go back to reference Beckett M, et al.: Do Health Interview Surveys Yield Reliable Data on Chronic Illness Among Older Respondents? American Journal of Epidemiology 2000,151(3):315-23.CrossRefPubMed Beckett M, et al.: Do Health Interview Surveys Yield Reliable Data on Chronic Illness Among Older Respondents? American Journal of Epidemiology 2000,151(3):315-23.CrossRefPubMed
8.
go back to reference Martin LM, et al.: Validation of self-reported chronic conditions and health services in a managed care population. American Journal of Preventive Medicine 2000,18(3):215-218. 10.1016/S0749-3797(99)00158-0CrossRefPubMed Martin LM, et al.: Validation of self-reported chronic conditions and health services in a managed care population. American Journal of Preventive Medicine 2000,18(3):215-218. 10.1016/S0749-3797(99)00158-0CrossRefPubMed
9.
go back to reference Bush TL, et al.: Self-Report and Medical Record Report Agreement of Selected Medical Conditions in the Elderly. American Journal of Public Health 1989,79(11):1554-1556. 10.2105/AJPH.79.11.1554CrossRefPubMedPubMedCentral Bush TL, et al.: Self-Report and Medical Record Report Agreement of Selected Medical Conditions in the Elderly. American Journal of Public Health 1989,79(11):1554-1556. 10.2105/AJPH.79.11.1554CrossRefPubMedPubMedCentral
10.
go back to reference Simpson CF, et al.: Agreement Between Self-Report of Disease Diagnoses and Medical Record Validation in Disabled Older Women: Factors That Modify Agreement. Journal of the American Geriatrics Society 2004,52(1):123-27. 10.1111/j.1532-5415.2004.52021.xCrossRefPubMed Simpson CF, et al.: Agreement Between Self-Report of Disease Diagnoses and Medical Record Validation in Disabled Older Women: Factors That Modify Agreement. Journal of the American Geriatrics Society 2004,52(1):123-27. 10.1111/j.1532-5415.2004.52021.xCrossRefPubMed
11.
go back to reference Hewitt M, Breen N, Devesa S: Cancer Prevalence and Survivorship Issues: Analyses of the 1992 National Health Interview Survey. Journal of the National Cancer Institute 1999,91(17):1480-86. 10.1093/jnci/91.17.1480CrossRefPubMed Hewitt M, Breen N, Devesa S: Cancer Prevalence and Survivorship Issues: Analyses of the 1992 National Health Interview Survey. Journal of the National Cancer Institute 1999,91(17):1480-86. 10.1093/jnci/91.17.1480CrossRefPubMed
12.
go back to reference Skinner KM, et al.: Concordance Between Respondent Self-reports and Medical Records for Chronic Conditions: Experience From the Veterans Health Study. The Journal of Ambulatory Care Management 2005,28(2):102-110.CrossRefPubMed Skinner KM, et al.: Concordance Between Respondent Self-reports and Medical Records for Chronic Conditions: Experience From the Veterans Health Study. The Journal of Ambulatory Care Management 2005,28(2):102-110.CrossRefPubMed
13.
go back to reference Navarro C, et al.: Validity of self reported diagnoses of cancer in a major Spanish prospective cohort study. Journal of Epidemiology and Community Health 2006,60(7):593-599. 10.1136/jech.2005.039131CrossRefPubMedPubMedCentral Navarro C, et al.: Validity of self reported diagnoses of cancer in a major Spanish prospective cohort study. Journal of Epidemiology and Community Health 2006,60(7):593-599. 10.1136/jech.2005.039131CrossRefPubMedPubMedCentral
14.
go back to reference Manjer J, Merlo J, Berglund G: Validity of Self-Reported Information on Cancer: Determinants of Under- and Over-Reporting. European Journal of Epidemiology 2004,19(3):239-247. 10.1023/B:EJEP.0000020347.95126.11CrossRefPubMed Manjer J, Merlo J, Berglund G: Validity of Self-Reported Information on Cancer: Determinants of Under- and Over-Reporting. European Journal of Epidemiology 2004,19(3):239-247. 10.1023/B:EJEP.0000020347.95126.11CrossRefPubMed
15.
go back to reference Desai M, et al.: Validity of self-reported cancer history: A comparison of health interview data and cancer registry records. American Journal of Epidemiology 2001,153(3):299-306. 10.1093/aje/153.3.299CrossRefPubMed Desai M, et al.: Validity of self-reported cancer history: A comparison of health interview data and cancer registry records. American Journal of Epidemiology 2001,153(3):299-306. 10.1093/aje/153.3.299CrossRefPubMed
16.
go back to reference Bergmann MM, et al.: Validity of Self-Reported Cancers in a Prospective Cohort Study in Comparison with Data from State Cancer Registries. American Journal of Epidemiology 1998,147(6):556-562.CrossRefPubMed Bergmann MM, et al.: Validity of Self-Reported Cancers in a Prospective Cohort Study in Comparison with Data from State Cancer Registries. American Journal of Epidemiology 1998,147(6):556-562.CrossRefPubMed
17.
go back to reference Upchurch DM, et al.: Inconsistencies in Reporting the Occurrence and Timing of First Intercourse Among Adolescents. Journal of Sex Research 2002,39(3):197-206. 10.1080/00224490209552142CrossRefPubMed Upchurch DM, et al.: Inconsistencies in Reporting the Occurrence and Timing of First Intercourse Among Adolescents. Journal of Sex Research 2002,39(3):197-206. 10.1080/00224490209552142CrossRefPubMed
18.
go back to reference Capaldi DM: The reliability of retrospective report for timing first sexual intercourse for adolescent males. Journal of Adolescent Research 1996,11(3):375-387. 10.1177/0743554896113006CrossRef Capaldi DM: The reliability of retrospective report for timing first sexual intercourse for adolescent males. Journal of Adolescent Research 1996,11(3):375-387. 10.1177/0743554896113006CrossRef
19.
go back to reference Hill MS: The Panel Study of Income Dynamics: A User's Guide. Beverly Hills, CA Sage; 1992. Hill MS: The Panel Study of Income Dynamics: A User's Guide. Beverly Hills, CA Sage; 1992.
20.
go back to reference Kim YS, Stafford F: The Quality of PSID Income Data in the 1990's and Beyond. In Technical Series Paper. University of Michigan: Ann Arbor, MI.; 2000. Kim YS, Stafford F: The Quality of PSID Income Data in the 1990's and Beyond. In Technical Series Paper. University of Michigan: Ann Arbor, MI.; 2000.
21.
go back to reference Andreski P, et al.: An Analysis of the Quality of the Health Data in the Panel Study or Income Dynamics. University of Michigan: Ann Arbor, MI; 2005. Andreski P, et al.: An Analysis of the Quality of the Health Data in the Panel Study or Income Dynamics. University of Michigan: Ann Arbor, MI; 2005.
22.
go back to reference Wilhelm MO: New Data on Charitable Giving in the PSID. Economics Letters 2006,92(1):26-31. 10.1016/j.econlet.2006.01.009CrossRef Wilhelm MO: New Data on Charitable Giving in the PSID. Economics Letters 2006,92(1):26-31. 10.1016/j.econlet.2006.01.009CrossRef
23.
go back to reference Gouskova E, Schoeni RF: Comparing Estimates of Family Income in the Panel Study of Income Dynamics and the March Current Population Survey, 1968-2005. In Institute for Social Research. University of Michigan: Ann Arbor, MI; 2007. Gouskova E, Schoeni RF: Comparing Estimates of Family Income in the Panel Study of Income Dynamics and the March Current Population Survey, 1968-2005. In Institute for Social Research. University of Michigan: Ann Arbor, MI; 2007.
24.
go back to reference Smith JP: The Impact of Socioeconomic Status on Health over the Life-Course. Journal of Human Resources 2007,17(4):739-764.CrossRef Smith JP: The Impact of Socioeconomic Status on Health over the Life-Course. Journal of Human Resources 2007,17(4):739-764.CrossRef
26.
go back to reference Guyatt GH, Feeny DH, Patrick DL: Measuring Health-Related Quality of Life. Annals of Internal Medicine 1993,118(8):622-629.CrossRefPubMed Guyatt GH, Feeny DH, Patrick DL: Measuring Health-Related Quality of Life. Annals of Internal Medicine 1993,118(8):622-629.CrossRefPubMed
27.
go back to reference SEER (Surveillance, E., and End Results) Program In Limited-Use Data (1973-2006). National Cancer Institute, DCCPS, Surveillance Research Program, Cancer Statistics Branch, released April 2009, based on the November 2007 submission; 2009. SEER (Surveillance, E., and End Results) Program In Limited-Use Data (1973-2006). National Cancer Institute, DCCPS, Surveillance Research Program, Cancer Statistics Branch, released April 2009, based on the November 2007 submission; 2009.
28.
go back to reference Junghans TB, et al.: Cancer information resources: digital and online sources. Toxicology 2004,198(1-3):177-193. 10.1016/j.tox.2004.02.021CrossRefPubMed Junghans TB, et al.: Cancer information resources: digital and online sources. Toxicology 2004,198(1-3):177-193. 10.1016/j.tox.2004.02.021CrossRefPubMed
29.
go back to reference Brant R: Assessing Proportionality in the Proportional Odds Model for Ordinal Logistic Regression. Biometrics 1990,46(4):1171-1178. 10.2307/2532457CrossRefPubMed Brant R: Assessing Proportionality in the Proportional Odds Model for Ordinal Logistic Regression. Biometrics 1990,46(4):1171-1178. 10.2307/2532457CrossRefPubMed
30.
go back to reference CDC: 2000 National Health Interview Survey (NHIS) Public Use Data Release. In Division of Health Interview Statistics. National Center for Health Statistics Hyattsville, MD; 2002. CDC: 2000 National Health Interview Survey (NHIS) Public Use Data Release. In Division of Health Interview Statistics. National Center for Health Statistics Hyattsville, MD; 2002.
31.
go back to reference Haas SA: The Long-Term Effects of Poor Childhood Health: An Assessment and Application of Retrospective Reports. Demography 2007,44(1):113-135. 10.1353/dem.2007.0003CrossRefPubMed Haas SA: The Long-Term Effects of Poor Childhood Health: An Assessment and Application of Retrospective Reports. Demography 2007,44(1):113-135. 10.1353/dem.2007.0003CrossRefPubMed
32.
go back to reference Else-Quest NM, et al.: Perceived Stigma, Self-Blame, and Adjustment Among Lung, Breast and Prostate Cancer Patients. Psychology and Health 2008,23(1):1-16. 10.1080/08870440701806604CrossRef Else-Quest NM, et al.: Perceived Stigma, Self-Blame, and Adjustment Among Lung, Breast and Prostate Cancer Patients. Psychology and Health 2008,23(1):1-16. 10.1080/08870440701806604CrossRef
33.
go back to reference Fife BL, Wright ER: The Dimensionality of Stigma: A Comparison of its Impact on the Self of Persons with HIV/AIDS and Cancer. Journal of Health and Social Behavior 2000,41(1):50-68. 10.2307/2676360CrossRefPubMed Fife BL, Wright ER: The Dimensionality of Stigma: A Comparison of its Impact on the Self of Persons with HIV/AIDS and Cancer. Journal of Health and Social Behavior 2000,41(1):50-68. 10.2307/2676360CrossRefPubMed
34.
go back to reference Groves RM: Survey Errors and Survey Costs. Hoboken, N.J: Wiley-Interscience; 2004. Groves RM: Survey Errors and Survey Costs. Hoboken, N.J: Wiley-Interscience; 2004.
35.
go back to reference Carroll RJ, et al.: Measurement Error in Nonlinear Models: A Modern Perspective. Second edition. New York NY: Wiley; 2006.CrossRef Carroll RJ, et al.: Measurement Error in Nonlinear Models: A Modern Perspective. Second edition. New York NY: Wiley; 2006.CrossRef
Metadata
Title
Consistency and precision of cancer reporting in a multiwave national panel survey
Authors
Anna Zajacova
Jennifer Beam Dowd
Robert F Schoeni
Robert B Wallace
Publication date
01-12-2010
Publisher
BioMed Central
Published in
Population Health Metrics / Issue 1/2010
Electronic ISSN: 1478-7954
DOI
https://doi.org/10.1186/1478-7954-8-20

Other articles of this Issue 1/2010

Population Health Metrics 1/2010 Go to the issue