Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2002

Open Access 01-12-2002 | Research article

Bias and heteroscedastic memory error in self-reported health behavior: an investigation using covariance structure analysis

Author: Emil Kupek

Published in: BMC Medical Research Methodology | Issue 1/2002

Login to get access

Abstract

Background

Frequent use of self-reports for investigating recent and past behavior in medical research requires statistical techniques capable of analyzing complex sources of bias associated with this methodology. In particular, although decreasing accuracy of recalling more distant past events is commonplace, the bias due to differential in memory errors resulting from it has rarely been modeled statistically.

Methods

Covariance structure analysis was used to estimate the recall error of self-reported number of sexual partners for past periods of varying duration and its implication for the bias.

Results

Results indicated increasing levels of inaccuracy for reports about more distant past. Considerable positive bias was found for a small fraction of respondents who reported ten or more partners in the last year, last two years and last five years. This is consistent with the effect of heteroscedastic random error where the majority of partners had been acquired in the more distant past and therefore were recalled less accurately than the partners acquired more recently to the time of interviewing.

Conclusions

Memory errors of this type depend on the salience of the events recalled and are likely to be present in many areas of health research based on self-reported behavior.
Appendix
Available only for authorised users
Literature
1.
go back to reference Boulton M: The methodological imagination. In: Challenge and innovation: Methodological advances in social research on HIV/AIDS. Edited by: Boulton M. 1994, London, Taylor & Francis, 1-21. Boulton M: The methodological imagination. In: Challenge and innovation: Methodological advances in social research on HIV/AIDS. Edited by: Boulton M. 1994, London, Taylor & Francis, 1-21.
2.
go back to reference Wadsworth J, Johnson AM, Wellings K, Field JJ: What is in a mean – an examination of the inconsistency between men and women reporting sexual partnerships. J R Statis Soc A. 1996, 159: 111-123.CrossRef Wadsworth J, Johnson AM, Wellings K, Field JJ: What is in a mean – an examination of the inconsistency between men and women reporting sexual partnerships. J R Statis Soc A. 1996, 159: 111-123.CrossRef
3.
go back to reference Catania JA, Gibson DR, Chitwood DD, Coates DJ: Methodological problems in AIDS behavioural research: Influences of measurement error and participation bias in studies of sexual behaviour. Psychol Bull. 1990, 108: 339-362. 10.1037//0033-2909.108.3.339.CrossRefPubMed Catania JA, Gibson DR, Chitwood DD, Coates DJ: Methodological problems in AIDS behavioural research: Influences of measurement error and participation bias in studies of sexual behaviour. Psychol Bull. 1990, 108: 339-362. 10.1037//0033-2909.108.3.339.CrossRefPubMed
4.
go back to reference Friedman WJ: Memory for the time of past events. Psychol Bull. 1993, 113: 44-66. 10.1037//0033-2909.113.1.44.CrossRef Friedman WJ: Memory for the time of past events. Psychol Bull. 1993, 113: 44-66. 10.1037//0033-2909.113.1.44.CrossRef
5.
go back to reference Gaskell G, Wright D, O'Muirchaertaigh C: Reliability of surveys. Psychologist. 1993, 6 (11): 500-503. Gaskell G, Wright D, O'Muirchaertaigh C: Reliability of surveys. Psychologist. 1993, 6 (11): 500-503.
6.
go back to reference Krosnick JA: Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl Cognit Psychol. 1991, 5: 213-236.CrossRef Krosnick JA: Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl Cognit Psychol. 1991, 5: 213-236.CrossRef
7.
go back to reference Nadeau R, Niemi RG: Educated guesses: The process of answering factual knowledge questions in surveys. Public Opinion Quart. 1995, 59: 323-346. 10.1086/269480.CrossRef Nadeau R, Niemi RG: Educated guesses: The process of answering factual knowledge questions in surveys. Public Opinion Quart. 1995, 59: 323-346. 10.1086/269480.CrossRef
8.
go back to reference Johnson AM, Wadsworth J, Wellings K, Field J: Sexual Attitudes and Lifestyles. Oxford, Blackwell Scientific Publications. 1994 Johnson AM, Wadsworth J, Wellings K, Field J: Sexual Attitudes and Lifestyles. Oxford, Blackwell Scientific Publications. 1994
9.
go back to reference Hoyt TW: Rater bias in psychological research: When is it a problem and what can we do about it?. Psy Method. 2000, 5: 64-86. 10.1037//1082-989X.5.1.64.CrossRef Hoyt TW: Rater bias in psychological research: When is it a problem and what can we do about it?. Psy Method. 2000, 5: 64-86. 10.1037//1082-989X.5.1.64.CrossRef
10.
go back to reference Hoyt WT, Kerns MD: Magnitude and moderators of bias in observer ratings: a meta-analysis. Psy Method. 1999, 4: 403-424. 10.1037//1082-989X.4.4.403.CrossRef Hoyt WT, Kerns MD: Magnitude and moderators of bias in observer ratings: a meta-analysis. Psy Method. 1999, 4: 403-424. 10.1037//1082-989X.4.4.403.CrossRef
11.
go back to reference Kupek E: Determinants of item non-response in a large national sex survey. Arch Sex Behav. 1998, 27: 581-594. 10.1023/A:1018721100903.CrossRefPubMed Kupek E: Determinants of item non-response in a large national sex survey. Arch Sex Behav. 1998, 27: 581-594. 10.1023/A:1018721100903.CrossRefPubMed
12.
go back to reference Kupek E: Estimation of the number of sexual partners for the non-respondents to a large national survey. Arch Sex Behav. 1999, 28: 233-242. 10.1023/A:1018784209505.CrossRefPubMed Kupek E: Estimation of the number of sexual partners for the non-respondents to a large national survey. Arch Sex Behav. 1999, 28: 233-242. 10.1023/A:1018784209505.CrossRefPubMed
13.
go back to reference Wadsworth J, Field J, Johnson AM, Bradshaw S, Wellings K: Methodology of the National Survey of Sexual Attitudes and Lifestyles. J R Stat Soc Ser A Stat Soc. 1993, 156: 407-421.CrossRefPubMed Wadsworth J, Field J, Johnson AM, Bradshaw S, Wellings K: Methodology of the National Survey of Sexual Attitudes and Lifestyles. J R Stat Soc Ser A Stat Soc. 1993, 156: 407-421.CrossRefPubMed
14.
go back to reference Dunn G, Everitt B, Pickles A: Modelling covariances and latent variables using EQS. London, Chapman & Hall. 1993 Dunn G, Everitt B, Pickles A: Modelling covariances and latent variables using EQS. London, Chapman & Hall. 1993
15.
go back to reference Joreskog KG, Sorbom D: LISREL VI. Uppsala, Uppsala University Press. 1981 Joreskog KG, Sorbom D: LISREL VI. Uppsala, Uppsala University Press. 1981
16.
go back to reference Scott Long J: Covariance Structure Models: An Introduction to LISREL. London, Sage Publications. 1990 Scott Long J: Covariance Structure Models: An Introduction to LISREL. London, Sage Publications. 1990
17.
go back to reference Johnson RA, Wichern DW: Applied multivariate statistical analysis. Englewood Cliffs, Prentice Hall Int. 1988 Johnson RA, Wichern DW: Applied multivariate statistical analysis. Englewood Cliffs, Prentice Hall Int. 1988
18.
go back to reference Sharma S: Applied multivariate techniques. New York, John Wiley & Sons. 1996 Sharma S: Applied multivariate techniques. New York, John Wiley & Sons. 1996
19.
go back to reference Institute SAS: Proc CALIS. SAS/STAT (R) User's Guide. Version 6. Edited by: SAS Institute. 1989, Cary, NC, SAS Institute, 2: 245-366. Institute SAS: Proc CALIS. SAS/STAT (R) User's Guide. Version 6. Edited by: SAS Institute. 1989, Cary, NC, SAS Institute, 2: 245-366.
20.
go back to reference Maddala GS: Econometrics. New York, McGraw-Hill. 1977 Maddala GS: Econometrics. New York, McGraw-Hill. 1977
21.
go back to reference Heckman J, Robb R: Alternative methods for solving the problem of selection bias in evaluating the impact of treatment on outcomes. In: Drawing inferences from self-selected samples. Edited by: Wainer H. 1986, Berlin, Springer-Verlag Heckman J, Robb R: Alternative methods for solving the problem of selection bias in evaluating the impact of treatment on outcomes. In: Drawing inferences from self-selected samples. Edited by: Wainer H. 1986, Berlin, Springer-Verlag
22.
go back to reference Bartholomew DJ: Foundation of factor analysis: Some practical implications. British J Math Statist Psych. 1985, 38: 1-10.CrossRef Bartholomew DJ: Foundation of factor analysis: Some practical implications. British J Math Statist Psych. 1985, 38: 1-10.CrossRef
23.
go back to reference Wood PW: The effect of unmeasured variables and their interactions on structural models. In: Latent variables analysis. Edited by: von Eye A, Clogg CC. 1994, London, Sage Publications, 109-130. Wood PW: The effect of unmeasured variables and their interactions on structural models. In: Latent variables analysis. Edited by: von Eye A, Clogg CC. 1994, London, Sage Publications, 109-130.
24.
go back to reference Bollen KA, Stine RA: Bootstrapping goodness-of-fit measures in structural equation models. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 111-135. Bollen KA, Stine RA: Bootstrapping goodness-of-fit measures in structural equation models. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 111-135.
25.
go back to reference Browne MW, Cudeck R: Alternative ways of assessing model fit. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 136-162. Browne MW, Cudeck R: Alternative ways of assessing model fit. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 136-162.
26.
go back to reference Chou CP, Bentler PM, Satorra A: Scaled test statistics and robust standard errors for non-normal data in covariance structure analysis: A Monte Carlo study. British J Math Statist Psych. 1993, 44: 347-357.CrossRef Chou CP, Bentler PM, Satorra A: Scaled test statistics and robust standard errors for non-normal data in covariance structure analysis: A Monte Carlo study. British J Math Statist Psych. 1993, 44: 347-357.CrossRef
27.
go back to reference MacCallum RC, Roznowski M, Mar CM, Reith JV: Alternative strategies for cross-validation of covariance structure models. Multivariate Behav Res. 1994, 29: 1-32.CrossRefPubMed MacCallum RC, Roznowski M, Mar CM, Reith JV: Alternative strategies for cross-validation of covariance structure models. Multivariate Behav Res. 1994, 29: 1-32.CrossRefPubMed
28.
go back to reference Gonzalez R, Griffin D: Testing parameters in structural equation modeling: every "one" matters. Psy Method. 2001, 6: 258-269. 10.1037//1082-989X.6.3.258.CrossRef Gonzalez R, Griffin D: Testing parameters in structural equation modeling: every "one" matters. Psy Method. 2001, 6: 258-269. 10.1037//1082-989X.6.3.258.CrossRef
29.
go back to reference MacCallum RC, Roznowski M, Necowitz LB: Model modification in covariance structure analysis: the problem of capitalization on chance. Psychol Bull. 1992, 111: 490-504. 10.1037//0033-2909.111.3.490.CrossRefPubMed MacCallum RC, Roznowski M, Necowitz LB: Model modification in covariance structure analysis: the problem of capitalization on chance. Psychol Bull. 1992, 111: 490-504. 10.1037//0033-2909.111.3.490.CrossRefPubMed
30.
go back to reference Browne MW: Asymptotically distribution-free methods for the analysis of covariance structures. British J Math Statist Psych. 1984, 37: 62-83.CrossRef Browne MW: Asymptotically distribution-free methods for the analysis of covariance structures. British J Math Statist Psych. 1984, 37: 62-83.CrossRef
31.
go back to reference Boomsma A: The robustness of maximum likelihood estimation in structural equation models. In: Structural Modelling by Example. Edited by: Cuttance P, Ecob R. 1987, Cambridge, Cambridge University Press, 160-188. Boomsma A: The robustness of maximum likelihood estimation in structural equation models. In: Structural Modelling by Example. Edited by: Cuttance P, Ecob R. 1987, Cambridge, Cambridge University Press, 160-188.
32.
go back to reference Browne MW, Shapiro A: Robustness of normal theory methods in the analysis of linear latent variable models. British J Math Statist Psych. 1988, 41: 193-208.CrossRef Browne MW, Shapiro A: Robustness of normal theory methods in the analysis of linear latent variable models. British J Math Statist Psych. 1988, 41: 193-208.CrossRef
33.
go back to reference Satorra A, Bentler PM: Model conditions for asymptotic robustness in the analysis of linear relations. Comput Stat Data Analysis. 1990, 10: 235-249. 10.1016/0167-9473(90)90004-2.CrossRef Satorra A, Bentler PM: Model conditions for asymptotic robustness in the analysis of linear relations. Comput Stat Data Analysis. 1990, 10: 235-249. 10.1016/0167-9473(90)90004-2.CrossRef
34.
go back to reference Satorra A, Bentler PM: Corrections to tests statistics and standard errors in covariance structure analysis. In: Latent variables analysis. Edited by: von Eye A, Clogg CC. 1994, London, Sage Publications, 399-419. Satorra A, Bentler PM: Corrections to tests statistics and standard errors in covariance structure analysis. In: Latent variables analysis. Edited by: von Eye A, Clogg CC. 1994, London, Sage Publications, 399-419.
35.
go back to reference Bentler PM, Newcomb MD: Linear structural modeling with nonnormal continuous variables. Application: Relations among social support, drug use, and health in young adults. In: Statistical models for longitudinal studies of health. Edited by: Dwayer JH, Feinlieb M, Lippert P, Hoffmeister H. 1992, Oxford, Oxford University Press, 132-160. Bentler PM, Newcomb MD: Linear structural modeling with nonnormal continuous variables. Application: Relations among social support, drug use, and health in young adults. In: Statistical models for longitudinal studies of health. Edited by: Dwayer JH, Feinlieb M, Lippert P, Hoffmeister H. 1992, Oxford, Oxford University Press, 132-160.
36.
go back to reference Gerbing DW, Anderson JC: Monte Carlo evaluations of goodness-of-fit indices for structural equation models. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 40-65. Gerbing DW, Anderson JC: Monte Carlo evaluations of goodness-of-fit indices for structural equation models. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 40-65.
37.
go back to reference Muthen BO: Goodness of fit with categorical and other nonnormal variables. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 205-234. Muthen BO: Goodness of fit with categorical and other nonnormal variables. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 205-234.
38.
go back to reference Tanaka JS: Multifaceted conceptions of fit in structural equation models. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 10-39. Tanaka JS: Multifaceted conceptions of fit in structural equation models. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 10-39.
39.
go back to reference Kupek E: Sexual attitudes and number of partners in young British men. Arch Sex Behav. 2001, 30: 13-27. 10.1023/A:1026464606453.CrossRefPubMed Kupek E: Sexual attitudes and number of partners in young British men. Arch Sex Behav. 2001, 30: 13-27. 10.1023/A:1026464606453.CrossRefPubMed
40.
go back to reference Fendrich M, Vaughn CM: Diminished lifetime substance use over time: an inquiry into differential underreporting. Public Opinion Quart. 1994, 58: 96-123. 10.1086/269410.CrossRef Fendrich M, Vaughn CM: Diminished lifetime substance use over time: an inquiry into differential underreporting. Public Opinion Quart. 1994, 58: 96-123. 10.1086/269410.CrossRef
41.
go back to reference Pickles A, Pickering K, Taylor C: Reconciling recalled dates of developmental milestones, events and transitions: a mixed generalized linear model with random mean and variance functions. J R Statist Soc A. 1996, 159: 225-234.CrossRef Pickles A, Pickering K, Taylor C: Reconciling recalled dates of developmental milestones, events and transitions: a mixed generalized linear model with random mean and variance functions. J R Statist Soc A. 1996, 159: 225-234.CrossRef
42.
go back to reference Saris WE, Satorra A: Power evaluations in structural equation models. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 181-204. Saris WE, Satorra A: Power evaluations in structural equation models. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 181-204.
43.
go back to reference Raftery AE: Bayesian model selection in structural equation models. In: Testing structural equation models. Edited by: Bollen KA, Long JS. 1993, Newbury Park, Sage Publications, 163-180. Raftery AE: Bayesian model selection in structural equation models. In: Testing structural equation models. Edited by: Bollen KA, Long JS. 1993, Newbury Park, Sage Publications, 163-180.
44.
go back to reference Goldstein H, Spiegelhalter D: League tables and their limitations: Statistical issues in comparisons of institutional performance. J R Statist Soc A. 1996, 159 (3): 385-443.CrossRef Goldstein H, Spiegelhalter D: League tables and their limitations: Statistical issues in comparisons of institutional performance. J R Statist Soc A. 1996, 159 (3): 385-443.CrossRef
45.
go back to reference Cameron AC, Trivedi PK: Regression analysis of count data. Cambridge, Cambridge University Press. 1998 Cameron AC, Trivedi PK: Regression analysis of count data. Cambridge, Cambridge University Press. 1998
46.
go back to reference Muthen LK, Muthen B: Mplus user's guide. Los Angeles, Muthen & Muthen. 1998 Muthen LK, Muthen B: Mplus user's guide. Los Angeles, Muthen & Muthen. 1998
47.
go back to reference Heckman J: Comment. J Amer Statist Assoc. 1996, 91: 459-462. Heckman J: Comment. J Amer Statist Assoc. 1996, 91: 459-462.
48.
go back to reference Angrist JD, Imbens GW, Rubin DB: Identification of causal effects using instrumental variables. J Amer Statist Assoc. 1996, 91: 444-455.CrossRef Angrist JD, Imbens GW, Rubin DB: Identification of causal effects using instrumental variables. J Amer Statist Assoc. 1996, 91: 444-455.CrossRef
49.
go back to reference Wothke W: Nonpositive definite matrices in structural modeling. In: Testing structural equation models. Edited by: Bollen KA, Long JS. 1993, Newbury Park, Sage Publications, 256-293. Wothke W: Nonpositive definite matrices in structural modeling. In: Testing structural equation models. Edited by: Bollen KA, Long JS. 1993, Newbury Park, Sage Publications, 256-293.
50.
51.
go back to reference Plummer MT, Clayton DG: Measurement error in dietary assessment: an investigation using covariance structure models. Stat Med. 1993, 12: 925-948.CrossRefPubMed Plummer MT, Clayton DG: Measurement error in dietary assessment: an investigation using covariance structure models. Stat Med. 1993, 12: 925-948.CrossRefPubMed
52.
go back to reference Joereskog KG: Testing structural equation models. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 294-316. Joereskog KG: Testing structural equation models. In: Testing structural equation models. Edited by: Bollen KA, Scott Long J. 1993, Newbury Park, Sage Publications, 294-316.
Metadata
Title
Bias and heteroscedastic memory error in self-reported health behavior: an investigation using covariance structure analysis
Author
Emil Kupek
Publication date
01-12-2002
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2002
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-2-14

Other articles of this Issue 1/2002

BMC Medical Research Methodology 1/2002 Go to the issue