Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2004

Open Access 01-12-2004 | Research

Practical methods for dealing with 'not applicable' item responses in the AMC Linear Disability Score project

Authors: Rebecca Holman, Cees AW Glas, Robert Lindeboom, Aeilko H Zwinderman, Rob J de Haan

Published in: Health and Quality of Life Outcomes | Issue 1/2004

Login to get access

Abstract

Background

Whenever questionnaires are used to collect data on constructs, such as functional status or health related quality of life, it is unlikely that all respondents will respond to all items. This paper examines ways of dealing with responses in a 'not applicable' category to items included in the AMC Linear Disability Score (ALDS) project item bank.

Methods

The data examined in this paper come from the responses of 392 respondents to 32 items and form part of the calibration sample for the ALDS item bank. The data are analysed using the one-parameter logistic item response theory model. The four practical strategies for dealing with this type of response are: cold deck imputation; hot deck imputation; treating the missing responses as if these items had never been offered to those individual patients; and using a model which takes account of the 'tendency to respond to items'.

Results

The item and respondent population parameter estimates were very similar for the strategies involving hot deck imputation; treating the missing responses as if these items had never been offered to those individual patients; and using a model which takes account of the 'tendency to respond to items'. The estimates obtained using the cold deck imputation method were substantially different.

Conclusions

The cold deck imputation method was not considered suitable for use in the ALDS item bank. The other three methods described can be usefully implemented in the ALDS item bank, depending on the purpose of the data analysis to be carried out. These three methods may be useful for other data sets examining similar constructs, when item response theory based methods are used.
Appendix
Available only for authorised users
Literature
1.
go back to reference McHorney CA, Ware JE, Lu JF, Sherbourne CD: The MOS 36-item short-form health survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care 1994, 32: 40–66.PubMedCrossRef McHorney CA, Ware JE, Lu JF, Sherbourne CD: The MOS 36-item short-form health survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care 1994, 32: 40–66.PubMedCrossRef
2.
go back to reference Rand Health Sciences Program: Rand 36-item Health Survey 1.0 Santa Monica, California: Rand Corporation 1992. Rand Health Sciences Program: Rand 36-item Health Survey 1.0 Santa Monica, California: Rand Corporation 1992.
3.
go back to reference Roth M, Tym E, Mountjoy CO, Huppert FA, Hendrie H, Verma S, Goddard R: CAMDEX. A standardised instrument for the diagnosis of mental disorder in the elderly. British Journal of Psychiatry 1986, 49: 698–709.CrossRef Roth M, Tym E, Mountjoy CO, Huppert FA, Hendrie H, Verma S, Goddard R: CAMDEX. A standardised instrument for the diagnosis of mental disorder in the elderly. British Journal of Psychiatry 1986, 49: 698–709.CrossRef
5.
go back to reference Fayers PM, Curran D, Machin D: Incomplete quality of life data in randomized trials: missing items. Stat Med 1998, 15: 679–696. Publisher Full Text 10.1002/(SICI)1097-0258(19980315/15)17:5/7<679::AID-SIM814>3.3.CO;2-OCrossRef Fayers PM, Curran D, Machin D: Incomplete quality of life data in randomized trials: missing items. Stat Med 1998, 15: 679–696. Publisher Full Text 10.1002/(SICI)1097-0258(19980315/15)17:5/7<679::AID-SIM814>3.3.CO;2-OCrossRef
6.
go back to reference Hunsberger S, Murray D, Davis CE, Fabsitz RR: Imputation strategies for missing data in a school-based multi-centre study: the pathways study. Stat Med 2001, 20: 305–16. 10.1002/1097-0258(20010130)20:2<305::AID-SIM645>3.0.CO;2-MPubMedCrossRef Hunsberger S, Murray D, Davis CE, Fabsitz RR: Imputation strategies for missing data in a school-based multi-centre study: the pathways study. Stat Med 2001, 20: 305–16. 10.1002/1097-0258(20010130)20:2<305::AID-SIM645>3.0.CO;2-MPubMedCrossRef
7.
go back to reference Faris PD, Ghali WA, Brant R, Norris CM, Galbraith PD, Knudtson ML: Multiple imputation versus data enhancement for dealing with missing data in observational health care outcome analyses. J Clin Epidemiol 2002, 55: 184–91. 10.1016/S0895-4356(01)00433-4PubMedCrossRef Faris PD, Ghali WA, Brant R, Norris CM, Galbraith PD, Knudtson ML: Multiple imputation versus data enhancement for dealing with missing data in observational health care outcome analyses. J Clin Epidemiol 2002, 55: 184–91. 10.1016/S0895-4356(01)00433-4PubMedCrossRef
8.
go back to reference Schafer JL: Analysis of incomplete multivariate data New York: Chapman and Hall 1997.CrossRef Schafer JL: Analysis of incomplete multivariate data New York: Chapman and Hall 1997.CrossRef
9.
go back to reference Heckman JJ: Sample selection bias as a specification error. Econometrica 1979, 47: 153–161.CrossRef Heckman JJ: Sample selection bias as a specification error. Econometrica 1979, 47: 153–161.CrossRef
10.
11.
go back to reference Rubin DB: Multiple Imputation for Nonresponse in Surveys New York: Wiley 1987.CrossRef Rubin DB: Multiple Imputation for Nonresponse in Surveys New York: Wiley 1987.CrossRef
12.
go back to reference Little RJA, Rubin DB: Statistical analysis with missing data New York: Wiley 1987. Little RJA, Rubin DB: Statistical analysis with missing data New York: Wiley 1987.
13.
go back to reference Lindeboom R, Vermeulen M, Holman R, de Haan RJ: Activities of daily living instruments in clinical neurology, optimizing scales for neurologic assessments. Neurology 2003, 60: 738–742.PubMedCrossRef Lindeboom R, Vermeulen M, Holman R, de Haan RJ: Activities of daily living instruments in clinical neurology, optimizing scales for neurologic assessments. Neurology 2003, 60: 738–742.PubMedCrossRef
15.
go back to reference Fillenbaum GG, George LK, Blazer DG: Scoring nonresponse on the mini-mental state examination. Psychological Medicine 1988, 18: 1021–5.PubMedCrossRef Fillenbaum GG, George LK, Blazer DG: Scoring nonresponse on the mini-mental state examination. Psychological Medicine 1988, 18: 1021–5.PubMedCrossRef
16.
go back to reference Bergner M, Bobbitt RA, Carter WB, Gilson BS: The sickness impact profile: development and final revision of a health status measure. Med Care 1981, 19: 787–805.PubMedCrossRef Bergner M, Bobbitt RA, Carter WB, Gilson BS: The sickness impact profile: development and final revision of a health status measure. Med Care 1981, 19: 787–805.PubMedCrossRef
17.
go back to reference Holman R, Glas CAW, Zwinderman AH, de Haan RJ: The treatment of not applicable responses in an item bank to measure functional status using item response theory. Poster presented at the 23rd meeting of the International Society for Biostatistics. Held in Dijon, France 11–13 September 2002 Holman R, Glas CAW, Zwinderman AH, de Haan RJ: The treatment of not applicable responses in an item bank to measure functional status using item response theory. Poster presented at the 23rd meeting of the International Society for Biostatistics. Held in Dijon, France 11–13 September 2002
19.
go back to reference Holman R, Lindeboom R, Glas CAW, Vermeulen M, de Haan RJ: Constructing an item bank using item response theory: the AMC linear disability score project. Health Services and Outcomes Research Methodology 2003, 4: 19–33. 10.1023/A:1025824810390CrossRef Holman R, Lindeboom R, Glas CAW, Vermeulen M, de Haan RJ: Constructing an item bank using item response theory: the AMC linear disability score project. Health Services and Outcomes Research Methodology 2003, 4: 19–33. 10.1023/A:1025824810390CrossRef
20.
go back to reference Wu ML, Adams RJ, Wilson MR: ACER ConQuest: Generalised Item Response Modelling Software Melbourne: ACER Press 1998. Wu ML, Adams RJ, Wilson MR: ACER ConQuest: Generalised Item Response Modelling Software Melbourne: ACER Press 1998.
21.
go back to reference Thissen D: Marginal maximum likelihood estimation for the one parameter logistic model. Psychometrika 1982, 47: 175–186.CrossRef Thissen D: Marginal maximum likelihood estimation for the one parameter logistic model. Psychometrika 1982, 47: 175–186.CrossRef
22.
go back to reference Lord FM: Maximum likelihood estimation of item response parameters when some responses are omitted. Psychometrika 1983, 48: 477–482.CrossRef Lord FM: Maximum likelihood estimation of item response parameters when some responses are omitted. Psychometrika 1983, 48: 477–482.CrossRef
23.
go back to reference van der Linden WJ, Glas CAW: Computerized Adaptive Testing. Theory and Practice Dordrecht, the Netherlands: Kluwer Academic Publishers 2000.CrossRef van der Linden WJ, Glas CAW: Computerized Adaptive Testing. Theory and Practice Dordrecht, the Netherlands: Kluwer Academic Publishers 2000.CrossRef
24.
go back to reference Mislevy RJ, Chang H: Does addaptive testing violate local independence? Psychometrika 2000, 65: 149–156.CrossRef Mislevy RJ, Chang H: Does addaptive testing violate local independence? Psychometrika 2000, 65: 149–156.CrossRef
25.
go back to reference Andersen EB: Estimating latent correlations between repeated testings. Psychometrika 1985, 50: 3–16.CrossRef Andersen EB: Estimating latent correlations between repeated testings. Psychometrika 1985, 50: 3–16.CrossRef
26.
go back to reference Holman R, Glas CAW: Modelling non-ignorable missing data mechanisms with item response theory models. British Journal of Mathematical and Statistical Psychology, in press. Holman R, Glas CAW: Modelling non-ignorable missing data mechanisms with item response theory models. British Journal of Mathematical and Statistical Psychology, in press.
27.
go back to reference Rasch G: On general laws and the meaning of measurement in psychology. In Proceedings of the Fourth Berkely Symposium on Mathematical Statistics and Probability 1961, 4: 321–34. Rasch G: On general laws and the meaning of measurement in psychology. In Proceedings of the Fourth Berkely Symposium on Mathematical Statistics and Probability 1961, 4: 321–34.
28.
go back to reference Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16: 297–334.CrossRef Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16: 297–334.CrossRef
29.
go back to reference Wright BD, Masters GN: Rating scale analysis: Rasch measurement Chicago, IL: MESA Press 1982. Wright BD, Masters GN: Rating scale analysis: Rasch measurement Chicago, IL: MESA Press 1982.
30.
go back to reference May K, Nicewander WA: Measuring change conventionally and adaptively. Educational and Psychological Measurement 1998, 58: 882–897.CrossRef May K, Nicewander WA: Measuring change conventionally and adaptively. Educational and Psychological Measurement 1998, 58: 882–897.CrossRef
31.
go back to reference Little RJA, Rubin DB: On jointly estimating parameters and missing data by maximising the complete-data likelihood. American Statistician 1983, 37: 218–220. Little RJA, Rubin DB: On jointly estimating parameters and missing data by maximising the complete-data likelihood. American Statistician 1983, 37: 218–220.
32.
go back to reference Pinheiro JC, Bates DM: Mixed-Effects Models in S and S-PLUS New York: Springer-Verlag 2000.CrossRef Pinheiro JC, Bates DM: Mixed-Effects Models in S and S-PLUS New York: Springer-Verlag 2000.CrossRef
Metadata
Title
Practical methods for dealing with 'not applicable' item responses in the AMC Linear Disability Score project
Authors
Rebecca Holman
Cees AW Glas
Robert Lindeboom
Aeilko H Zwinderman
Rob J de Haan
Publication date
01-12-2004
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2004
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-2-29

Other articles of this Issue 1/2004

Health and Quality of Life Outcomes 1/2004 Go to the issue