Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2003

Open Access 01-12-2003 | Research

Utilization of the propensity score method: an exploratory comparison of proxy-completed to self-completed responses in the Medicare Health Outcomes Survey

Authors: Beth Hartman Ellis, Wade M Bannister, Jacquilyn Kay Cox, Brenda M Fowler, Erin Dowd Shannon, David Drachman, Randall W Adams, Laura A Giordano

Published in: Health and Quality of Life Outcomes | Issue 1/2003

Login to get access

Abstract

Background

This research examined the use of the propensity score method to compare proxy-completed responses to self-completed responses in the first three baseline cohorts of the Medicare Health Outcomes Survey, administered in 1998, 1999, and 2000, respectively. A proxy is someone other than the respondent who completes the survey for the respondent.

Methods

The propensity score method of matched sampling was used to compare proxy and self-completed responses. A propensity score is a value that equals the estimated probability of a given individual belonging to a treatment group given the observed background characteristics of that individual. Proxy and self-completed responses were compared on demographics, the SF-36, chronic conditions, activities of daily living, and depression-screening questions. For each individual survey respondent, logistic regression was used to calculate the probability that this individual belonged to the proxy respondent group (propensity score). Pre and post adjustment comparisons were tested by calculating effect sizes.

Results

Differences between self and proxy-completed responses were substantially reduced with the use of the propensity score method. However, differences were still found in the SF-36, several demographics, several impaired activities of daily living, several chronic conditions, and one depression-screening question.

Conclusion

The propensity score method helped to reduce differences between proxy-completed and self-completed survey responses, thereby providing an approximation to a randomized controlled experiment of proxy-completed versus self-completed survey responses.
Literature
1.
go back to reference Cooper JK, Kohlmann T, Michael JA, Haffer SC, Stevic M: Health outcomes: new quality measure for Medicare. Int J Qual Health Care 2001, 13: 9–16. 10.1093/intqhc/13.1.9PubMedCrossRef Cooper JK, Kohlmann T, Michael JA, Haffer SC, Stevic M: Health outcomes: new quality measure for Medicare. Int J Qual Health Care 2001, 13: 9–16. 10.1093/intqhc/13.1.9PubMedCrossRef
2.
go back to reference D'Agostino RB: Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Stat Med 1998, 17: 2265–2281. 10.1002/(SICI)1097-0258(19981015)17:19<2265::AID-SIM918>3.0.CO;2-BPubMedCrossRef D'Agostino RB: Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Stat Med 1998, 17: 2265–2281. 10.1002/(SICI)1097-0258(19981015)17:19<2265::AID-SIM918>3.0.CO;2-BPubMedCrossRef
3.
go back to reference Rubin DB: Matching to remove bias in observational studies. Biometrics 1973, 29: 159–183.CrossRef Rubin DB: Matching to remove bias in observational studies. Biometrics 1973, 29: 159–183.CrossRef
4.
go back to reference Neumann PJ, Araki SS, Gutterman EM: The use of proxy-completed responses in studies of older adults: lessons, challenges, and opportunities. J Am Geriatr Soc 2000, 48: 1646–1654.PubMedCrossRef Neumann PJ, Araki SS, Gutterman EM: The use of proxy-completed responses in studies of older adults: lessons, challenges, and opportunities. J Am Geriatr Soc 2000, 48: 1646–1654.PubMedCrossRef
5.
go back to reference Dorman PJ, Waddel F, Slattery J, Dennis M, Sandercock P: Are proxy assessments of health status after stroke with the EuroQol questionnaire feasible, accurate and unbiased? Stroke 1997, 28: 1883–1887.PubMedCrossRef Dorman PJ, Waddel F, Slattery J, Dennis M, Sandercock P: Are proxy assessments of health status after stroke with the EuroQol questionnaire feasible, accurate and unbiased? Stroke 1997, 28: 1883–1887.PubMedCrossRef
6.
go back to reference Yip JY, Wilber KH, Myrtle RC, Grazman DN: Comparison of older adult subject and proxy responses on the SF-36 health-related quality of life instrument. Aging Ment Health 2001, 5: 136–142. 10.1080/13607860120038357PubMedCrossRef Yip JY, Wilber KH, Myrtle RC, Grazman DN: Comparison of older adult subject and proxy responses on the SF-36 health-related quality of life instrument. Aging Ment Health 2001, 5: 136–142. 10.1080/13607860120038357PubMedCrossRef
7.
go back to reference Magaziner J, Zimmerman SI, Gruber-Baldini AL, Hebel JR, Fox KM: Proxy reporting in five areas of functional status: comparison with self reports and observations of performance. Am J Epidemiol 1997, 146: 418–428.PubMedCrossRef Magaziner J, Zimmerman SI, Gruber-Baldini AL, Hebel JR, Fox KM: Proxy reporting in five areas of functional status: comparison with self reports and observations of performance. Am J Epidemiol 1997, 146: 418–428.PubMedCrossRef
8.
go back to reference Tordorov A, Kirchner C: Bias in proxies' reports of disability: data from the national health interview survey on disability. Am J Public Health 2000, 90: 1248–1253.CrossRef Tordorov A, Kirchner C: Bias in proxies' reports of disability: data from the national health interview survey on disability. Am J Public Health 2000, 90: 1248–1253.CrossRef
9.
go back to reference Pierre U, Wood-Dauphinee S, Korner-Bitensky N, Gayton D, Hanley J: Proxy use of the Canadian SF-36 in rating health status of the disabled elderly. J Clin Epidemiol 1998, 51: 983–990. 10.1016/S0895-4356(98)00090-0PubMedCrossRef Pierre U, Wood-Dauphinee S, Korner-Bitensky N, Gayton D, Hanley J: Proxy use of the Canadian SF-36 in rating health status of the disabled elderly. J Clin Epidemiol 1998, 51: 983–990. 10.1016/S0895-4356(98)00090-0PubMedCrossRef
10.
go back to reference Shields M: Proxy reporting in the national population health survey. Health Rep 2000, 12: 21–39.PubMed Shields M: Proxy reporting in the national population health survey. Health Rep 2000, 12: 21–39.PubMed
11.
go back to reference Rosenbaum PR, Rubin DB: The central role of the propensity score in observational studies for causal effects. Biometrika 1983, 70: 41–55.CrossRef Rosenbaum PR, Rubin DB: The central role of the propensity score in observational studies for causal effects. Biometrika 1983, 70: 41–55.CrossRef
12.
go back to reference Rubin DB, Thomas N: Characterizing the effect of matching using linear propensity score methods with normal distributions. Biometrika 1992, 79: 797–809.CrossRef Rubin DB, Thomas N: Characterizing the effect of matching using linear propensity score methods with normal distributions. Biometrika 1992, 79: 797–809.CrossRef
13.
go back to reference Rubin DB, Thomas N: Combining propensity score matching with additional adjustments for prognostic covariates. J Am Stat Assoc 2000, 95: 573–585.CrossRef Rubin DB, Thomas N: Combining propensity score matching with additional adjustments for prognostic covariates. J Am Stat Assoc 2000, 95: 573–585.CrossRef
14.
go back to reference Kilborn MJ, Rathore SS, Gersh BJ, Oetgen WJ, Solomon AJ: Amiodarone and mortality among elderly patients with acute myocardial infarction with atrial fibrillation. Am Heart J 2002, 144: 1095–1101. 10.1067/mhj.2002.125836PubMedCrossRef Kilborn MJ, Rathore SS, Gersh BJ, Oetgen WJ, Solomon AJ: Amiodarone and mortality among elderly patients with acute myocardial infarction with atrial fibrillation. Am Heart J 2002, 144: 1095–1101. 10.1067/mhj.2002.125836PubMedCrossRef
15.
go back to reference Teufelsbauer H, Prusa AM, Wolff K, Polterauer P, Nanobashvili J, Prager M, Holzenbein T, Thurnher S, Lammer J, Schemper M, Kretschmer G, Huk I: Endovascular stent grafting versus open surgical operation in patients with infrarenal aortic aneurysms: a propensity score-adjusted analysis. Circulation 2002, 106: 782–787. 10.1161/01.CIR.0000028603.73287.7DPubMedCrossRef Teufelsbauer H, Prusa AM, Wolff K, Polterauer P, Nanobashvili J, Prager M, Holzenbein T, Thurnher S, Lammer J, Schemper M, Kretschmer G, Huk I: Endovascular stent grafting versus open surgical operation in patients with infrarenal aortic aneurysms: a propensity score-adjusted analysis. Circulation 2002, 106: 782–787. 10.1161/01.CIR.0000028603.73287.7DPubMedCrossRef
16.
go back to reference Neugut AI, Fleischauer AT, Sundararajan V, Mitra N, Heitjan DF, Jacobson JS, Grann VR: Use of adjuvant chemotherapy and radiation therapy for rectal cancer among the elderly: a population-based study. J Clin Oncol 2002, 20: 2643–2650. 10.1200/JCO.2002.08.062PubMedCrossRef Neugut AI, Fleischauer AT, Sundararajan V, Mitra N, Heitjan DF, Jacobson JS, Grann VR: Use of adjuvant chemotherapy and radiation therapy for rectal cancer among the elderly: a population-based study. J Clin Oncol 2002, 20: 2643–2650. 10.1200/JCO.2002.08.062PubMedCrossRef
17.
go back to reference Mehta RL, McDonald B, Gabbai F, Pahl M, Farkas A, Pascual MTA, Zhuang S, Kaplan RM, Chertow GM: Nephrology consultation in acute renal failure: does timing matter? Am J Med 2002, 113: 456–528. 10.1016/S0002-9343(02)01230-5PubMedCrossRef Mehta RL, McDonald B, Gabbai F, Pahl M, Farkas A, Pascual MTA, Zhuang S, Kaplan RM, Chertow GM: Nephrology consultation in acute renal failure: does timing matter? Am J Med 2002, 113: 456–528. 10.1016/S0002-9343(02)01230-5PubMedCrossRef
18.
go back to reference Drake C: Effects of misspecification of the propensity score on estimators of treatment effect. Biometrics 1993, 49: 1231–1236.CrossRef Drake C: Effects of misspecification of the propensity score on estimators of treatment effect. Biometrics 1993, 49: 1231–1236.CrossRef
19.
go back to reference Gu XS, Rosenbaum PR: Comparison of multivariate matching methods: structures, distances, and algorithms. J Comp Graph Stat 1993, 2: 405–420. Gu XS, Rosenbaum PR: Comparison of multivariate matching methods: structures, distances, and algorithms. J Comp Graph Stat 1993, 2: 405–420.
20.
go back to reference Dehejia RF, Wahba S: Causal effects in nonexperimental studies: reevaluating the evaluation of training programs. J Am Stat Assoc 1999, 94: 1053–1062.CrossRef Dehejia RF, Wahba S: Causal effects in nonexperimental studies: reevaluating the evaluation of training programs. J Am Stat Assoc 1999, 94: 1053–1062.CrossRef
22.
go back to reference National Committee for Quality Assurance: HEDIS ® 3.0 Volume 6 Health of Seniors Survey Manual . Washington DC 1998. National Committee for Quality Assurance: HEDIS ® 3.0 Volume 6 Health of Seniors Survey Manual . Washington DC 1998.
23.
go back to reference Ware JE, Snow KK, Kosinski M, Gandek B: SF-36® Health Status Survey Manual and Interpretation Guide New Haven: The Health Institute, New England Medical Center 1993. Ware JE, Snow KK, Kosinski M, Gandek B: SF-36® Health Status Survey Manual and Interpretation Guide New Haven: The Health Institute, New England Medical Center 1993.
24.
go back to reference Ware JE, Kosinski M: SF-36® Physical and Mental Health Summary Scales: A Manual for Users of Version 1 Second Edition Lincoln: QualityMetric, Inc 2001. Ware JE, Kosinski M: SF-36® Physical and Mental Health Summary Scales: A Manual for Users of Version 1 Second Edition Lincoln: QualityMetric, Inc 2001.
25.
go back to reference Cohen J: Statistical power analysis for the behavioral sciences Hillsdale: Lawrence Erlbaum 1988. Cohen J: Statistical power analysis for the behavioral sciences Hillsdale: Lawrence Erlbaum 1988.
26.
go back to reference Markus H, Zajonc RB: The cognitive perspective in social psychology. In The handbook of social psychology 3 Edition (Edited by: Lindzey G, Aronson E). Hillsdale: Erlbaum 1985, 137–230. Markus H, Zajonc RB: The cognitive perspective in social psychology. In The handbook of social psychology 3 Edition (Edited by: Lindzey G, Aronson E). Hillsdale: Erlbaum 1985, 137–230.
27.
go back to reference Todorov A: Cognitive procedures for correcting proxy-response bias in surveys. Appl Cog Psychol 2002, 17: 215–224. 10.1002/acp.850CrossRef Todorov A: Cognitive procedures for correcting proxy-response bias in surveys. Appl Cog Psychol 2002, 17: 215–224. 10.1002/acp.850CrossRef
Metadata
Title
Utilization of the propensity score method: an exploratory comparison of proxy-completed to self-completed responses in the Medicare Health Outcomes Survey
Authors
Beth Hartman Ellis
Wade M Bannister
Jacquilyn Kay Cox
Brenda M Fowler
Erin Dowd Shannon
David Drachman
Randall W Adams
Laura A Giordano
Publication date
01-12-2003
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2003
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-1-47

Other articles of this Issue 1/2003

Health and Quality of Life Outcomes 1/2003 Go to the issue