Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2006

Open Access 01-12-2006 | Research

Misinterpretation with norm-based scoring of health status in adults with type 1 diabetes

Authors: Alison L Supina, David H Feeny, Linda J Carroll, Jeffrey A Johnson

Published in: Health and Quality of Life Outcomes | Issue 1/2006

Login to get access

Abstract

Background

Interpretations of profile and preference based measure scores can differ. Profile measures often use a norm-based scoring algorithm where each scale is scored to have a standardized mean and standard deviation, relative to the general population scores/norms (i.e., norm-based). Preference-based index measures generate an overall scores on the conventional scale in which 0.00 is assigned to dead and 1.00 is assigned to perfect health. Our objective was to investigate the interpretation of norm-based scoring of generic health status measures in a population of adults with type 1 diabetes by comparing norm-based health status scores and preference-based health-related quality of life (HRQL) scores.

Methods

Data were collected through self-complete questionnaires sent to patients with type 1 diabetes. The RAND-36 and the Health Utilities Index Mark 3 (HUI3) were included.

Results

A total of 216 (61%) questionnaires were returned. The respondent sample was predominantly female (58.8%); had a mean (SD) age of 37.1 (14.3) years and a mean duration of diabetes of 20.9 (12.4) years. Mean (SD) health status scores were: RAND-36 PHC 47.9 (9.4), RAND-36 MHC 47.2 (11.8), and HUI3 0.78 (0.23). Histograms of these scores show substantial left skew. HUI3 scores were similar to those previously reported for diabetes in the general Canadian population. Physical and mental health summary scores of the RAND-36 suggest that this population is as healthy as the general adult population.

Conclusion

In this sample, a preference-based measure indicated poorer health, consistent with clinical evidence, whereas a norm-based measure indicated health similar to the average for the general population. Norm-based scoring measure may provide misleading interpretations in populations when health status is not normally distributed.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lydick E, Epstein RS: Interpretation of quality of life changes. Qual Life Res 1993, 2: 221–226. 10.1007/BF00435226PubMedCrossRef Lydick E, Epstein RS: Interpretation of quality of life changes. Qual Life Res 1993, 2: 221–226. 10.1007/BF00435226PubMedCrossRef
2.
go back to reference Guyatt GH, Osobora D, Wu A, Wyrwich KW, Norman GR, the Clinical Significance Consensus Meeting Group: Methods to explain the clinical significance of health status measures. Mayo Clin Proc 2002, 77: 371–383.PubMedCrossRef Guyatt GH, Osobora D, Wu A, Wyrwich KW, Norman GR, the Clinical Significance Consensus Meeting Group: Methods to explain the clinical significance of health status measures. Mayo Clin Proc 2002, 77: 371–383.PubMedCrossRef
3.
go back to reference Cella D, Bullinger M, Scott C, Barofsky I, the Clinical Significance Consensus Meeting Group: Group vs. individual approaches to understanding the clinical significance of differences or changes in quality of life. Mayo Clin Proc 2002, 77: 384–392.PubMedCrossRef Cella D, Bullinger M, Scott C, Barofsky I, the Clinical Significance Consensus Meeting Group: Group vs. individual approaches to understanding the clinical significance of differences or changes in quality of life. Mayo Clin Proc 2002, 77: 384–392.PubMedCrossRef
4.
go back to reference Crosby CD, Kolotkin RL, Williams GR: Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol 2003, 56: 395–407. 10.1016/S0895-4356(03)00044-1PubMedCrossRef Crosby CD, Kolotkin RL, Williams GR: Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol 2003, 56: 395–407. 10.1016/S0895-4356(03)00044-1PubMedCrossRef
5.
go back to reference Guyatt GH, Feeny DH, Patrick DL: Measuring health-related quality of life. Ann Intern Med 1993, 118: 622–629.PubMedCrossRef Guyatt GH, Feeny DH, Patrick DL: Measuring health-related quality of life. Ann Intern Med 1993, 118: 622–629.PubMedCrossRef
6.
go back to reference Luscombe FA: Health-related quality of life measurement in type 2 diabetes. Value Health 2000, 3: S15-S28. 10.1046/j.1524-4733.2000.36032.xCrossRef Luscombe FA: Health-related quality of life measurement in type 2 diabetes. Value Health 2000, 3: S15-S28. 10.1046/j.1524-4733.2000.36032.xCrossRef
7.
go back to reference MacKeigan LD, Pathak DS: Overview of health-related quality of life measures. Am J Hosp Pharm 1992, 49: 226–245. MacKeigan LD, Pathak DS: Overview of health-related quality of life measures. Am J Hosp Pharm 1992, 49: 226–245.
8.
go back to reference Feeny DH, Furlong WJ, Torrance GW, Goldsmith CH, Ma ZZ, DePauw S, Denton M, Boyle M: Health Utilities Index. Multiattribute and single-attribute utility functions for the Health Utilities Index Mark 3 system. Med Care 2002, 40: 113–128. 10.1097/00005650-200202000-00006PubMedCrossRef Feeny DH, Furlong WJ, Torrance GW, Goldsmith CH, Ma ZZ, DePauw S, Denton M, Boyle M: Health Utilities Index. Multiattribute and single-attribute utility functions for the Health Utilities Index Mark 3 system. Med Care 2002, 40: 113–128. 10.1097/00005650-200202000-00006PubMedCrossRef
9.
go back to reference Ware JE, Kosinski M, James D: How to score version 2 of the SF-36® Health Survey (Standard & Acute Forms). Lincoln, RI: Quality Metric Incorporated; 2000. Ware JE, Kosinski M, James D: How to score version 2 of the SF-36® Health Survey (Standard & Acute Forms). Lincoln, RI: Quality Metric Incorporated; 2000.
10.
go back to reference Hays RD: RAND-36 Health Status Inventory. San Antonio: The Psychological Corporation; 1998. Hays RD: RAND-36 Health Status Inventory. San Antonio: The Psychological Corporation; 1998.
11.
go back to reference Tabaei BP, Shill-Novak J, Brandle R, Kaplan RM, Herman WH: Glycemia and the quality of well-being in patients with diabetes. Qual Life Res 2004, 13: 1153–1161. 10.1023/B:QURE.0000031336.81580.52PubMedCrossRef Tabaei BP, Shill-Novak J, Brandle R, Kaplan RM, Herman WH: Glycemia and the quality of well-being in patients with diabetes. Qual Life Res 2004, 13: 1153–1161. 10.1023/B:QURE.0000031336.81580.52PubMedCrossRef
12.
go back to reference Coffey JT, Brandle M, Zhou H, Marriott D, Burke R: Valuing health-related quality of life in diabetes. Diabetes Care 2002, 25: 2238–2243.PubMedCrossRef Coffey JT, Brandle M, Zhou H, Marriott D, Burke R: Valuing health-related quality of life in diabetes. Diabetes Care 2002, 25: 2238–2243.PubMedCrossRef
13.
go back to reference Redekop WK, Koopmanschap MA, Stolk RP, Rutten GE, Wolffenbuttel BH, Niessen LW: Health-related quality of life and treatment satisfaction in Dutch patients with type 2 diabetes. Diabetes Care 2002, 25: 458–463.PubMedCrossRef Redekop WK, Koopmanschap MA, Stolk RP, Rutten GE, Wolffenbuttel BH, Niessen LW: Health-related quality of life and treatment satisfaction in Dutch patients with type 2 diabetes. Diabetes Care 2002, 25: 458–463.PubMedCrossRef
14.
go back to reference Koopmanschap M: Coping with type II diabetes: the patient's perspective. Diabetologia 2002, 45: S18–22.PubMedCrossRef Koopmanschap M: Coping with type II diabetes: the patient's perspective. Diabetologia 2002, 45: S18–22.PubMedCrossRef
15.
go back to reference Hahl J, Hämäläinen H, Sintonen H, Simell T, Arinen S, Simell O: Health-related quality of life in type 1 diabetes without or with symptoms of long-term complications. Qual Life Res 2002, 11: 427–436. 10.1023/A:1015684100227PubMedCrossRef Hahl J, Hämäläinen H, Sintonen H, Simell T, Arinen S, Simell O: Health-related quality of life in type 1 diabetes without or with symptoms of long-term complications. Qual Life Res 2002, 11: 427–436. 10.1023/A:1015684100227PubMedCrossRef
16.
go back to reference UK Prospective Diabetes Study Group: Quality of life in type 2 diabetic patients is affected by complications but not by intensive policies to improve blood glucose or blood pressure control (UKPDS 37). Diabetes Care 1999, 22: 1125–1136.CrossRef UK Prospective Diabetes Study Group: Quality of life in type 2 diabetic patients is affected by complications but not by intensive policies to improve blood glucose or blood pressure control (UKPDS 37). Diabetes Care 1999, 22: 1125–1136.CrossRef
17.
go back to reference Statistics Canada: National Population Health Survey, Cycle 2 Documentation. Statistics Canada: National Population Health Survey, Cycle 2 Documentation.
18.
go back to reference Drummond , Michael : Introducing Economic and Quality of Life Measurements into Clinical Studies. Ann Med 2001, 33: 344–349.PubMedCrossRef Drummond , Michael : Introducing Economic and Quality of Life Measurements into Clinical Studies. Ann Med 2001, 33: 344–349.PubMedCrossRef
19.
go back to reference Horsman J, Furlong W, Feeny D, Torrance G: The Health Utilities Index (HUI ® ): concepts, measurement properties and applications. Health Qual Life Outcomes 2003, 1: 54. 10.1186/1477-7525-1-54PubMedCentralPubMedCrossRef Horsman J, Furlong W, Feeny D, Torrance G: The Health Utilities Index (HUI ® ): concepts, measurement properties and applications. Health Qual Life Outcomes 2003, 1: 54. 10.1186/1477-7525-1-54PubMedCentralPubMedCrossRef
20.
go back to reference Boyle MH, Furlong W, Feeny D, Torrance G, Hatcher J: Reliability of the Health Utilities Index – Mark III used in the 1991 Cycle 6 General Social Survey Health Questionnaire. Qual Life Res 1995, 4: 249–257. 10.1007/BF02260864PubMedCrossRef Boyle MH, Furlong W, Feeny D, Torrance G, Hatcher J: Reliability of the Health Utilities Index – Mark III used in the 1991 Cycle 6 General Social Survey Health Questionnaire. Qual Life Res 1995, 4: 249–257. 10.1007/BF02260864PubMedCrossRef
21.
go back to reference Fisk JD, Brown MG, Sketris IS, Metz LM, Murray TJ, Stadnyk KJ: A comparison of health utility measures for the evaluation of multiple sclerosis treatments. J Neurol Neurosurg Psychiatry 2005, 76: 58–63. 10.1136/jnnp.2003.017897PubMedCentralPubMedCrossRef Fisk JD, Brown MG, Sketris IS, Metz LM, Murray TJ, Stadnyk KJ: A comparison of health utility measures for the evaluation of multiple sclerosis treatments. J Neurol Neurosurg Psychiatry 2005, 76: 58–63. 10.1136/jnnp.2003.017897PubMedCentralPubMedCrossRef
22.
go back to reference Jones CA, Feeny D, Eng K: Test-retest reliability of Health Utilities Index scores: evidence from hip fracture. Int J Technol Assess Health Care 2005, 21: 393–398.PubMedCrossRef Jones CA, Feeny D, Eng K: Test-retest reliability of Health Utilities Index scores: evidence from hip fracture. Int J Technol Assess Health Care 2005, 21: 393–398.PubMedCrossRef
23.
go back to reference Marra CA, Rashidi AA, Guh D, Kopec JA, Abrahamowicz M, Esdaile JM, Brazier JE, Fortin PR, Anis AH: Are indirect utility measures reliable and responsive in rheumatoid arthritis patients. Qual Life Res 2005, 14: 1333–1344. 10.1007/s11136-004-6012-0PubMedCrossRef Marra CA, Rashidi AA, Guh D, Kopec JA, Abrahamowicz M, Esdaile JM, Brazier JE, Fortin PR, Anis AH: Are indirect utility measures reliable and responsive in rheumatoid arthritis patients. Qual Life Res 2005, 14: 1333–1344. 10.1007/s11136-004-6012-0PubMedCrossRef
24.
go back to reference Thoma A, Sprague S, Veltri K, Duku E, Furlong W: Methodology and measurement properties of health-related quality of life instruments: a prospective study of patients undergoing breast reduction surgery. Health Qual Life Outcomes 2005, 3: 44. 10.1186/1477-7525-3-44PubMedCentralPubMedCrossRef Thoma A, Sprague S, Veltri K, Duku E, Furlong W: Methodology and measurement properties of health-related quality of life instruments: a prospective study of patients undergoing breast reduction surgery. Health Qual Life Outcomes 2005, 3: 44. 10.1186/1477-7525-3-44PubMedCentralPubMedCrossRef
25.
go back to reference Maddigan SL, Feeny DH, Johnson JA, For the DOVE Investigators: A comparison of the Health Utilities Index Mark 2 and Mark 3 in type 2 diabetes. Med Decis Making 2003, 23: 489–501. 10.1177/0272989X03258438PubMedCrossRef Maddigan SL, Feeny DH, Johnson JA, For the DOVE Investigators: A comparison of the Health Utilities Index Mark 2 and Mark 3 in type 2 diabetes. Med Decis Making 2003, 23: 489–501. 10.1177/0272989X03258438PubMedCrossRef
26.
go back to reference Maddigan SL, Feeny DH, Johnson JA: Construct validity of the RAND-12 and Health Utilities Index Mark 2 and Mark 3 in type 2 diabetes. Qual Life Res 2004, 13: 435–448. 10.1023/B:QURE.0000018497.06539.8fPubMedCrossRef Maddigan SL, Feeny DH, Johnson JA: Construct validity of the RAND-12 and Health Utilities Index Mark 2 and Mark 3 in type 2 diabetes. Qual Life Res 2004, 13: 435–448. 10.1023/B:QURE.0000018497.06539.8fPubMedCrossRef
27.
go back to reference Johnson JA, Nowatzki TE, Coons SJ: Health-related quality of life of diabetic Pima Indians. Med Care 1996, 34: 97–102. 10.1097/00005650-199602000-00001PubMedCrossRef Johnson JA, Nowatzki TE, Coons SJ: Health-related quality of life of diabetic Pima Indians. Med Care 1996, 34: 97–102. 10.1097/00005650-199602000-00001PubMedCrossRef
28.
go back to reference The Diabetes Control and Complications Trial Research Group, Shamoon H, Duffy H, Fleischer N: The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med 1993, 329: 977–984. 10.1056/NEJM199309303291401CrossRef The Diabetes Control and Complications Trial Research Group, Shamoon H, Duffy H, Fleischer N: The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med 1993, 329: 977–984. 10.1056/NEJM199309303291401CrossRef
29.
go back to reference Birbeck GI, Kim S, Hays RD, Vickery BG: Quality of life measures in epilepsy: How well can they detect change over time? Neurology 2000, 54: 1822–1827.PubMedCrossRef Birbeck GI, Kim S, Hays RD, Vickery BG: Quality of life measures in epilepsy: How well can they detect change over time? Neurology 2000, 54: 1822–1827.PubMedCrossRef
30.
go back to reference Johnson JA, Maddigan SL: Performance of the RAND-12 and SF-12 summary scores in type 2 diabetes. Qual Life Res 2004, 13: 449–456. 10.1023/B:QURE.0000018494.72748.cfPubMedCrossRef Johnson JA, Maddigan SL: Performance of the RAND-12 and SF-12 summary scores in type 2 diabetes. Qual Life Res 2004, 13: 449–456. 10.1023/B:QURE.0000018494.72748.cfPubMedCrossRef
31.
go back to reference Hays RD, Morales LS: The RAND-36 measure of health-related quality of life. Ann Med 2001, 33: 350–357.PubMedCrossRef Hays RD, Morales LS: The RAND-36 measure of health-related quality of life. Ann Med 2001, 33: 350–357.PubMedCrossRef
32.
go back to reference Jacobson AM, de Groot M, Samson JA: The evaluation of two measures of quality of life in type 1 and type 2 diabetes. Diabetes Care 1994, 17: 267–274.PubMedCrossRef Jacobson AM, de Groot M, Samson JA: The evaluation of two measures of quality of life in type 1 and type 2 diabetes. Diabetes Care 1994, 17: 267–274.PubMedCrossRef
33.
go back to reference Wyrwich KW, Tierney WM, Babu AN, Kroenk K, Wolinsky FD: A comparison of clinically important differences in health-related quality of life for patients with chronic lung disease, asthma, or heart disease. Health Serv Res 2005, 40: 577–591. 10.1111/j.1475-6773.2005.0l374.xPubMedCentralPubMedCrossRef Wyrwich KW, Tierney WM, Babu AN, Kroenk K, Wolinsky FD: A comparison of clinically important differences in health-related quality of life for patients with chronic lung disease, asthma, or heart disease. Health Serv Res 2005, 40: 577–591. 10.1111/j.1475-6773.2005.0l374.xPubMedCentralPubMedCrossRef
34.
go back to reference Haapanen N, Miilunpalo S, Pasanen M, Oja P, Vuori I: Agreement between questionnaire data and medical records of chronic diseases in middle-aged and elderly Finnish men and women. Am J Epidemiol 1997, 145: 762–769.PubMedCrossRef Haapanen N, Miilunpalo S, Pasanen M, Oja P, Vuori I: Agreement between questionnaire data and medical records of chronic diseases in middle-aged and elderly Finnish men and women. Am J Epidemiol 1997, 145: 762–769.PubMedCrossRef
35.
go back to reference Kehoe R, Wu SY, Leske MC, Chylack LT: Comparing self-reported and physician-reported medical history. Am J Epidemiol 1994, 139: 813–818.PubMed Kehoe R, Wu SY, Leske MC, Chylack LT: Comparing self-reported and physician-reported medical history. Am J Epidemiol 1994, 139: 813–818.PubMed
36.
go back to reference Martin LM, Leff M, Calonge N, Garrett C, Nelson DE: Validation of self-reported chronic conditions and health services in a managed care population. Am J Prev Med 2000, 18: 215–218. 10.1016/S0749-3797(99)00158-0PubMedCrossRef Martin LM, Leff M, Calonge N, Garrett C, Nelson DE: Validation of self-reported chronic conditions and health services in a managed care population. Am J Prev Med 2000, 18: 215–218. 10.1016/S0749-3797(99)00158-0PubMedCrossRef
37.
go back to reference Maddigan SL, Feeny DH, Johnson JA: Health-related quality of life deficits associated with diabetes and co morbidities in a Canadian national population health survey. Qual Life Res 2005, 14: 1311–1320. 10.1007/s11136-004-6640-4PubMedCrossRef Maddigan SL, Feeny DH, Johnson JA: Health-related quality of life deficits associated with diabetes and co morbidities in a Canadian national population health survey. Qual Life Res 2005, 14: 1311–1320. 10.1007/s11136-004-6640-4PubMedCrossRef
39.
go back to reference Hux Janet, Mei Tang : Patterns of Prevalence and Incidence of Diabetes. In Diabetes in Ontario: An ICES Practice Atlas. Edited by: Hux JE, Booth GL, Slaughter PM, Laupacis A. Institute for Clinical Evaluative Sciences; 2003:1.2–1.3. Hux Janet, Mei Tang : Patterns of Prevalence and Incidence of Diabetes. In Diabetes in Ontario: An ICES Practice Atlas. Edited by: Hux JE, Booth GL, Slaughter PM, Laupacis A. Institute for Clinical Evaluative Sciences; 2003:1.2–1.3.
40.
go back to reference Oliver Matthew J, Charmaine LokE, Jane Shi , Deanna RothwellM: Dialysis Therapy for Persons with Diabetes. In Diabetes in Ontario: An ICES Practice Atlas. Edited by: Hux JE, Booth GL, Slaughter PM, Laupacis A. Institute for Clinical Evaluative Sciences; 2003:8.166–8.167. Oliver Matthew J, Charmaine LokE, Jane Shi , Deanna RothwellM: Dialysis Therapy for Persons with Diabetes. In Diabetes in Ontario: An ICES Practice Atlas. Edited by: Hux JE, Booth GL, Slaughter PM, Laupacis A. Institute for Clinical Evaluative Sciences; 2003:8.166–8.167.
41.
go back to reference Bailes BK: Diabetes mellitus and its chronic complications. AORN 2002,76(2):266–80.CrossRef Bailes BK: Diabetes mellitus and its chronic complications. AORN 2002,76(2):266–80.CrossRef
42.
go back to reference Orchard TJ, Dorman JS, Maser RE, et al.: Prevalence of complications in IDDM by sex and duration: Pittsburgh Epidemiology of Diabetes Complications Study II. Diabetes 1990, 39: 1116–24.PubMedCrossRef Orchard TJ, Dorman JS, Maser RE, et al.: Prevalence of complications in IDDM by sex and duration: Pittsburgh Epidemiology of Diabetes Complications Study II. Diabetes 1990, 39: 1116–24.PubMedCrossRef
43.
go back to reference Bakaris G: Risk factors for diabetic nephropathy. In UpToDate. Edited by: Rose BD. UpToDate, Wellesley, WA; 2001. Bakaris G: Risk factors for diabetic nephropathy. In UpToDate. Edited by: Rose BD. UpToDate, Wellesley, WA; 2001.
Metadata
Title
Misinterpretation with norm-based scoring of health status in adults with type 1 diabetes
Authors
Alison L Supina
David H Feeny
Linda J Carroll
Jeffrey A Johnson
Publication date
01-12-2006
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2006
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-4-15

Other articles of this Issue 1/2006

Health and Quality of Life Outcomes 1/2006 Go to the issue