Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Health and Quality of Life Outcomes
Published in: Health and Quality of Life Outcomes 1/2014

Open Access 01-12-2014 | Research

Patient reports of health outcome for adults living with sickle cell disease: development and testing of the ASCQ-Me item banks

Authors: San D Keller, Manshu Yang, Marsha J Treadwell, Ellen M Werner, Kathryn L Hassell

Published in: Health and Quality of Life Outcomes | Issue 1/2014

Login to get access

Abstract

Background

Providers and patients have called for improved understanding of the health care requirements of adults with sickle cell disease (SCD) and have identified the need for a systematic, reliable and valid method to document the patient-reported outcomes (PRO) of adult SCD care. To address this need, the Adult Sickle Cell Quality of Life Measurement System (ASCQ-Me) was designed to complement the Patient Reported Outcome Measurement Information System (PROMIS®). Here we describe methods and results of the psychometric evaluation of ASCQ-Me item banks (IBs).

Methods

At seven geographically-disbursed clinics within the US, 556 patients responded to questions generated to assess cognitive, emotional, physical and social impacts of SCD. We evaluated the construct validity of the hypothesized domains using exploratory factor analysis (EFA), parallel analysis (PA), and bi-factor analysis (Item Response Theory Graded Response Model, IRT-GRM). We used IRT-GRM and the Wald method to identify bias in responses across gender and age. We used IRT and Cronbach’s alpha coefficient to evaluate the reliability of the IBs and then tested the ability of summary scores based on IRT calibrations to discriminate among tertiles of respondents defined by SCD severity.

Results

Of the original 140 questions tested, we eliminated 48 that either did not form clean factors or provided biased measurement across subgroups defined by age and gender. Via EFA and PA, we identified three subfactors within physical impact: sleep, pain and stiffness impacts. Analysis of the resulting six item sets (sleep, pain, stiffness, cognitive, emotional and social impacts of SCD) supported their essential unidimensionality. With the exception of the cognitive impact IB, these item sets also were highly reliable across a broad range of values and highly significantly related to SCD disease severity.

Conclusion

ASCQ-Me pain, sleep, stiffness, emotional and social SCD impact IBs demonstrated exceptional measurement properties using modern and classical psychometric methods of evaluation. Further development of the cognitive impact IB is required to improve its sensitivity to differences in SCD disease severity. Future research will evaluate the sensitivity of the ASCQ-Me IBs to change in SCD disease severity over time due to health interventions.
Literature
1.
Brawley OW, Cornelius LJ, Edwards LR, Gamble VN, Green BL, Inturrisi C, James AH, Laraque D, Mendez M, Montoya CJ, Pollock BH, Robinson L, Scholnik AP, Schori M: National institutes of health consensus development conference statement: hydroxyurea treatment for sickle cell disease. Ann Intern Med 2008, 148(12):932–938. Epub 2008 May 5. PMID: 18458271 10.7326/0003-4819-148-12-200806170-00220CrossRefPubMed
2.
Vichinsky EP, Neumayr LD, Gold JI, Weiner MW, Rule RR, Truran D, Kasten J, Eggleston B, Kesler K, McMahon L, Orringer EP, Harrington T, Kalinyak K, De Castro LM, Kutlar A, Rutherford CJ, Johnson C, Bessman JD, Jordan LB, Armstrong FD: Neuropsychological dysfunction and neuroimaging abnormalities in neurologically intact adults with sickle cell anemia. JAMA 2010, 303(18):1823–1831. 10.1001/jama.2010.562PubMedCentralCrossRefPubMed
3.
4.
Haywood C Jr, Beach MC, Lanzkron S, Strouse JJ, Wilson R, Park H, Witkop C, Bass EB, Segal JB: A systematic review of barriers and interventions to improve appropriate use of therapies for sickle cell disease. J Natl Med Assoc 2009, 101(10):1022–1033.PubMed
5.
Werner EM: NHLBI activities in hemoglobinopathies. NICHD Newborn Screening Translational Research Network Meeting. 2013.
6.
Treadwell MT, Hassell KL, Levine RE, Keller SD: Adult Sickle Cell Quality of Life Measurement Information System (ASCQ-Me): Conceptual model based on review of the literature and formative research. Clin J Pain 2013, [Epub ahead of print].
7.
Keller SD, Levine RE: The grounded item technique for developing content valid questions.[abstract]. Qual Life Res 2011, 20: 54.
8.
Flanagan JC: The critical incident technique. Psych Bull 1954, 51(4):327–358. 10.1037/h0061470CrossRef
9.
Stewart AL, Ware JE: Measuring Functioning and Well-being: The Medical Outcome Study Approach. Duke University Press, Durham; 1992.
10.
DeWalt DA, Rothrock N, Yount S, Stone AA: Evaluation of item candidates: The PROMIS qualitative item review. Med Care 2007, 45(5):S12-S21. 10.1097/01.mlr.0000254567.79743.e2PubMedCentralCrossRefPubMed
11.
Reise SP, Yu J: Parameter recovery in the graded response model using MULTILOG. J Educ Meas 1990, 27: 133–144. 10.1111/j.1745-3984.1990.tb00738.xCrossRef
12.
Bender MA, Hobbs W: Sickle Cell Disease. In Gene Reviews [Internet]. Edited by: Pagon RA, Bird TC, Dolan CR, Stephens K. University of Washington, Seattle, Seattle (WA); 1993–2003. [updated 2009 Sep 17]
13.
Steinberg MH: Sickle cell anemia, the first molecular disease: overview of molecular etiology, pathophysiology, and therapeutic approaches. Sci World J 2008, 25(8):1295–1324. 10.1100/tsw.2008.157CrossRef
14.
Steinberg MH: Predicting clinical severity in sickle cell anaemia. Br J Haematol 2005, 129(4):465–481. 10.1111/j.1365-2141.2005.05411.xCrossRefPubMed
15.
Sebastiani P, Nolan VG, Baldwin CT, Abad-Grau MM, Wang L, Adewoye AH, McMahon LC, Farrer LA, Taylor JG, Kato GJ, Gladwin MT, Steinberg MH: A network model to predict the risk of death in sickle cell disease. Blood 2007, 110(7):2727–2735. 10.1182/blood-2007-04-084921PubMedCentralCrossRefPubMed
16.
Akinola NO, Bolarinwa RA, Faponle AF: The import of abdominal pain in adults with sickle cell disorder. West Afr J Med 2009, 28(2):83–86.PubMed
17.
Ballas SK: Sickle cell disease: current clinical management. Semin Hematol 2010, 38(4):307–314. 10.1016/S0037-1963(01)90024-1CrossRef
18.
Sebastiani P, Solovieff N, Hartley SW, Milton JN, Riva A, Dworkis DA, Melista E, Klings ES, Garrett ME, Telen MJ, Ashley-Koch A, Baldwin CT, Steinberg MH: Genetic modifiers of the severity of sickle cell anemia identified through a genome-wide association study. Am J Hematol 2010, 85(1):29–35.PubMedCentralPubMed
19.
Steinberg MH, Adewoye AH: Modifier genes and sickle cell anemia. Curr Opin Hematol 2006, 13(3):131–136. 10.1097/01.moh.0000219656.50291.73CrossRefPubMed
20.
Mayer ML, Konrad TR, Dvorak CC: Hospital resource utilization among patients with sickle cell disease. J Health Care Poor Underserved 2003, 14(1):122–135. 10.1353/hpu.2010.0834CrossRefPubMed
21.
Loureiro MM, Rozenfeld S, Sá Carvalho M, Portugal RD: Factors associated with hospital readmission in sickle cell disease. BMC Blood Disord 2009, 9: 2. doi:10.1186/1471–2326–9-2 10.1186/1471-2326-9-2PubMedCentralCrossRefPubMed
22.
Aisiku IP, Smith WR, McClish DK, Levenson JL, Penberthy LT, Roseff SD, Bovbjerg VE, Roberts JD: Comparisons of high versus low emergency department utilizers in sickle cell disease. Ann Emerg Med 2009, 53(5):587–593. 10.1016/j.annemergmed.2008.07.050CrossRefPubMed
23.
Audard V, Homs S, Habibi A, Galacteros F, Bartolucci P, Godeau B, Renaud B, Levy Y, Grimbert P, Lang P, Brun-Buisson C, Brochard L, Schortgen F, Maitre B, Mekontso Dessap A: Acute kidney injury in sickle patients with painful crisis or acute chest syndrome and its relation to pulmonary hypertension. Nephrol Dial Transplant 2010, 25(8):2524–2529. 10.1093/ndt/gfq083CrossRefPubMed
24.
Frei-Jones MJ, Field JJ, DeBaun MR: Risk factors for hospital readmission within 30 days: a new quality measure for children with sickle cell disease. Pediatr Blood Cancer 2009, 52(4):481–485. 10.1002/pbc.21854PubMedCentralCrossRefPubMed
25.
Carroll CP, Haywood C Jr, Fagan P, Lanzkron S: The course and correlates of high hospital utilization in sickle cell disease: Evidence from a large, urban Medicaid managed care organization. Am J Hematol 2009, 84(10):666–670. 10.1002/ajh.21515PubMedCentralCrossRefPubMed
26.
Smith WR, Penberthy LT, Bovbjerg VE, McClish DK, Roberts JD, Dahman B, Aisiku IP, Levenson JL, Roseff SD: Daily assessment of pain in adults with sickle cell disease. Ann Intern Med 2008, 148(2):94–101. 10.7326/0003-4819-148-2-200801150-00004CrossRefPubMed
27.
Dampier C, Setty BN, Eggleston B, Brodecki D, O'neal P, Stuart M: Vaso-occlusion in children with sickle cell disease: clinical characteristics and biologic correlates. J Pediatr Hematol Oncol 2004, 26(12):785–790.PubMed
28.
Vick LR, Gosche JR, Islam S: Partial splenectomy prevents splenic sequestration crises in sickle cell disease. J Pediatr Surg 2009, 44(11):2088–2091. 10.1016/j.jpedsurg.2009.06.007CrossRefPubMed
29.
Halabi-Tawil M, Lionnet F, Girot R, Bachmeyer C, Lévy PP, Aractingi S: Sickle cell leg ulcers: a frequently disabling complication and a marker of severity. Br J Dermatol 2008, 158(2):339–344. 10.1111/j.1365-2133.2007.08323.xCrossRefPubMed
30.
Nolan VG, Adewoye A, Baldwin C, Wang L, Ma Q, Wyszynski DF, Farrell JJ, Sebastiani P, Farrer LA, Steinberg MH: Sickle cell leg ulcers: associations with haemolysis and SNPs in Klotho, TEK and genes of the TGF-beta/BMP pathway. Br J Haematol 2006, 133(5):570–578. 10.1111/j.1365-2141.2006.06074.xPubMedCentralCrossRefPubMed
31.
Klings ES, Wyszynski DF, Nolan VG, Steinberg MH: Abnormal pulmonary function in adults with sickle cell anemia. Am J Respir Crit Care Med 2006, 173(11):1264–1269. 10.1164/rccm.200601-125OCPubMedCentralCrossRefPubMed
32.
Gill FM, Sleeper LA, Weiner SJ, Brown AK, Bellevue R, Grover R, Pegelow CH, Vichinsky E: Clinical events in the first decade in a cohort of infants with sickle cell disease. Cooperative study of sickle cell disease. Blood 1995, 86(2):776–783.PubMed
33.
Van der Linden WT, Van K-S: Using response times to detect aberrant responses in computerized adaptive testing. Psychometrika 2003, 68(2):251–265. 10.1007/BF02294800CrossRef
34.
Cheng L, Cumber S, Dumas C, Winter R, Nguyen KM, Nieman LZ: Health related quality of life in pregeriatric patients with chronic diseases at urban, public supported clinics. Health Qual Life Outcomes 2003, 1: 63. 10.1186/1477-7525-1-63PubMedCentralCrossRefPubMed
35.
Wensing M, Vingerhoets E, Grol R: Functional status, health problems, age and comorbidity in primary care patients. Qual Life Res 2001, 10: 141–148. 10.1023/A:1016705615207CrossRefPubMed
36.
Michelson H, Bolund C, Brandberg Y: Multiple chronic health problems are negatively associated with health related quality of life (HRQoL) irrespective of age. Qual Life Res 2000, 9: 1093–1104. 10.1023/A:1016654621784CrossRefPubMed
37.
Meyer HH: Methods for scoring a check-list type rating scale. J Appl Psychol 1951, 35(1):46–49. 10.1037/h0055890CrossRefPubMed
38.
Bland AC, Kreiter CD, Gordon JA: The psychometric properties of five scoring methods applied to the script concordance test. Acad Med 2005, 80(4):395–399. 10.1097/00001888-200504000-00019CrossRefPubMed
39.
Hu L, Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model 1999, 6(1):1–55. 10.1080/10705519909540118CrossRef
40.
Suhr DD: Exploratory or confirmatory factor analysis? SUGI Proc 2006, Paper 200–31.
41.
Horn JL: A rationale and a test for the number of factors in factor analysis. Psychometrika 1965, 30: 179–185. 10.1007/BF02289447CrossRefPubMed
42.
Cattell RB: The scree test for the number of factors. Multivar Behav Res 1966, 1: 245–246. 10.1207/s15327906mbr0102_10CrossRef
43.
Thurstone LL: The vectors of the mind: multiple factor analysis for the isolation of primary traits. University of Chicago Press, Chicago, IL; 1935.CrossRef
44.
Hayashi T, Hays RD: A microcomputer program for analyzing multitrait-multimethod matrices. Behav Res Methods Instrum Comput 1987, 19: 345–348. 10.3758/BF03202573CrossRef
45.
Ware JE, Harris WJ, Gandek B, Rogers BW, Reese PR: MAP-R for Windows: Multitrait/Multi-item Analysis Program - Revised User's Guide. Health Assessment Lab, Boston, MA; 1997.
46.
Howard KI, Forehand GG: A method for correcting item-total correlations for the effect of relevant item inclusion. Ed Psych Meas 1962, 22: 731–735. 10.1177/001316446202200407CrossRef
47.
Reise SP, Morizot J, Hays RD: The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Qual Life Res 2007, 16: 19–31. 10.1007/s11136-007-9183-7CrossRefPubMed
48.
Samejima F: Estimation of latent ability using a response pattern of graded scores. In Psychometrika Monograph, 17. Psychometric Society, Richmond, VA; 1969.
49.
50.
Harrison DA: Robustness of IRT parameter estimation to violations of the unidimensionality assumption. J Educ Stat 1986, 11(2):91–115. 10.2307/1164972CrossRef
51.
Embretson SE, Reise SP: Item Response Theory for Psychologists. Lawrence Erlbaum Associates, Mahwah, NJ; 2000.
52.
Woods CM: Empirical selection of anchors for tests of differential item functioning. Appl Psychol Meas 2009, 33: 42–57. 10.1177/0146621607314044CrossRef
53.
Lord FM: A Study of Item Bias, using item Characteristic Curve Theory. In Basic Problems in Cross-Cultural Psychology. Edited by: Poortinga YH. Swets and Zeitlinger, Amsterdam; 1977:19–29.
54.
Lord FM: Applications of Item Response Theory to Practical Testing Problems. Lawrence Erlbaum Associates, Hillsdale, NJ; 1980.
55.
Langer MM: A reexamination of Lord’s Wald test for differential item functioning using item response theory and modern error estimation (Doctoral Dissertation). 2008.
56.
Bock RD, Aitkin M: Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika 1981, 46: 443–459. 10.1007/BF02293801CrossRef
57.
Health, United States, 2011: With Special Feature on Socioeconomic Status and Health. National Center for Health Statistics, Hyattsville, MD; 2012.
58.
Platt OS, Thorington BD, Brambilla DJ: Pain in sickle cell disease – rates and risk factors. N Engl J Med 1991, 325: 11–16. 10.1056/NEJM199107043250103CrossRefPubMed
59.
Ballas SK, Lusardi M: Hospital readmission for adult acute sickle cell painful episodes: frequency, etiology, and prognostic significance. Am J Hematol 2005, 79: 17–25. 10.1002/ajh.20336CrossRefPubMed
60.
Yusuf HR, Atrash HK, Grosse SK, Parker CS, Grant AM: Emergency department visits made by patients with sickle cell disease: A descriptive Study, 1999–2007. Am J Prev Med 2010, 38(4):S536-S541. 10.1016/j.amepre.2010.01.001PubMedCentralCrossRefPubMed
61.
Hays RD, Bjorner JB, Revicki DA, Sprintzer KL, Cella D: Development of physical and mental health summary scores from the patient-reported outcomes measurement information system (PROMIS) global items. Qual Life Res 2009, 18: 873–880. 10.1007/s11136-009-9496-9PubMedCentralCrossRefPubMed
62.
Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16(3):297–334. 10.1007/BF02310555CrossRef
63.
Tomarken AJ, Waller NG: Structural equation modeling: Strengths, limitations, and misconceptions. Annu Rev Clin Psychol 2005, 1: 31–65. 10.1146/annurev.clinpsy.1.102803.144239CrossRefPubMed
64.
Cook KF, Kallen MA, Amtmann D: Having a fit: impact of number of items and distribution of data on traditional criteria for assessing IRT’s unidimensionality assumption. Qual Life Res 2009, 18: 447–460. 10.1007/s11136-009-9464-4PubMedCentralCrossRefPubMed
65.
66.
Bayliss EA, Ellis JL, Steiner JF: Subjective assessments of comorbidity correlate with quality of life health outcomes: Initial validation of a comorbidity assessment instrument. Health Qual Life Outcomes 2005, 3: 51. 10.1186/1477-7525-3-51PubMedCentralCrossRefPubMed
67.
68.
Dampier C, LeBeau P, Rhee S, Lieff S, Kesler K, Ballas S, Rogers Z, Wang W: Health-related quality of life in adults with sickle cell disease (SCD): a report from the comprehensive sickle cell centers clinical trial consortium. Am J Hematol 2011, 86: 203–205. 10.1002/ajh.21905PubMedCentralCrossRefPubMed
69.
Levenson JL, McClish DK, Dahman BA, Bovbjerg VE, De ACitero V, Penberthy LT, Aisiku IP, Roberts JD, Roseff SD, Smith WR: Depression and anxiety in adults with sickle cell disease: the PiSCES project. Psychosom Med 2008, 70: 192–196. 10.1097/PSY.0b013e31815ff5c5CrossRefPubMed
70.
McClish DK, Levenson JL, Penberthy LT, Roseff SD, Bovbjerg VE, Roberts JD, Aisiku IP, Smith WR: Gender differences in pain and healthcare utilization for adult sickle cell patients: The PiSCES Project. J Womens Health (Larchmt) 2006, 15(2):146–154. 10.1089/jwh.2006.15.146CrossRef
71.
Reeve BB, Hays RD, Bjorner JB, Cook KF, Crane PK, Teresi JA, Thissen D, Revicki DA, Weiss DJ, Hambleton RK, Liu H, Gershon R, Reise SP, Lai JS, Cella D: Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Med Care 2007, 45(5,Suppl 1):S22-S31. 10.1097/01.mlr.0000250483.85507.04CrossRefPubMed
Metadata
Title
Patient reports of health outcome for adults living with sickle cell disease: development and testing of the ASCQ-Me item banks
Authors
San D Keller
Manshu Yang
Marsha J Treadwell
Ellen M Werner
Kathryn L Hassell
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2014
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-014-0125-0

Other articles of this Issue 1/2014

Health and Quality of Life Outcomes 1/2014 Go to the issue

Research

Internalizing the threat of risk-a qualitative study about adolescents’ experience living with screening-detected celiac disease 5 years after diagnosis

Research

Change in health status in long-term conditions over a one year period: a cohort survey using patient-reported outcome measures

Research

Evaluation of a skin self examination attitude scale using an item response theory model approach

Research

Health-related quality of life and socioeconomic status: inequalities among adults with a chronic disease

Research

Properties of patient-reported outcome measures in individuals following acute whiplash injury

Research

A comparison of injured patient and general population valuations of EQ-5D health states for New Zealand