Skip to main content
Top
Published in: BMC Anesthesiology 1/2012

Open Access 01-12-2012 | Research article

The functional comorbidity index had high inter-rater reliability in patients with acute lung injury

Authors: Eddy Fan, Jeneen M Gifford, Satish Chandolu, Elizabeth Colantuoni, Peter J Pronovost, Dale M Needham

Published in: BMC Anesthesiology | Issue 1/2012

Login to get access

Abstract

Background

The Functional Comorbidity Index (FCI) was recently developed to predict physical function in acute lung injury patients using comorbidity data. Our objectives were to determine: (1) the inter-rater reliability of the FCI collected using in-patient discharge summaries (primary objective); and (2) the accuracy and predictive validity of the FCI collected using hospital discharge summaries and admission records versus complete chart review (secondary objectives).

Methods

For reliability, we evaluated the FCI’s intraclass correlation coefficient (ICC) among trained research staff performing data collection for 421 acute lung injury patients enrolled in a prospective cohort study. For validity and accuracy, we compared the detection of FCI comorbidities across three types of inpatient medical records, and the association of the respective FCI scores obtained with patients’ SF-36 physical function subscale (PFS) scores at 1-year follow-up.

Results

Inter-rater reliability was near-perfect (ICC 0.91; 95% CI 0.89-0.94). Hospital admission records and discharge summaries (vs. complete chart review) significantly underestimated the total FCI score. However, using multivariable linear regression, FCI scores collected using each of the three types of inpatient medical records had similar associations with PFS, suggesting similar predictive value.

Conclusions

Data collection using in-patient discharge summaries represents a reliable and valid method for collecting FCI comorbidity information.
Appendix
Available only for authorised users
Literature
1.
go back to reference Herridge MS, Tansey CM, Matté A, Tomlinson G, Diaz-Granados N, Cooper A, et al: Functional disability 5 years after acute respiratory distress syndrome. N Engl J Med. 2011, 364: 1293-1304. 10.1056/NEJMoa1011802.CrossRefPubMed Herridge MS, Tansey CM, Matté A, Tomlinson G, Diaz-Granados N, Cooper A, et al: Functional disability 5 years after acute respiratory distress syndrome. N Engl J Med. 2011, 364: 1293-1304. 10.1056/NEJMoa1011802.CrossRefPubMed
2.
go back to reference Desai SV, Law TJ, Needham DM: Long-term complications of critical care. Crit Care Med. 2011, 39: 371-379. 10.1097/CCM.0b013e3181fd66e5.CrossRefPubMed Desai SV, Law TJ, Needham DM: Long-term complications of critical care. Crit Care Med. 2011, 39: 371-379. 10.1097/CCM.0b013e3181fd66e5.CrossRefPubMed
3.
go back to reference Cheung AM, Tansey CM, Tomlinson G, Diaz-Granados N, Matté A, Barr A, et al: Two-year outcomes, health care use, and costs of survivors of acute respiratory distress syndrome. Am J Respir Crit Care Med. 2006, 174: 538-544. 10.1164/rccm.200505-693OC.CrossRefPubMed Cheung AM, Tansey CM, Tomlinson G, Diaz-Granados N, Matté A, Barr A, et al: Two-year outcomes, health care use, and costs of survivors of acute respiratory distress syndrome. Am J Respir Crit Care Med. 2006, 174: 538-544. 10.1164/rccm.200505-693OC.CrossRefPubMed
4.
go back to reference Herridge MS, Cheung AM, Tansey CM, Matte-Martyn A, Diaz-Granados N, Al-Saidi F, et al: One-year outcomes in survivors of the acute respiratory distress syndrome. N Engl J Med. 2003, 348: 683-693. 10.1056/NEJMoa022450.CrossRefPubMed Herridge MS, Cheung AM, Tansey CM, Matte-Martyn A, Diaz-Granados N, Al-Saidi F, et al: One-year outcomes in survivors of the acute respiratory distress syndrome. N Engl J Med. 2003, 348: 683-693. 10.1056/NEJMoa022450.CrossRefPubMed
5.
go back to reference Fried LP, Ettinger WH, Lind B, Newman AB, Gardin J: Physical disability in older adults: a physiological approach. Cardiovascular Health Study Research Group. J Clin Epidemiol. 1999, 47: 747-760.CrossRef Fried LP, Ettinger WH, Lind B, Newman AB, Gardin J: Physical disability in older adults: a physiological approach. Cardiovascular Health Study Research Group. J Clin Epidemiol. 1999, 47: 747-760.CrossRef
6.
go back to reference Kishimoto M, Ojima T, Nakamura Y, Yanagawa H, Fujita Y, Kasagi F, et al: Relationship between the level of activities of daily living and chronic medical conditions among the elderly. J Epidemiol. 1998, 8: 272-277. 10.2188/jea.8.272.CrossRefPubMed Kishimoto M, Ojima T, Nakamura Y, Yanagawa H, Fujita Y, Kasagi F, et al: Relationship between the level of activities of daily living and chronic medical conditions among the elderly. J Epidemiol. 1998, 8: 272-277. 10.2188/jea.8.272.CrossRefPubMed
7.
go back to reference Kaplan MH, Feinstein AR: The importance of classifying initial co-morbidity in evaluatin the outcome of diabetes mellitus. J Chron Dis. 1974, 27: 387-404. 10.1016/0021-9681(74)90017-4.CrossRefPubMed Kaplan MH, Feinstein AR: The importance of classifying initial co-morbidity in evaluatin the outcome of diabetes mellitus. J Chron Dis. 1974, 27: 387-404. 10.1016/0021-9681(74)90017-4.CrossRefPubMed
8.
go back to reference Lash TL, Mor V, Wieland D, Ferrucci L, Satariano W, Silliman RA: Methodology, design, and analytic techniques to address measurement of comorbid disease. J Gerontol A Biol Sci Med Sci. 2007, 62: 281-285. 10.1093/gerona/62.3.281.CrossRefPubMedPubMedCentral Lash TL, Mor V, Wieland D, Ferrucci L, Satariano W, Silliman RA: Methodology, design, and analytic techniques to address measurement of comorbid disease. J Gerontol A Biol Sci Med Sci. 2007, 62: 281-285. 10.1093/gerona/62.3.281.CrossRefPubMedPubMedCentral
9.
go back to reference Groll DL, To T, Bombardier C, Wright JG: The development of a comorbidity index with physical function as the outcome. J Clin Epidemiol. 2005, 58: 595-602. 10.1016/j.jclinepi.2004.10.018.CrossRefPubMed Groll DL, To T, Bombardier C, Wright JG: The development of a comorbidity index with physical function as the outcome. J Clin Epidemiol. 2005, 58: 595-602. 10.1016/j.jclinepi.2004.10.018.CrossRefPubMed
10.
go back to reference Groll DL, Heyland DK, Caeser M, Wright JG: Assessment of long-term physical function in acute respiratory distress syndrome (ARDS) patients: comparison of the Charlson Comorbidity Index and the Functional Comorbidity Index. Am J Phys Med Rehabil. 2006, 85: 574-581. 10.1097/01.phm.0000223220.91914.61.CrossRefPubMed Groll DL, Heyland DK, Caeser M, Wright JG: Assessment of long-term physical function in acute respiratory distress syndrome (ARDS) patients: comparison of the Charlson Comorbidity Index and the Functional Comorbidity Index. Am J Phys Med Rehabil. 2006, 85: 574-581. 10.1097/01.phm.0000223220.91914.61.CrossRefPubMed
11.
go back to reference Needham DM, Dennison CR, Dowdy DW, Mendez-Tellez PA, Ciesla N, Desai SV, et al: Study protocol: The Improving Care of Acute Lung Injury Patients (ICAP) study. Crit Care. 2006, 10: R9-10.1186/cc3948.CrossRefPubMed Needham DM, Dennison CR, Dowdy DW, Mendez-Tellez PA, Ciesla N, Desai SV, et al: Study protocol: The Improving Care of Acute Lung Injury Patients (ICAP) study. Crit Care. 2006, 10: R9-10.1186/cc3948.CrossRefPubMed
12.
go back to reference Ware JE, Sherbourne CD: The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992, 30: 473-483. 10.1097/00005650-199206000-00002.CrossRefPubMed Ware JE, Sherbourne CD: The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992, 30: 473-483. 10.1097/00005650-199206000-00002.CrossRefPubMed
13.
go back to reference Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chron Dis. 1987, 40: 373-383. 10.1016/0021-9681(87)90171-8.CrossRefPubMed Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chron Dis. 1987, 40: 373-383. 10.1016/0021-9681(87)90171-8.CrossRefPubMed
14.
go back to reference Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med. 1985, 13: 818-829. 10.1097/00003246-198510000-00009.CrossRefPubMed Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med. 1985, 13: 818-829. 10.1097/00003246-198510000-00009.CrossRefPubMed
15.
go back to reference Walter SD, Eliasziw M, Donner A: Sample size and optimal designs for reliability studies. Stat Med. 1998, 17: 101-110. 10.1002/(SICI)1097-0258(19980115)17:1<101::AID-SIM727>3.0.CO;2-E.CrossRefPubMed Walter SD, Eliasziw M, Donner A: Sample size and optimal designs for reliability studies. Stat Med. 1998, 17: 101-110. 10.1002/(SICI)1097-0258(19980115)17:1<101::AID-SIM727>3.0.CO;2-E.CrossRefPubMed
16.
go back to reference Hopkins RO, Weaver LK, Pope D, Orme JF, Bigler ED, Larson-Lohr V: Neuropsychological sequelae and impaired health status in survivors of severe acute respiratory distress syndrome. Am J Respir Crit Care Med. 1999, 160: 50-56.CrossRefPubMed Hopkins RO, Weaver LK, Pope D, Orme JF, Bigler ED, Larson-Lohr V: Neuropsychological sequelae and impaired health status in survivors of severe acute respiratory distress syndrome. Am J Respir Crit Care Med. 1999, 160: 50-56.CrossRefPubMed
17.
go back to reference Wyrwich KW, Tierney WM, Babu AN, Kroenke K, Wolinsky FD: A comparison of clinically important differences in health-related quality of life for patients with chronic lung disease, asthma, or heart disease. Health Serv Res. 2005, 40: 577-591. 10.1111/j.1475-6773.2005.0l374.x.CrossRefPubMedPubMedCentral Wyrwich KW, Tierney WM, Babu AN, Kroenke K, Wolinsky FD: A comparison of clinically important differences in health-related quality of life for patients with chronic lung disease, asthma, or heart disease. Health Serv Res. 2005, 40: 577-591. 10.1111/j.1475-6773.2005.0l374.x.CrossRefPubMedPubMedCentral
18.
go back to reference Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979, 86: 420-428.CrossRefPubMed Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979, 86: 420-428.CrossRefPubMed
19.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed
20.
go back to reference Cumming G: Inference by eye: Reading the overlap of independent confidence intervals. Stat Med. 2009, 28: 205-220. 10.1002/sim.3471.CrossRefPubMed Cumming G: Inference by eye: Reading the overlap of independent confidence intervals. Stat Med. 2009, 28: 205-220. 10.1002/sim.3471.CrossRefPubMed
Metadata
Title
The functional comorbidity index had high inter-rater reliability in patients with acute lung injury
Authors
Eddy Fan
Jeneen M Gifford
Satish Chandolu
Elizabeth Colantuoni
Peter J Pronovost
Dale M Needham
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Anesthesiology / Issue 1/2012
Electronic ISSN: 1471-2253
DOI
https://doi.org/10.1186/1471-2253-12-21

Other articles of this Issue 1/2012

BMC Anesthesiology 1/2012 Go to the issue