Skip to main content
Top
Published in: BMC Health Services Research 1/2012

Open Access 01-12-2012 | Research article

Psychometric properties of the patient assessment of chronic illness care measure: acceptability, reliability and validity in United Kingdom patients with long-term conditions

Authors: Jo Rick, Kelly Rowe, Mark Hann, Bonnie Sibbald, David Reeves, Martin Roland, Peter Bower

Published in: BMC Health Services Research | Issue 1/2012

Login to get access

Abstract

Background

The Patient Assessment of Chronic Illness Care (PACIC) is a US measure of chronic illness quality of care, based on the influential Chronic Care Model (CCM). It measures a number of aspects of care, including patient activation; delivery system design and decision support; goal setting and tailoring; problem-solving and contextual counselling; follow-up and coordination. Although there is developing evidence of the utility of the scale, there is little evidence about its performance in the United Kingdom (UK). We present preliminary data on the psychometric performance of the PACIC in a large sample of UK patients with long-term conditions.

Method

We collected PACIC, demographic, clinical and quality of care data from patients with long-term conditions across 38 general practices, as part of a wider longitudinal study. We assess rates of missing data, present descriptive and distributional data, assess internal consistency, and test validity through confirmatory factor analysis, and through associations between PACIC scores, patient characteristics and related measures.

Results

There was evidence that rates of missing data were high on PACIC (9.6% - 15.9%), and higher than on other scales used in the same survey. Most PACIC sub-scales showed reasonable levels of internal consistency (alpha = 0.68 – 0.94), responses did not demonstrate high skewness levels, and floor effects were more frequent (up to 30.4% on the follow up and co-ordination subscale) than ceiling effects (generally <5%). PACIC demonstrated preliminary evidence of validity in terms of measures of long-term condition care. Confirmatory factor analysis suggested that the five factor PACIC structure proposed by the scale developers did not fit the data: reporting separate factor scores may not always be appropriate.

Conclusion

The importance of improving care for long-term conditions means that the development and validation of measures is a priority. The PACIC scale has demonstrated potential utility in this regard, but further assessment is required to assess low levels of completion of the scale, and to explore the performance of the scale in predicting outcomes and assessing the effects of interventions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Wagner E: Chronic disease management: What will it take to improve care for chronic illness?. Effective Clinical Practice. 1998, 1: 2-4.PubMed Wagner E: Chronic disease management: What will it take to improve care for chronic illness?. Effective Clinical Practice. 1998, 1: 2-4.PubMed
2.
go back to reference Department of Health: Supporting people with long term conditions: An NHS and social care model to support local innovation and integration. 2005, London Department of Health: Supporting people with long term conditions: An NHS and social care model to support local innovation and integration. 2005, London
4.
go back to reference Murray E, Burns J, See Tai S, Lai R, Nazareth I: Interactive Health Communication Applications for people with chronic disease. Cochrane Database of Systematic Reviews. 2005, 10.1002/14651858. Issue 4. Art. No. CD004274 Murray E, Burns J, See Tai S, Lai R, Nazareth I: Interactive Health Communication Applications for people with chronic disease. Cochrane Database of Systematic Reviews. 2005, 10.1002/14651858. Issue 4. Art. No. CD004274
5.
go back to reference Campbell S, Reeves D, Kontopantelis E, Sibbald B, Roland M: Effects of pay for performance on the quality of primary care in England. N Engl J Med. 2009, 361: 368-378. 10.1056/NEJMsa0807651.CrossRefPubMed Campbell S, Reeves D, Kontopantelis E, Sibbald B, Roland M: Effects of pay for performance on the quality of primary care in England. N Engl J Med. 2009, 361: 368-378. 10.1056/NEJMsa0807651.CrossRefPubMed
6.
go back to reference Campbell S, Roland M, Buetow S: Defining quality of care. Soc Sci Med. 2000, 51: 1611-1625. 10.1016/S0277-9536(00)00057-5.CrossRefPubMed Campbell S, Roland M, Buetow S: Defining quality of care. Soc Sci Med. 2000, 51: 1611-1625. 10.1016/S0277-9536(00)00057-5.CrossRefPubMed
7.
go back to reference Glasgow R, Wagner E, Schaefer J, Mahoney L, Reid R, Greene S: Development and validation of the Patient Assessment of Chronic Illness Care. Med Care. 2005, 43: 436-444. 10.1097/01.mlr.0000160375.47920.8c.CrossRefPubMed Glasgow R, Wagner E, Schaefer J, Mahoney L, Reid R, Greene S: Development and validation of the Patient Assessment of Chronic Illness Care. Med Care. 2005, 43: 436-444. 10.1097/01.mlr.0000160375.47920.8c.CrossRefPubMed
8.
go back to reference Gensichen J, Serras A, Paulitsch M, Rosemann T, König J, Gerlach F, Petersen J: The Patient Assessment of Chronic Illness Care questionnaire: evaluation in patients with mental disorders in primary care. Community Ment Health J. 2011, 47: 453.CrossRef Gensichen J, Serras A, Paulitsch M, Rosemann T, König J, Gerlach F, Petersen J: The Patient Assessment of Chronic Illness Care questionnaire: evaluation in patients with mental disorders in primary care. Community Ment Health J. 2011, 47: 453.CrossRef
9.
go back to reference Gugiu C, Coryn C, Applegate B: Structure and measurement properties of the Patient Assessment of Chronic Illness Care instrument. J Eval Clin Pract. 2010, 16: 509-516.PubMed Gugiu C, Coryn C, Applegate B: Structure and measurement properties of the Patient Assessment of Chronic Illness Care instrument. J Eval Clin Pract. 2010, 16: 509-516.PubMed
10.
go back to reference Schmittdiel J, Mosen D, Glasgow R, Hibbard J, Remmers C, Bellows J: Patient assessment of chronic illness care (PACIC) and improved patient-centered outcomes for chronic conditions. J Gen Intern Med. 2011, 23: 77-80.CrossRef Schmittdiel J, Mosen D, Glasgow R, Hibbard J, Remmers C, Bellows J: Patient assessment of chronic illness care (PACIC) and improved patient-centered outcomes for chronic conditions. J Gen Intern Med. 2011, 23: 77-80.CrossRef
11.
go back to reference Maindal H, Sokolowski I, Vedsted P: Adaptation, data quality and confirmatory factor analysis of the Danish version of the PACIC questionnaire. Eur J Public Health. 2010 Maindal H, Sokolowski I, Vedsted P: Adaptation, data quality and confirmatory factor analysis of the Danish version of the PACIC questionnaire. Eur J Public Health. 2010
12.
go back to reference Glasgow R, Whitesides H, Nelson C, King D: Use of the Patient Assessment of Chronic Illness Care (PACIC) with diabetic patients. Diabet Care. 2005, 28: 2655-2661. 10.2337/diacare.28.11.2655.CrossRef Glasgow R, Whitesides H, Nelson C, King D: Use of the Patient Assessment of Chronic Illness Care (PACIC) with diabetic patients. Diabet Care. 2005, 28: 2655-2661. 10.2337/diacare.28.11.2655.CrossRef
13.
go back to reference Gugiu P, Coryn C, Clark R, Kuehn A: Development and evaluation of the short version of the Patient Assessment of Chronic Illness Care instrument. Chronic Illness. 2009, 5: 268-276. 10.1177/1742395309348072.CrossRefPubMed Gugiu P, Coryn C, Clark R, Kuehn A: Development and evaluation of the short version of the Patient Assessment of Chronic Illness Care instrument. Chronic Illness. 2009, 5: 268-276. 10.1177/1742395309348072.CrossRefPubMed
14.
go back to reference Taggart J, Chan B, Jayasinghe U, Christl B, Proudfoot J, Crookes P, Beilby J, Black D, Harris M: Patients Assessment of Chronic Illness Care (PACIC) in two Australian studies: structure and utility. J Eval Clin Pract. 2011, 17: 215-221. 10.1111/j.1365-2753.2010.01423.x.CrossRefPubMed Taggart J, Chan B, Jayasinghe U, Christl B, Proudfoot J, Crookes P, Beilby J, Black D, Harris M: Patients Assessment of Chronic Illness Care (PACIC) in two Australian studies: structure and utility. J Eval Clin Pract. 2011, 17: 215-221. 10.1111/j.1365-2753.2010.01423.x.CrossRefPubMed
15.
go back to reference Aragones A, Schaefer E, Stevens D, Gourevitch M, Glasgow R, Shah N: Validation of the Spanish translation of the Patient Assessment of Chronic Illness Care (PACIC) survey. Preventing Chronic Disease. 2008, 5: 1-10. Aragones A, Schaefer E, Stevens D, Gourevitch M, Glasgow R, Shah N: Validation of the Spanish translation of the Patient Assessment of Chronic Illness Care (PACIC) survey. Preventing Chronic Disease. 2008, 5: 1-10.
16.
go back to reference Carryer J, Budge C, Hansen C, Gibbs K: Providing and receiving self-management support for chronic illness: Patients' and health practitioners' assessments. Journal of Primary Health Care. 2010, 2: 124-129.PubMed Carryer J, Budge C, Hansen C, Gibbs K: Providing and receiving self-management support for chronic illness: Patients' and health practitioners' assessments. Journal of Primary Health Care. 2010, 2: 124-129.PubMed
17.
go back to reference Goetz K, Freund T, Gensichen J, Miksch A, Szecsenyi J, Steinhauser J: Adaptation and psychometric properties of the PACIC Short Form. Am J Manag Care. 2012, 18: e55-e60.PubMed Goetz K, Freund T, Gensichen J, Miksch A, Szecsenyi J, Steinhauser J: Adaptation and psychometric properties of the PACIC Short Form. Am J Manag Care. 2012, 18: e55-e60.PubMed
18.
go back to reference Jackson G, Weinberger M, Hamilton N, Edelman D: Racial/ethnic and educational-level differences in diabetes care experiences in primary care. Primary Care Diabetes. 2008, 2: 39-44. 10.1016/j.pcd.2007.11.002.CrossRefPubMed Jackson G, Weinberger M, Hamilton N, Edelman D: Racial/ethnic and educational-level differences in diabetes care experiences in primary care. Primary Care Diabetes. 2008, 2: 39-44. 10.1016/j.pcd.2007.11.002.CrossRefPubMed
19.
go back to reference Rosemann T, Laux G, Szecsenyi J, Grol R: The Chronic Care Model: congruency and predictors among primary care patients with osteoarthritis. Qual Saf Health Care. 2008, 17: 442-446. 10.1136/qshc.2007.022822.CrossRefPubMed Rosemann T, Laux G, Szecsenyi J, Grol R: The Chronic Care Model: congruency and predictors among primary care patients with osteoarthritis. Qual Saf Health Care. 2008, 17: 442-446. 10.1136/qshc.2007.022822.CrossRefPubMed
20.
go back to reference Rosemann T, Laux G, Droesemeyer S, Gensichen J, Szecsenyi J: Evaluation of a culturally adapted German version of the Patient Assessment of Chronic Illness Care (PACIC 5A) questionnaire in a sample of osteoarthritis patients. J Eval Clin Pract. 2007, 13: 806-813. 10.1111/j.1365-2753.2007.00786.x.CrossRefPubMed Rosemann T, Laux G, Droesemeyer S, Gensichen J, Szecsenyi J: Evaluation of a culturally adapted German version of the Patient Assessment of Chronic Illness Care (PACIC 5A) questionnaire in a sample of osteoarthritis patients. J Eval Clin Pract. 2007, 13: 806-813. 10.1111/j.1365-2753.2007.00786.x.CrossRefPubMed
21.
go back to reference Szecsenyi J, Rosemann T, Joos S, Peters-Klimm F, Miksch A: German diabetes disease management programs are appropriate for restructuring care according to the chronic care model. Diabet Care. 2011, 31: 1150-1154.CrossRef Szecsenyi J, Rosemann T, Joos S, Peters-Klimm F, Miksch A: German diabetes disease management programs are appropriate for restructuring care according to the chronic care model. Diabet Care. 2011, 31: 1150-1154.CrossRef
22.
go back to reference Wensing M, van Lieshout J, Jung H, Hermsen J, Rosemann T: The Patient Assessment Chronic Illness Care (PACIC) questionnaire in The Netherlands: a validation study in rural general practice. BMC Health Services Research. 2008, 8: 182-10.1186/1472-6963-8-182.CrossRefPubMedPubMedCentral Wensing M, van Lieshout J, Jung H, Hermsen J, Rosemann T: The Patient Assessment Chronic Illness Care (PACIC) questionnaire in The Netherlands: a validation study in rural general practice. BMC Health Services Research. 2008, 8: 182-10.1186/1472-6963-8-182.CrossRefPubMedPubMedCentral
23.
go back to reference McIntosh C: Examining the factorial validity of selected modules from the Canadian Survey of Experiences with Primary Health Care (). http://www.statcan.ca Ottowa; 2011 McIntosh C: Examining the factorial validity of selected modules from the Canadian Survey of Experiences with Primary Health Care (). http://​www.​statcan.​ca Ottowa; 2011
24.
go back to reference Burt J, Roland M, Paddison C, Reeves D, Campbell J, Abel G, Bower P: Use and benefits of care plans and care planning for people with long-term conditions in England. J Health Serv Res Policy. 2012, 17: 64-71. 10.1258/jhsrp.2011.010172.CrossRefPubMed Burt J, Roland M, Paddison C, Reeves D, Campbell J, Abel G, Bower P: Use and benefits of care plans and care planning for people with long-term conditions in England. J Health Serv Res Policy. 2012, 17: 64-71. 10.1258/jhsrp.2011.010172.CrossRefPubMed
25.
go back to reference Campbell J, Smith P, Nissen S, Bower P, Elliott M, Roland M: The GP Patient Survey for use in primary care in the National Health Service in the UK - development and psychometric characteristics. BMC Family Practice. 2009, 10. Campbell J, Smith P, Nissen S, Bower P, Elliott M, Roland M: The GP Patient Survey for use in primary care in the National Health Service in the UK - development and psychometric characteristics. BMC Family Practice. 2009, 10.
26.
go back to reference Williams G, McGregor H, Zeldman A, Freedman Z, Deci E: Testing a self-determination theory process model for promoting glycemic control through diabetes self-management. Health Psychol. 2004, 23: 58-66.CrossRefPubMed Williams G, McGregor H, Zeldman A, Freedman Z, Deci E: Testing a self-determination theory process model for promoting glycemic control through diabetes self-management. Health Psychol. 2004, 23: 58-66.CrossRefPubMed
27.
go back to reference Williams G, McGregor H, Kind D, Nelson C, Glasgow R: Variation in perceived competence, glycemic control, and patient satisfaction: relationship to autonomy support from physicians. Pat Educ Couns. 2005, 57: 39-45. 10.1016/j.pec.2004.04.001.CrossRef Williams G, McGregor H, Kind D, Nelson C, Glasgow R: Variation in perceived competence, glycemic control, and patient satisfaction: relationship to autonomy support from physicians. Pat Educ Couns. 2005, 57: 39-45. 10.1016/j.pec.2004.04.001.CrossRef
28.
go back to reference Roland M, Elliott M, Lyratzopoulos G, Barbiere J, Parker R, Smith P, Bower P, Campbell J: Reliability of patient responses in pay for performance schemes: analysis of national General Practitioner Patient Survey data in England. BMJ. 2009, 339: b3851-10.1136/bmj.b3851.CrossRefPubMedPubMedCentral Roland M, Elliott M, Lyratzopoulos G, Barbiere J, Parker R, Smith P, Bower P, Campbell J: Reliability of patient responses in pay for performance schemes: analysis of national General Practitioner Patient Survey data in England. BMJ. 2009, 339: b3851-10.1136/bmj.b3851.CrossRefPubMedPubMedCentral
29.
go back to reference Fitzpatrick R, Davey C, Buxton M, Jones D: Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998, 2 (14). Fitzpatrick R, Davey C, Buxton M, Jones D: Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998, 2 (14).
30.
go back to reference Spicer J, Budge C, Carryer J: Taking the PACIC back to basics: the structure of the Patient Assessment of Chronic Illness Care. J Eval Clin Pract. 2010, 6. Spicer J, Budge C, Carryer J: Taking the PACIC back to basics: the structure of the Patient Assessment of Chronic Illness Care. J Eval Clin Pract. 2010, 6.
31.
go back to reference Maisey S, Steel N, Marsh R, Gillam S, Fleetcroft R, Howe A: Effects of payment for performance in primary care: qualitative interview study. J Health Serv Res Policy. 2008, 13: 133-139. 10.1258/jhsrp.2008.007118.CrossRefPubMed Maisey S, Steel N, Marsh R, Gillam S, Fleetcroft R, Howe A: Effects of payment for performance in primary care: qualitative interview study. J Health Serv Res Policy. 2008, 13: 133-139. 10.1258/jhsrp.2008.007118.CrossRefPubMed
32.
go back to reference Schoen C, Osborn R, Squires D, Doty M, Pierson R, Applebaum S: New 2011 survey of patients with complex care needs in eleven countries finds that care is often poorly coordinated. Health Aff. 2012, 30: 2437-2448.CrossRef Schoen C, Osborn R, Squires D, Doty M, Pierson R, Applebaum S: New 2011 survey of patients with complex care needs in eleven countries finds that care is often poorly coordinated. Health Aff. 2012, 30: 2437-2448.CrossRef
33.
go back to reference Checkland K, Harrison S, McDonald R, Grant S, Campbell S, Guthrie B: Biomedicine, holism and general medical practice: responses to the 2004 General Practitioner contract. Sociology of Health and Illness. 2008, 30: 788-803. 10.1111/j.1467-9566.2008.01081.x.CrossRefPubMed Checkland K, Harrison S, McDonald R, Grant S, Campbell S, Guthrie B: Biomedicine, holism and general medical practice: responses to the 2004 General Practitioner contract. Sociology of Health and Illness. 2008, 30: 788-803. 10.1111/j.1467-9566.2008.01081.x.CrossRefPubMed
34.
go back to reference Blakeman T, MacDonald W, Bower P, Gately C, Chew-Graham C: A qualitative study of GPs' attitudes to self-management of chronic disease. Br J Gen Pract. 2006, 56: 407-414.PubMedPubMedCentral Blakeman T, MacDonald W, Bower P, Gately C, Chew-Graham C: A qualitative study of GPs' attitudes to self-management of chronic disease. Br J Gen Pract. 2006, 56: 407-414.PubMedPubMedCentral
35.
go back to reference MacDonald W, Rogers A, Blakeman T, Bower P: Practice nurses and the facilitation of self-management in primary care. J Adv Nurs. 2008, 62: 191-199. 10.1111/j.1365-2648.2007.04585.x.CrossRefPubMed MacDonald W, Rogers A, Blakeman T, Bower P: Practice nurses and the facilitation of self-management in primary care. J Adv Nurs. 2008, 62: 191-199. 10.1111/j.1365-2648.2007.04585.x.CrossRefPubMed
36.
go back to reference Flora D, Curran P: An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods. 2004, 9: 466-491.CrossRefPubMedPubMedCentral Flora D, Curran P: An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods. 2004, 9: 466-491.CrossRefPubMedPubMedCentral
37.
go back to reference Bollen K, Lennox R: Conventional wisdom on measurement: a structural equation perspective. Psychol Bull. 1991, 110: 305-314.CrossRef Bollen K, Lennox R: Conventional wisdom on measurement: a structural equation perspective. Psychol Bull. 1991, 110: 305-314.CrossRef
38.
go back to reference Kahn K, Tisnado D, Adams J, Liu H, Chen W, Hu F, Mangione C, Hays R, Danberg C: Does ambulatory process of care predict health-related quality of life outcomes for patients with chronic disease?. Health Serv Res. 2007, 42: 63-83. 10.1111/j.1475-6773.2006.00604.x.CrossRefPubMedPubMedCentral Kahn K, Tisnado D, Adams J, Liu H, Chen W, Hu F, Mangione C, Hays R, Danberg C: Does ambulatory process of care predict health-related quality of life outcomes for patients with chronic disease?. Health Serv Res. 2007, 42: 63-83. 10.1111/j.1475-6773.2006.00604.x.CrossRefPubMedPubMedCentral
Metadata
Title
Psychometric properties of the patient assessment of chronic illness care measure: acceptability, reliability and validity in United Kingdom patients with long-term conditions
Authors
Jo Rick
Kelly Rowe
Mark Hann
Bonnie Sibbald
David Reeves
Martin Roland
Peter Bower
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2012
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-12-293

Other articles of this Issue 1/2012

BMC Health Services Research 1/2012 Go to the issue