Skip to main content
Top
Published in: BMC Health Services Research 1/2015

Open Access 01-12-2015 | Research article

Development and validation of the Medical Home Care Coordination Survey for assessing care coordination in the primary care setting from the patient and provider perspectives

Authors: Ianita Zlateva, Daren Anderson, Emil Coman, Khushbu Khatri, Terrence Tian, Judith Fifield

Published in: BMC Health Services Research | Issue 1/2015

Login to get access

Abstract

Background

Community health centers are increasingly embracing the Patient Centered Medical Home (PCMH) model to improve quality, access to care, and patient experience while reducing healthcare costs. Care coordination (CC) is an important element of the PCMH model, but implementation and measurability of CC remains a problem within the outpatient setting. Assessing CC is an integral component of quality monitoring in health care systems. This study developed and validated the Medical Home Care Coordination Survey (MHCCS), to fill the gap in assessing CC in primary care from the perspectives of patients and their primary healthcare teams.

Methods

We conducted a review of relevant literature and existing care coordination instruments identified by bibliographic search and contact with experts. After identifying all care coordination domains that could be assessed by primary healthcare team members and patients, we developed a conceptual model. Potentially appropriate items from existing published CC measures, along with newly developed items, were matched to each domain for inclusion. A modified Delphi approach was used to establish content validity. Primary survey data was collected from 232 patients with care transition and/or complex chronic illness needs from the Community Health Center, Inc. and from 164 staff members from 12 community health centers across the country via mail, phone and online survey. The MHCCS was validated for internal consistency, reliability, discriminant and convergent validity. This study was conducted at the Community Health Center, Inc. from January 15, 2012 to July 15, 2014.

Results

The 13-item MHCCS - Patient and the 32-item MHCCS - Healthcare Team were developed and validated. Exploratory Structural Equation Modeling was used to test the hypothesized domain structure. Four CC domains were confirmed from the patient group and eight were confirmed from the primary healthcare team group. All domains had high reliability (Cronbach’s α scores were above 0.8).

Conclusions

Patients experience the ultimate output of care coordination services, but primary healthcare staff members are best primed to perceive many of the structural elements of care coordination. The proactive measurement and monitoring of the core domains from both perspectives provides a richer body of information for the continuous improvement of care coordination services. The MHCCS shows promise as a valid and reliable assessment of these CC efforts.
Appendix
Available only for authorised users
Literature
1.
go back to reference Jackson GL, Powers BJ, Chatterjee R, Bettger JP, Kemper AR, Hasselblad V, et al. The patient-centered medical home: a systematic review. Ann Intern Med. 2013;158(3):169–78.CrossRefPubMed Jackson GL, Powers BJ, Chatterjee R, Bettger JP, Kemper AR, Hasselblad V, et al. The patient-centered medical home: a systematic review. Ann Intern Med. 2013;158(3):169–78.CrossRefPubMed
2.
go back to reference Gilfillan RJ, Tomcavage J, Rosenthal MB, Davis DE, Graham J, Roy JA. Value and the medical home: effects of transformed primary care. Am J Manag Care. 2010;16:607–14.PubMed Gilfillan RJ, Tomcavage J, Rosenthal MB, Davis DE, Graham J, Roy JA. Value and the medical home: effects of transformed primary care. Am J Manag Care. 2010;16:607–14.PubMed
3.
go back to reference Steele GD, Haynes JA, Davis DE, Tomcavage J, Stewart WF, Graf TR, et al. How Geisinger's advanced medical home model argues the case for rapid-cycle innovation. Health Aff (Millwood). 2010;29(11):2047–53.CrossRef Steele GD, Haynes JA, Davis DE, Tomcavage J, Stewart WF, Graf TR, et al. How Geisinger's advanced medical home model argues the case for rapid-cycle innovation. Health Aff (Millwood). 2010;29(11):2047–53.CrossRef
4.
go back to reference Starfield B, Shi L. The medical home, access to care, and insurance: a review of evidence. Pediatrics. 2004;113(Supplement 4):1493–8.PubMed Starfield B, Shi L. The medical home, access to care, and insurance: a review of evidence. Pediatrics. 2004;113(Supplement 4):1493–8.PubMed
5.
go back to reference Jaen DR, Ferrer RL, Miller WL, Palmer RF, Wood R, Davila M. Patient outcomes at 26 months in the patient-centered medical home national demonstration project. Ann Fam Med. 2010;8(S1):S57–67.CrossRefPubMedPubMedCentral Jaen DR, Ferrer RL, Miller WL, Palmer RF, Wood R, Davila M. Patient outcomes at 26 months in the patient-centered medical home national demonstration project. Ann Fam Med. 2010;8(S1):S57–67.CrossRefPubMedPubMedCentral
6.
go back to reference Reid RJ, Fishman PA, Yu O, Ross TR, Tufano JT, Soman MP. Patient-centered medical home demonstration: a prospective, quasi-experimental, before and after evaluation. Am J Manag Care. 2009;15(9):e71–87.PubMed Reid RJ, Fishman PA, Yu O, Ross TR, Tufano JT, Soman MP. Patient-centered medical home demonstration: a prospective, quasi-experimental, before and after evaluation. Am J Manag Care. 2009;15(9):e71–87.PubMed
7.
go back to reference Domino ME, Humble C, Lawrence Jr WW, Wegner S. Enhancing the medical homes model for children with asthma. Med Care. 2009;47(11):1113–20.CrossRefPubMed Domino ME, Humble C, Lawrence Jr WW, Wegner S. Enhancing the medical homes model for children with asthma. Med Care. 2009;47(11):1113–20.CrossRefPubMed
8.
go back to reference Maeng DD, Graham J, Graf TR, Liberman JN, Dermes NB, Tomcavage J, et al. Reducing long-term cost by transforming primary care: evidence from Geisinger’s medical home model. Am J Manag Care. 2012;18(3):149–55.PubMed Maeng DD, Graham J, Graf TR, Liberman JN, Dermes NB, Tomcavage J, et al. Reducing long-term cost by transforming primary care: evidence from Geisinger’s medical home model. Am J Manag Care. 2012;18(3):149–55.PubMed
9.
go back to reference Reid RJ, Coleman K, Johnson EA, Fishman PA, Hsu C, Soman MP, et al. The group health medical home at year two: cost savings, higher patient satisfaction, and less burnout for providers. Health Aff. 2010;29(5):835–43.CrossRef Reid RJ, Coleman K, Johnson EA, Fishman PA, Hsu C, Soman MP, et al. The group health medical home at year two: cost savings, higher patient satisfaction, and less burnout for providers. Health Aff. 2010;29(5):835–43.CrossRef
10.
go back to reference Pham HH, O’Malley AS, Bach PB, Salontz-Martinez C, Schrag D. Primary care physicians’ links to other physicians through medicare patients: the scope of care coordination. Ann Intern Med. 2009;150(4):236–42.CrossRefPubMedPubMedCentral Pham HH, O’Malley AS, Bach PB, Salontz-Martinez C, Schrag D. Primary care physicians’ links to other physicians through medicare patients: the scope of care coordination. Ann Intern Med. 2009;150(4):236–42.CrossRefPubMedPubMedCentral
11.
go back to reference O’Malley AS, Reschovsky JD. Referral and consultation communication between primary care and specialist physicians: finding common ground. Arch Intern Med. 2011;171(1):56–65.PubMed O’Malley AS, Reschovsky JD. Referral and consultation communication between primary care and specialist physicians: finding common ground. Arch Intern Med. 2011;171(1):56–65.PubMed
12.
go back to reference Rittenhouse DR, Casalino LP, Shortell SM, McClellan SR, Gillies RR, Alexander JA, et al. Small and medium-size physician practices use few patient-centered medical home processes. Health Aff (Millwood). 2011;30(8):1–10.CrossRef Rittenhouse DR, Casalino LP, Shortell SM, McClellan SR, Gillies RR, Alexander JA, et al. Small and medium-size physician practices use few patient-centered medical home processes. Health Aff (Millwood). 2011;30(8):1–10.CrossRef
13.
go back to reference Rittenhouse DR, Shortell SM, Gillies RR, Casalino LP, Robinson JC, McCurdy RK. Improving chronic illness care: findings from a National Study of Care Management Processes in Large Physician Practices. Med Care Res Rev. 2010;67(3):301–20.CrossRefPubMed Rittenhouse DR, Shortell SM, Gillies RR, Casalino LP, Robinson JC, McCurdy RK. Improving chronic illness care: findings from a National Study of Care Management Processes in Large Physician Practices. Med Care Res Rev. 2010;67(3):301–20.CrossRefPubMed
14.
go back to reference Institute of Medicine. Unequal treatment: confronting racial and ethnic disparities in health care. Washington: The National Academies Press; 2003. Institute of Medicine. Unequal treatment: confronting racial and ethnic disparities in health care. Washington: The National Academies Press; 2003.
15.
go back to reference Van Houdt S, Heyrman J, Vanhaecht K, Sermeus W, De Lepeleire J. An in-depth analysis of theoretical frameworks for the study of care coordination. International Journal of Integrated Care. 2013;13:e024 Van Houdt S, Heyrman J, Vanhaecht K, Sermeus W, De Lepeleire J. An in-depth analysis of theoretical frameworks for the study of care coordination. International Journal of Integrated Care. 2013;13:e024
17.
go back to reference Schultz EM, Pineda N, Lonhart J, Davies SM, McDonald KM. A systematic review of the care coordination measurement landscape. BMC Health Serv Res. 2013;13(1):119.CrossRefPubMedPubMedCentral Schultz EM, Pineda N, Lonhart J, Davies SM, McDonald KM. A systematic review of the care coordination measurement landscape. BMC Health Serv Res. 2013;13(1):119.CrossRefPubMedPubMedCentral
18.
go back to reference McDonald KM. Care coordination measures atlas update. 2014. McDonald KM. Care coordination measures atlas update. 2014.
19.
go back to reference National Quality Forum. Preferred practices and performance measures for measuring and reporting care coordination: a consensus report. Washington, DC: National Quality Forum; 2010. National Quality Forum. Preferred practices and performance measures for measuring and reporting care coordination: a consensus report. Washington, DC: National Quality Forum; 2010.
20.
go back to reference Donabedian A. The Criteria and Standards of Quality. Ann Arbor, MI: Health Administration Press; 1982. Donabedian A. The Criteria and Standards of Quality. Ann Arbor, MI: Health Administration Press; 1982.
21.
go back to reference Hsu C, Sandford BA. The Delphi Technique: Making Sense of Consensus. PARE. 2007(10):1-8 Hsu C, Sandford BA. The Delphi Technique: Making Sense of Consensus. PARE. 2007(10):1-8
22.
go back to reference Keeney S, Hasson F, McKenna HP. A critical review of the Delphi technique as a research methodology for nursing. Int J Nurs Stud. 2001;38(2):195–200.CrossRefPubMed Keeney S, Hasson F, McKenna HP. A critical review of the Delphi technique as a research methodology for nursing. Int J Nurs Stud. 2001;38(2):195–200.CrossRefPubMed
23.
go back to reference Hasson F, Keeney S. Enhancing rigour in the Delphi technique research. Technol Forecast Soc Chang. 2011;78(9):1695–704.CrossRef Hasson F, Keeney S. Enhancing rigour in the Delphi technique research. Technol Forecast Soc Chang. 2011;78(9):1695–704.CrossRef
24.
go back to reference Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.CrossRefPubMed Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.CrossRefPubMed
25.
go back to reference Nie NH, Bent DH, Hull CH. SPSS: Statistical package for the social sciences (Vol. 227). New York, NY: McGraw-Hill 1975. Nie NH, Bent DH, Hull CH. SPSS: Statistical package for the social sciences (Vol. 227). New York, NY: McGraw-Hill 1975.
26.
go back to reference Muthén L, Muthén B. Mplus user’s guide 5. Los Angeles: Muthén & Muthén; 1998–2007. Muthén L, Muthén B. Mplus user’s guide 5. Los Angeles: Muthén & Muthén; 1998–2007.
27.
go back to reference John OP, Benet-Martinez V. Measurement: Reliability, construct validation, and scale construction. Handbook of Research Methods in Social and Personality Psychology. Cambridge: Cambridge University Personality; 2000. John OP, Benet-Martinez V. Measurement: Reliability, construct validation, and scale construction. Handbook of Research Methods in Social and Personality Psychology. Cambridge: Cambridge University Personality; 2000.
28.
go back to reference Raykov T, Marcoulides GA. Introduction to psychometric theory. New York, NY: Taylor & Francis; 2010. Raykov T, Marcoulides GA. Introduction to psychometric theory. New York, NY: Taylor & Francis; 2010.
29.
go back to reference Gulliksen H. Theory of mental tests. New York, NY: Routledge; 2013 Gulliksen H. Theory of mental tests. New York, NY: Routledge; 2013
30.
go back to reference Lord FM, Novick MR, Birnbaum A. Statistical theories of mental test scores. Oxford: Addison-Wesley; 1968. Lord FM, Novick MR, Birnbaum A. Statistical theories of mental test scores. Oxford: Addison-Wesley; 1968.
31.
go back to reference Bentler PM, Weeks DG. Linear structural equations with latent variables. Psychometrika. 1980;45(3):289–308.CrossRef Bentler PM, Weeks DG. Linear structural equations with latent variables. Psychometrika. 1980;45(3):289–308.CrossRef
32.
go back to reference Bollen KA. A new incremental fit index for general structural equation models. Sociol Methods Res. 1989;17(3):303–16.CrossRef Bollen KA. A new incremental fit index for general structural equation models. Sociol Methods Res. 1989;17(3):303–16.CrossRef
33.
go back to reference Bollen KA. Latent variables in psychology and the social sciences. Annu Rev Psychol. 2002;53(1):605–34.CrossRefPubMed Bollen KA. Latent variables in psychology and the social sciences. Annu Rev Psychol. 2002;53(1):605–34.CrossRefPubMed
34.
go back to reference Raines-Eudy R. Using structural equation modeling to test for differential reliability and validity: An empirical demonstration. Struct Equ Model. 2000;7(1):124–41.CrossRef Raines-Eudy R. Using structural equation modeling to test for differential reliability and validity: An empirical demonstration. Struct Equ Model. 2000;7(1):124–41.CrossRef
35.
go back to reference Marsh HW, Liem GAD, Martin AJ, Morin AJ, Nagengast B. Methodological measurement fruitfulness of exploratory structural equation modeling (ESEM): New approaches to key substantive issues in motivation and engagement. J Psychoeduc Assess. 2011;29(4):322–46.CrossRef Marsh HW, Liem GAD, Martin AJ, Morin AJ, Nagengast B. Methodological measurement fruitfulness of exploratory structural equation modeling (ESEM): New approaches to key substantive issues in motivation and engagement. J Psychoeduc Assess. 2011;29(4):322–46.CrossRef
36.
go back to reference Scholle SH, Vuong O, Ding L, Fry S, Gallagher P, Brown JA, et al. Development of and field test results for the CAHPS PCMH Survey. Med Care. 2012;50(Suppl):S2–S10.CrossRefPubMed Scholle SH, Vuong O, Ding L, Fry S, Gallagher P, Brown JA, et al. Development of and field test results for the CAHPS PCMH Survey. Med Care. 2012;50(Suppl):S2–S10.CrossRefPubMed
37.
go back to reference Friedberg MW, Schneider EC, Rosenthal MB, Volpp KG, Werner RM. Association between participation in a multipayer medical home intervention and changes in quality, utilization, and costs of care. JAMA. 2014;311(8):815–25.CrossRefPubMed Friedberg MW, Schneider EC, Rosenthal MB, Volpp KG, Werner RM. Association between participation in a multipayer medical home intervention and changes in quality, utilization, and costs of care. JAMA. 2014;311(8):815–25.CrossRefPubMed
38.
go back to reference Fredrickson DD, Jones TL, Molgaard CA, Carman CG, Schukman J, Dismuke SE, et al. Optimal design features for surveying low-income populations. J Health Care Poor Underserved. 2005;16(4):677–90.CrossRefPubMed Fredrickson DD, Jones TL, Molgaard CA, Carman CG, Schukman J, Dismuke SE, et al. Optimal design features for surveying low-income populations. J Health Care Poor Underserved. 2005;16(4):677–90.CrossRefPubMed
39.
go back to reference Haas LR, Takahashi PY, Shah ND, Stroebel RJ, Bernard ME, Finnie DM, et al. Risk-stratification methods for identifying patients for care coordination. Am J Manag Care. 2013;19(9):725–32.PubMed Haas LR, Takahashi PY, Shah ND, Stroebel RJ, Bernard ME, Finnie DM, et al. Risk-stratification methods for identifying patients for care coordination. Am J Manag Care. 2013;19(9):725–32.PubMed
40.
go back to reference McDonald KM, Sundaram V, Bravata DM, Lewis R, Lin N, Kraft S, et al. Closing the Quality Gap: A Critical Analysis of Quality Improvement Strategies (Vol. 7: Care Coordination). Technical Review 9. AHRQ Publication No. 04(07)-0051-7. Rockville, MD: Agency for Healthcare Research and Quality: 2007. Available from: http://www.ncbi.nlm.nih.gov/books/NBK44015/ McDonald KM, Sundaram V, Bravata DM, Lewis R, Lin N, Kraft S, et al. Closing the Quality Gap: A Critical Analysis of Quality Improvement Strategies (Vol. 7: Care Coordination). Technical Review 9. AHRQ Publication No. 04(07)-0051-7. Rockville, MD: Agency for Healthcare Research and Quality: 2007. Available from: http://​www.​ncbi.​nlm.​nih.​gov/​books/​NBK44015/​
41.
go back to reference National Quality Forum. Priority Setting for Healthcare Performance Measurement: Addressing Performance Measure Gaps in Care Coordination. 2014. National Quality Forum. Priority Setting for Healthcare Performance Measurement: Addressing Performance Measure Gaps in Care Coordination. 2014.
42.
go back to reference Kenny DA, Kashy DA, Cook WL. Dyadic data analysis. New York, NY: Guilford Press; 2006. Kenny DA, Kashy DA, Cook WL. Dyadic data analysis. New York, NY: Guilford Press; 2006.
43.
go back to reference Kenny DA, Veldhuijzen W, Weijden T, LeBlanc A, Lockyer J, Légaré F, et al. Interpersonal perception in the context of doctor–patient relationships: a dyadic analysis of doctor–patient communication. Soc Sci Med. 2010;70(5):763–8.CrossRefPubMed Kenny DA, Veldhuijzen W, Weijden T, LeBlanc A, Lockyer J, Légaré F, et al. Interpersonal perception in the context of doctor–patient relationships: a dyadic analysis of doctor–patient communication. Soc Sci Med. 2010;70(5):763–8.CrossRefPubMed
44.
go back to reference Coman E. Proceedings of the CIPCI-TRIPP Roundtable. Hartford: Connecticut Institute for Primary Care Innovation & Ethel Donaghue Center for Translating Research into Practice and Policy; 2014. Coman E. Proceedings of the CIPCI-TRIPP Roundtable. Hartford: Connecticut Institute for Primary Care Innovation & Ethel Donaghue Center for Translating Research into Practice and Policy; 2014.
Metadata
Title
Development and validation of the Medical Home Care Coordination Survey for assessing care coordination in the primary care setting from the patient and provider perspectives
Authors
Ianita Zlateva
Daren Anderson
Emil Coman
Khushbu Khatri
Terrence Tian
Judith Fifield
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2015
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-015-0893-1

Other articles of this Issue 1/2015

BMC Health Services Research 1/2015 Go to the issue