Skip to main content
Top
Published in: Community Mental Health Journal 2/2010

01-04-2010 | Original Paper

Continuity of Care: Validation of a Self-Report Measure to Assess Client Perceptions of Mental Health Service Delivery

Authors: Anthony S. Joyce, Carol E. Adair, T. Cameron Wild, Gerald M. McDougall, Alan Gordon, Norman Costigan, Gloria Pasmeny

Published in: Community Mental Health Journal | Issue 2/2010

Login to get access

Abstract

The psychometric characteristics of an instrument to assess perceived continuity of care among mental health patients were examined. 441 adults with severe and persistent mental illness were recruited from 70 inpatient, outpatient, emergency and community treatment programs (n = 259 females; M age = 42.5, SD = 10.3 years) in Alberta, Canada. Respondents completed a 43-item self-report questionnaire to rate perceived continuity. Item quality was assessed by examining missing data and frequency distributions. In a randomly selected subsample (n = 171), exploratory factor analysis identified 3 dimensions: (1) perceived attentiveness to individual needs or changes in illness or life circumstances (Individualized Care; α = .64); (2) perceptions of a coherent system characterized by good communication between providers (Responsive System; α = .71); and (3) perceived responsiveness on the part of a primary provider (Responsive Caregiver; α = .52). In a second random subsample (n = 181), confirmatory factor analysis provided support for this 3-factor structure and the inclusion of a second-order “continuity” factor (α = .72), and informed further item reduction. Split-half reliability for the second-order factor was calculated. Associations between the factors and “objective” measures of continuity, as well as relevant clinical, quality of life, and service satisfaction variables, are reported. Use of the measure for clinical and research purposes and its limitations are considered.
Literature
go back to reference Adair, C. E., McDougall, G. M., Beckie, A., Joyce, A. S., Mitton, C., Wild, T. C., et al. (2003). History and measurement of continuity of care in mental health services and evidence of its role in outcomes. Psychiatric Services, 54, 1351–1356.CrossRefPubMed Adair, C. E., McDougall, G. M., Beckie, A., Joyce, A. S., Mitton, C., Wild, T. C., et al. (2003). History and measurement of continuity of care in mental health services and evidence of its role in outcomes. Psychiatric Services, 54, 1351–1356.CrossRefPubMed
go back to reference Adair, C. E., McDougall, G. M., Mitton, C. R., Joyce, A. S., Wild, T. C., Gordon, A., et al. (2005). Continuity of care and health outcomes among persons with severe mental illness. Psychiatric Services, 56, 1061–1069.CrossRefPubMed Adair, C. E., McDougall, G. M., Mitton, C. R., Joyce, A. S., Wild, T. C., Gordon, A., et al. (2005). Continuity of care and health outcomes among persons with severe mental illness. Psychiatric Services, 56, 1061–1069.CrossRefPubMed
go back to reference Adair, C. E., Wild, T. C., Joyce, A. S., McDougall, G. M., Gordon, A., Costigan, N., et al. (2001). The Continuity of Mental Health Services (COHMS) Study of Alberta: A research program on continuity of care. Paper presented at the 26th Biennial Congress of the World Assembly for Mental Health, Vancouver, British Columbia. Adair, C. E., Wild, T. C., Joyce, A. S., McDougall, G. M., Gordon, A., Costigan, N., et al. (2001). The Continuity of Mental Health Services (COHMS) Study of Alberta: A research program on continuity of care. Paper presented at the 26th Biennial Congress of the World Assembly for Mental Health, Vancouver, British Columbia.
go back to reference Attkisson, C. C., & Greenfield, T. K. (1996). The Client Satisfaction Questionnaire (CSQ) Scales and the Service Satisfactrion Scale-30 (SSS-30). In L. I. Sederer & B. Dickey (Eds.), Outcomes assessment in clinical practice (pp. 120–127). Baltimore, MD: Williams & Wilkins. Attkisson, C. C., & Greenfield, T. K. (1996). The Client Satisfaction Questionnaire (CSQ) Scales and the Service Satisfactrion Scale-30 (SSS-30). In L. I. Sederer & B. Dickey (Eds.), Outcomes assessment in clinical practice (pp. 120–127). Baltimore, MD: Williams & Wilkins.
go back to reference Bachrach, L. L. (1981). Continuity of care for chronic mental patients: A conceptual analysis. American Journal of Psychiatry, 138, 1449–1456.PubMed Bachrach, L. L. (1981). Continuity of care for chronic mental patients: A conceptual analysis. American Journal of Psychiatry, 138, 1449–1456.PubMed
go back to reference Bachrach, L. L. (1993). Continuity of care and approaches to case management for long-term mentally ill patients. Hospital and Community Psychiatry, 44, 465–468.PubMed Bachrach, L. L. (1993). Continuity of care and approaches to case management for long-term mentally ill patients. Hospital and Community Psychiatry, 44, 465–468.PubMed
go back to reference Barbato, A., Terzian, E., Saraceno, B., Barquero, F. M., & Tognon, G. (1992). Patterns of aftercare for psychiatric patients discharged after short inpatient treatment. Social Psychiatry and Psychiatric Epidemiology, 27, 46–52.CrossRefPubMed Barbato, A., Terzian, E., Saraceno, B., Barquero, F. M., & Tognon, G. (1992). Patterns of aftercare for psychiatric patients discharged after short inpatient treatment. Social Psychiatry and Psychiatric Epidemiology, 27, 46–52.CrossRefPubMed
go back to reference Barker, S., Barron, N., McFarland, B., & Bigelow, D. (1994a). A community ability scale for chronically mentally ill consumers: Part II. Applications. Community Mental Health Journal, 30, 459–472.CrossRefPubMed Barker, S., Barron, N., McFarland, B., & Bigelow, D. (1994a). A community ability scale for chronically mentally ill consumers: Part II. Applications. Community Mental Health Journal, 30, 459–472.CrossRefPubMed
go back to reference Barker, S., Barron, N., McFarland, B., Bigelow, D., & Carnahan, T. (1994b). A community ability scale for chronically mentally ill consumers: Part I. Reliability and validity. Community Mental Health Journal, 30, 363–383.CrossRefPubMed Barker, S., Barron, N., McFarland, B., Bigelow, D., & Carnahan, T. (1994b). A community ability scale for chronically mentally ill consumers: Part I. Reliability and validity. Community Mental Health Journal, 30, 363–383.CrossRefPubMed
go back to reference Bass, R. D., & Windle, C. (1972). A preliminary attempt to measure continuity of care in a community mental health clinic. Community Mental Health Journal, 9, 53–62.CrossRef Bass, R. D., & Windle, C. (1972). A preliminary attempt to measure continuity of care in a community mental health clinic. Community Mental Health Journal, 9, 53–62.CrossRef
go back to reference Becker, M. A., Diamond, R., Douglas, J., & Thornton, D. (1997). Wisconsin Quality of Life Assessment Manual. Madison, WI: University of Wisconsin-Madison Press. Becker, M. A., Diamond, R., Douglas, J., & Thornton, D. (1997). Wisconsin Quality of Life Assessment Manual. Madison, WI: University of Wisconsin-Madison Press.
go back to reference Bernstein, I. H., & Teng, G. (1989). Factoring items and factoring scales are different: Spurious evidence for multidimensionality due to item categorization. Psychological Bulletin, 105, 467–477.CrossRef Bernstein, I. H., & Teng, G. (1989). Factoring items and factoring scales are different: Spurious evidence for multidimensionality due to item categorization. Psychological Bulletin, 105, 467–477.CrossRef
go back to reference Bindman, J., Johnson, S., Szmukler, G., Wright, S., Kuipers, E., Thornicroft, G., et al. (2000). Continuity of care and clinical outcome: A prospective cohort study. Social Psychiatry and Psychiatric Epidemiology, 35, 242–247.CrossRefPubMed Bindman, J., Johnson, S., Szmukler, G., Wright, S., Kuipers, E., Thornicroft, G., et al. (2000). Continuity of care and clinical outcome: A prospective cohort study. Social Psychiatry and Psychiatric Epidemiology, 35, 242–247.CrossRefPubMed
go back to reference Bolscher, J., & Graf von der Schulenburg, J. M. (1997). Using the EuroQol in mental health. Symposium conducted at the Plenary Meeting of the EuroQol Group, Rotterdam, The Netherlands. Bolscher, J., & Graf von der Schulenburg, J. M. (1997). Using the EuroQol in mental health. Symposium conducted at the Plenary Meeting of the EuroQol Group, Rotterdam, The Netherlands.
go back to reference Byrne, B. M. (2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum. Byrne, B. M. (2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum.
go back to reference Caron, J., Corbiere, M., Mercier, C. A., Diaz, P., Ricard, N., & Lesage, A. (2003). The construct validity of the client questionnaire of the Wisconsin Quality of Life Index: A cross-validation study. International Journal of Methods in Psychiatric Research, 12, 128–138.CrossRefPubMed Caron, J., Corbiere, M., Mercier, C. A., Diaz, P., Ricard, N., & Lesage, A. (2003). The construct validity of the client questionnaire of the Wisconsin Quality of Life Index: A cross-validation study. International Journal of Methods in Psychiatric Research, 12, 128–138.CrossRefPubMed
go back to reference Caron, J., Mercier, C., Diaz, P., & Martin, A. (2005). Socio-demographic and clinical predictors of quality of life in patients with schizophrenia or schizo-affective disorder. Psychiatry Research, 137, 203–213.CrossRefPubMed Caron, J., Mercier, C., Diaz, P., & Martin, A. (2005). Socio-demographic and clinical predictors of quality of life in patients with schizophrenia or schizo-affective disorder. Psychiatry Research, 137, 203–213.CrossRefPubMed
go back to reference Chien, C. F., Steinwachs, D. M., Lehman, A., Fahey, M., & Skinner, E. A. (2000). Provider continuity and outcomes of care for persons with schizophrenia. Mental Health Services Research, 2, 201–211.CrossRef Chien, C. F., Steinwachs, D. M., Lehman, A., Fahey, M., & Skinner, E. A. (2000). Provider continuity and outcomes of care for persons with schizophrenia. Mental Health Services Research, 2, 201–211.CrossRef
go back to reference Diamond, R., & Becker, M. (1999). The Wisconsin Quality of Life Index: A multidimensional model for measuring quality of life. Journal of Clinical Psychiatry, 60, 29–31.PubMed Diamond, R., & Becker, M. (1999). The Wisconsin Quality of Life Index: A multidimensional model for measuring quality of life. Journal of Clinical Psychiatry, 60, 29–31.PubMed
go back to reference Druss, B., & Rosenheck, R. (1997). Evaluation of the HEDIS measure of behavioral health care quality. Psychiatric Services, 48, 956–957. Druss, B., & Rosenheck, R. (1997). Evaluation of the HEDIS measure of behavioral health care quality. Psychiatric Services, 48, 956–957.
go back to reference Durbin, J., Goering, P., Streiner, D. L., & Pink, G. (2004). Continuity of care: Validation of a new self-report measure for individuals using mental health services. Journal of Behavioral Sciences & Research, 31, 279–296. Durbin, J., Goering, P., Streiner, D. L., & Pink, G. (2004). Continuity of care: Validation of a new self-report measure for individuals using mental health services. Journal of Behavioral Sciences & Research, 31, 279–296.
go back to reference Eaton, (1996). Strategies of measurement and analysis. In H. K. Knudson & G. Thornicroft (Eds.), Mental health services evaluation (pp. 121–142). Cambridge: Cambridge University Press. Eaton, (1996). Strategies of measurement and analysis. In H. K. Knudson & G. Thornicroft (Eds.), Mental health services evaluation (pp. 121–142). Cambridge: Cambridge University Press.
go back to reference Ellis, R., Wilson, N., & Foster, F. (1984). Statewide treatment outcome assessment in Colorado: The Colorado Client Assessment Record (CCAR). Community Mental Health Journal, 20, 72–89.CrossRefPubMed Ellis, R., Wilson, N., & Foster, F. (1984). Statewide treatment outcome assessment in Colorado: The Colorado Client Assessment Record (CCAR). Community Mental Health Journal, 20, 72–89.CrossRefPubMed
go back to reference Glick, H. A., Polsky, D., Willke, R. J., & Schulman, K. A. (1999). A comparison of preference assessment instruments used in a clinical trial: Responses to the visual analog scale from the EuroQol EQ-5D and the Health Utilities Index. Society for Medical Decision Making, 19, 265–275.CrossRef Glick, H. A., Polsky, D., Willke, R. J., & Schulman, K. A. (1999). A comparison of preference assessment instruments used in a clinical trial: Responses to the visual analog scale from the EuroQol EQ-5D and the Health Utilities Index. Society for Medical Decision Making, 19, 265–275.CrossRef
go back to reference Greenberg, G. A., Rosenheck, R. A., & Seibyl, C. L. (2002). Continuity of care and clinical effectiveness: Outcomes following residental treatment for severe substance abuse. Medical Care, 40, 246–259.CrossRefPubMed Greenberg, G. A., Rosenheck, R. A., & Seibyl, C. L. (2002). Continuity of care and clinical effectiveness: Outcomes following residental treatment for severe substance abuse. Medical Care, 40, 246–259.CrossRefPubMed
go back to reference Greenfield, T. K., & Attkisson, C. C. (1989). Steps toward a multifactorial satisfaction scale for primary care and mental health services. Evaluation and Program Planning, 12, 271–278.CrossRef Greenfield, T. K., & Attkisson, C. C. (1989). Steps toward a multifactorial satisfaction scale for primary care and mental health services. Evaluation and Program Planning, 12, 271–278.CrossRef
go back to reference Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7, 191–205.CrossRef Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7, 191–205.CrossRef
go back to reference Hedlund, J. L., & Vieweg, B. W. (1980). The Brief Psychiatric Rating Scale (BPRS): A comprehensive review. Journal of Operational Psychiatry, 11, 48–65. Hedlund, J. L., & Vieweg, B. W. (1980). The Brief Psychiatric Rating Scale (BPRS): A comprehensive review. Journal of Operational Psychiatry, 11, 48–65.
go back to reference Johnson, S., Prosser, D., Bindman, J., & Szmukler, G. (1997). Continuity of care for the severely mentally ill: Concepts and measures. Social Psychiatry and Psychiatric Epidemiology, 32, 137–142.PubMed Johnson, S., Prosser, D., Bindman, J., & Szmukler, G. (1997). Continuity of care for the severely mentally ill: Concepts and measures. Social Psychiatry and Psychiatric Epidemiology, 32, 137–142.PubMed
go back to reference Joyce, A. S., Wild, T. C., Adair, C. E., McDougall, G. M., Gordon, A., Costigan, N., et al. (2004). Continuity of care in mental health services: Toward clarifying the construct. Canadian Journal of Psychiatry, 49, 539–550. Joyce, A. S., Wild, T. C., Adair, C. E., McDougall, G. M., Gordon, A., Costigan, N., et al. (2004). Continuity of care in mental health services: Toward clarifying the construct. Canadian Journal of Psychiatry, 49, 539–550.
go back to reference Kopelowicz, A., Wallace, C. J., & Zarate, R. (1998). Defining and measuring continuity of care. Psychosocial Rehabilitation Journal, 49, 1313–1316. Kopelowicz, A., Wallace, C. J., & Zarate, R. (1998). Defining and measuring continuity of care. Psychosocial Rehabilitation Journal, 49, 1313–1316.
go back to reference Mitton, C. R., Adair, C. E., McDougall, G. M., & Marcoux, G. (2005). Continuity of care and health care costs among persons with severe mental illness. Psychiatric Services, 56, 1070–1076.CrossRefPubMed Mitton, C. R., Adair, C. E., McDougall, G. M., & Marcoux, G. (2005). Continuity of care and health care costs among persons with severe mental illness. Psychiatric Services, 56, 1070–1076.CrossRefPubMed
go back to reference Nunnaly, J., & Bernstein, I. (1994). Psychometric theory (pp. 316–318). New York: McGraw-Hill. Nunnaly, J., & Bernstein, I. (1994). Psychometric theory (pp. 316–318). New York: McGraw-Hill.
go back to reference O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers, 32, 396–402. O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers, 32, 396–402.
go back to reference Overall, J. E., & Gorham, D. R. (1988). The Brief Psychiatric Rating Scale (BPRS): Recent developments in ascertainment and scaling. Psychopharmacology Bulletin, 24, 97–99. Overall, J. E., & Gorham, D. R. (1988). The Brief Psychiatric Rating Scale (BPRS): Recent developments in ascertainment and scaling. Psychopharmacology Bulletin, 24, 97–99.
go back to reference Pugh, T. F., & MacMahon, B. (1967). Measurement of discontinuity of psychiatric inpatient care. Public Health Reports, 82, 533–538.PubMed Pugh, T. F., & MacMahon, B. (1967). Measurement of discontinuity of psychiatric inpatient care. Public Health Reports, 82, 533–538.PubMed
go back to reference Rhoades, H. M., & Overall, J. E. (1988). The semistructured BPRS interview and rating guide. Psychopharmacology Bulletin, 24, 101–104.PubMed Rhoades, H. M., & Overall, J. E. (1988). The semistructured BPRS interview and rating guide. Psychopharmacology Bulletin, 24, 101–104.PubMed
go back to reference Rogers, J., & Curtis, P. (1980). The concept and measurement of continuity of primary care. American Journal of Public Health, 70, 122–127.CrossRefPubMed Rogers, J., & Curtis, P. (1980). The concept and measurement of continuity of primary care. American Journal of Public Health, 70, 122–127.CrossRefPubMed
go back to reference Sheehan, D., Lecrubier, Y., Harnett-Sheehan, K., Amorim, P., Janavs, J., Weiller, E., et al. (1998). The Mini-International Neuropsychiatric Interview (MINI): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry, 59, 22–33.PubMed Sheehan, D., Lecrubier, Y., Harnett-Sheehan, K., Amorim, P., Janavs, J., Weiller, E., et al. (1998). The Mini-International Neuropsychiatric Interview (MINI): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry, 59, 22–33.PubMed
go back to reference Shenn, D. L., Wilson, N. Z., Coen, A. S., et al. (1994). Client outcomes II: Longitudinal client data from the Colorado treatment outcome study. Millbank Quarterly, 72, 123–148.CrossRef Shenn, D. L., Wilson, N. Z., Coen, A. S., et al. (1994). Client outcomes II: Longitudinal client data from the Colorado treatment outcome study. Millbank Quarterly, 72, 123–148.CrossRef
go back to reference Sytema, S., Micciolo, R., & Tansella, M. (1997). Continuity of care for patients with schizophrenia and related disorders: A comparative South Verona and Groningen case-register study. Psychological Medicine, 27, 1355–1362.CrossRefPubMed Sytema, S., Micciolo, R., & Tansella, M. (1997). Continuity of care for patients with schizophrenia and related disorders: A comparative South Verona and Groningen case-register study. Psychological Medicine, 27, 1355–1362.CrossRefPubMed
go back to reference Tessler, R. C., Willis, G., & Gubman, G. D. (1986). Defining and measuring continuity of care. Psychosocial Rehabilitation Journal, 10, 27–38. Tessler, R. C., Willis, G., & Gubman, G. D. (1986). Defining and measuring continuity of care. Psychosocial Rehabilitation Journal, 10, 27–38.
go back to reference Ware, N. C., Dickey, B., Tugenberg, T., & McHorney, C. A. (2003). CONNECT: A measure of continuity of care in mental health services. Mental Health Services Research, 5, 209–221.CrossRefPubMed Ware, N. C., Dickey, B., Tugenberg, T., & McHorney, C. A. (2003). CONNECT: A measure of continuity of care in mental health services. Mental Health Services Research, 5, 209–221.CrossRefPubMed
go back to reference Ware, N. C., Tugenberg, T., Dickey, B., & McHorney, C. A. (1999). An ethnographic study of the meaning of continuity of care in mental health services. Psychiatric Services, 50, 395–400.PubMed Ware, N. C., Tugenberg, T., Dickey, B., & McHorney, C. A. (1999). An ethnographic study of the meaning of continuity of care in mental health services. Psychiatric Services, 50, 395–400.PubMed
go back to reference Zani, B., McFarland, B., Wachal, M., Barker, S., & Barron, N. (1999). Statewide replication of predictive validation for the Multnomah Community Ability Scale. Community Mental Health Journal, 35, 223–229.CrossRefPubMed Zani, B., McFarland, B., Wachal, M., Barker, S., & Barron, N. (1999). Statewide replication of predictive validation for the Multnomah Community Ability Scale. Community Mental Health Journal, 35, 223–229.CrossRefPubMed
go back to reference Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99, 432–442.CrossRef Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99, 432–442.CrossRef
Metadata
Title
Continuity of Care: Validation of a Self-Report Measure to Assess Client Perceptions of Mental Health Service Delivery
Authors
Anthony S. Joyce
Carol E. Adair
T. Cameron Wild
Gerald M. McDougall
Alan Gordon
Norman Costigan
Gloria Pasmeny
Publication date
01-04-2010
Publisher
Springer US
Published in
Community Mental Health Journal / Issue 2/2010
Print ISSN: 0010-3853
Electronic ISSN: 1573-2789
DOI
https://doi.org/10.1007/s10597-009-9215-6

Other articles of this Issue 2/2010

Community Mental Health Journal 2/2010 Go to the issue