Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

Open Access 01-03-2018 | Original Article

Treatment Outcome, Duration, and Costs: A Comparison of Performance Indicators Using Data from Eight Mental Health Care Providers in The Netherlands

Authors: E. de Beurs, E. H. Warmerdam, S. C. C. Oudejans, M. Spits, P. Dingemanse, S. D. D. de Graaf, I. W. de Groot, H. Houben, W. G. E. Kuyck, E. O. Noorthoorn, M. A. Nugter, S. C. C. Robbers, G. E. van Son

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 2/2018

Abstract

Assessing performance of mental health services (MHS) providers merely by their outcomes is insufficient. Process factors, such as treatment cost or duration, should also be considered in a meaningful and thorough analysis of quality of care. The present study aims to examine various performance indicators based on treatment outcome and two process factors: duration and cost of treatment. Data of patients with depression or anxiety from eight Dutch MHS providers were used. Treatment outcome was operationalized as case mix corrected pre-to-posttreatment change scores and as reliable change (improved) and clinical significant change (recovered). Duration and cost were corrected for case mix differences as well. Three performance indicators were calculated and compared: outcome as such, duration per outcome, and cost per outcome. The results showed that performance indicators, which also take process variability into account, reveal larger differences between MHS providers than mere outcome. We recommend to use the three performance indicators in a complementary way. Average pre-to-posttreatment change allows for a simple and straightforward ranking of MHS providers. Duration per outcome informs patients on how MHS providers compare in how quickly symptomatic relief is achieved. Cost per outcome informs MHS providers on how they compare regarding the efficiency of their care. The substantial variation among MHS providers in outcome, treatment duration and cost calls for further exploration of its causes, dissemination of best practices, and continuous quality improvement.

American Psychiatric Association (1994). Diagnostic and statistical manual of mental disorders IV. Washington, DC: American Psychiatric Association.

Anderson, N. B. (2006). Evidence-based practice in psychology. American Psychologist, 61(4), 271–285.CrossRef

Appelo, M. (2006). Korte Klachten Lijst (KKL) handleiding: Bohn Stafleu van Loghum: Houten

Beurs, E. de, Barendregt, M., & Warmerdam, L. (Eds.). (2017). Behandeluitkomsten: bron voor kwaliteitsbeleid in de GGZ. Amsterdam: Boom.

Bockting, C. L. H., Schene, A. H., Spinhoven, P., Koeter, M. W. J., Wouters, L. F., Huyser, J., & Kamphuis, J. H. (2005). Preventing Relapse/Recurrence in Recurrent Depression With Cognitive Therapy: A Randomized Controlled Trial. Journal of Consulting and Clinical Psychology, 73(4), 647–657. doi:10.1037/0022-006X.73.4.647.CrossRefPubMed

Cohen, J., Marecek, J., & Gillham, J. (2006). Is three a crowd? Clients, clinicians, and managed care. American Journal of Orthopsychiatry, 76(2), 251.CrossRefPubMed

Cuddeback, G., Wilson, E., Orme, J. G., & Combs-Orme, T. (2004). Detecting and statistically correcting sample selection bias. Journal of Social Service Research, 30(3), 19–33.CrossRef

de Beurs, E. (2010). De genormaliseerde T-score, een ‘euro’ voor testuitslagen (The normalised T-score: A euro for test results). Maandblad Geestelijke Volksgezondheid, 65, 684–695. http://www.sbggz.nl.

de Beurs, E., Barendregt, M., de Heer, A., van Duijn, E., Goeree, B., Kloos, M., & Merks, A. (2016). Comparing methods to denote treatment outcome in clinical research and benchmarking mental health care. Clinical Psychology & Psychotherapy, 23, 308–318. doi:10.1002/cpp.1954.CrossRef

de Beurs, E., Barendregt, M., Flens, G., van Dijk, E., Huijbrechts, I., & Meerding, J. W. (2012). Vooruitgang in de behandeling meten: Een vergelijking van vragenlijsten voor zelfrapportage (A comparison of Self-report Questionnaires for treatment outcome). Maandblad Geestelijke Volksgezondheid, 67, 259–270. http://www.mgvonline.nl/artikelen/vooruitgang-in-de-behandeling-meten-2/.

de Beurs, E., den Hollander-Gijsman, M. E., van Rood, Y. R., van der Wee, N. J., Giltay, E. J., van Noorden, M. S., ... Zitman, F. G. (2011). Routine outcome monitoring in the Netherlands: Practical experiences with a web-based strategy for the assessment of treatment outcome in clinical practice. Clinical Psychology & Psychotherapy, 18(1), 1–12. doi:10.1002/cpp.696.CrossRef

Deming, W. E. (1950). Elementary principles of statistical control of quality. Tokyo: Nippon Kagaku Gijutsu Renmei.

Deming, W. E. (2000). Out of the crisis. Cambridge: Massachusetts Institute of Technology Press.

Derogatis, L. R. (1975). The Brief Symptom Inventory. Baltimore: Clinical Psychometric Research.

Ellwood, P. M. (1988). Shattuck lecture–outcomes management. A technology of patient experience. New England Journal of Medicine, 318(23), 1549–1556. doi:10.1056/NEJM198806093182329.CrossRefPubMed

Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE–OM. British Journal of Psychiatry, 180(1), 51–60. doi:10.1192/bjp.180.1.51.CrossRefPubMed

Fedorov, V., Mannino, F., & Zhang, R. (2009). Consequences of dichotomization. Pharmaceutical Statistics, 8(1), 50–61. doi:10.1002/pst.331.CrossRefPubMed

Hermann, R. C., Rollins, C. K., & Chan, J. A. (2007). Risk-adjusting outcomes of mental health and substance-related care: A review of the literature. Paper presented at the. Harvard Review of Psychiatry. Pennsylvania: Lippincott Williams & Wilkins. 10.1080/10673220701307596.

Hibbard, J. H. (2003). Engaging health care consumers to improve the quality of care. Medical Care, 41(1), I61–I70.

Hoogduin, C. A. L., Verbraak, M. J. P. M., & de Haan, E. (1997). Het ‘outtake’-team: strategieën ter voorkoming van langdurige behandelingen. In G. J. Methorst, C. A. L. Hoogduin, & K. van der Velden (Eds.), Richtlijnen bij kortdurende ambulante behandeling in de geestelijke gezondheidszorg (pp. 75–82). Houten: Bohn Stafleu van Loghum.

Hulley, S. B., Cummings, S. R., Browner, W. S., Grady, D. G., & Newman, T. B. (2013). Designing clinical research. Philadelphia: Lipincott, Williams & Wilkins.

Iezzoni, L. (Ed.). (2013). Risk adjustment for health care outcomes (4th edn.). Chicago: Health Administration Press.

Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12–19.CrossRefPubMed

Lambert, M. J. (2010). Prevention of treatment failure. The use measuring, monitoring, and feedback in clinical practice. Washington, D.C.: American Psychological Association.CrossRef

Lambert, M. J., Gregersen, A. T., & Burlingame, G. M. (2004). The Outcome Questionnaire-45. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment: Volume 3: Instruments for adults (3rd edn., pp. 191–234). Mahwah: Lawrence Erlbaum Associates Publishers.

Lovibond, S. H., & Lovibond, P. F. (1993). Manual for the depression anxiety stress scales (DASS). Sydney: Psychology Foundation Monograph.

McCall, W. A. (1922). How to measure in education. New York: MacMillan.

Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003). Interpretation of changes in health-related quality of life: The remarkable universality of half a standard deviation. Medical Care, 41(5), 582–592. doi:10.1097/00005650-200305000-00004.PubMed

Okiishi, J., Lambert, M. J., Nielsen, S. L., & Ogles, B. M. (2003). Waiting for supershrink: An empirical analysis of therapist effects. Clinical Psychology & Psychotherapy, 10(6), 361–373. doi:10.1002/cpp.383.CrossRef

Paul, G. L. (1967). Strategy of outcome research in psychotherapy. Journal of Consulting Psychology, 31(2), 109–118. doi:10.1037/h0024436.CrossRefPubMed

Porter, M. E. (2009). A strategy for health care reform–toward a value-based system. New England Journal of Medicine, 361(2), 109–112. doi:10.1056/NEJMp0904131.CrossRefPubMed

Porter, M. E., & Teisberg, E. O. (2006). Redefining health care: Creating value-based competition on results. Cambridge: Harvard Business Press.

Sloan, J. A., Cella, D., & Hays, R. D. (2005). Clinical significance of patient-reported questionnaire data: another step toward consensus. Journal of Clinical Epidemiology, 58(12), 1217–1219. doi:10.1016/j.jclinepi.2005.07.009.CrossRefPubMed

Tan, S. S., Bouwmans, C. A., Rutten, F. F., & Hakkaart-van Roijen, L. (2012). Update of the Dutch manual for costing in economic evaluations. International Journal of Technology Assessment in Health Care, 28(2), 152–158. doi:10.1017/S0266462312000062.CrossRefPubMed

Taylor, M. J., McNicholas, C., Nicolay, C., Darzi, A., Bell, D., & Reed, J. E. (2014). Systematic review of the application of the Plan–Do–Study–Act method to improve quality in healthcare. BMJ Quality and Safety, 23(4), 290–298.CrossRefPubMed

van Agthoven, M., van der Kolk, A., Knegtering, H., Delespaul, P. A. E. G., Arends, J., Jeurissen, P. P. T., ... Bruggeman, R. (2014). Doelmatigheid in de GGZ: toekomst dankzij ROM? (Cost-effectiveness in Dutch mental health care: Future because of ROM?). Tijdschrift voor Psychiatrie, 57(9), 672–679.

Verbraak, M. J. P. M., & Hoogduin, C. A. L. (2013). Management van behandeling. In P. M. G. Emmelkamp & C. A. L. Hoogduin (Eds.), Van mislukking naar succes in de psychotherapie (pp. 93–112). Amsterdam: Uitgeverij Boom.

Verbraak, M. J. P. M., Theuws, S., & Verdellen, C. W. J. (2015). ROM en benchmarken. Een voorbeeld van een geïntegreerde aanpak. Directieve Therapie, 35(2), 115–131.

Vittengl, J. R., Clark, L. A., Dunn, T. W., & Jarrett, R. B. (2007). Reducing relapse and recurrence in unipolar depression: A comparative meta-analysis of cognitive-behavioral therapy’s effects. Journal of Consulting and Clinical Psychology, 75(3), 475–488. doi:10.1037/0022-006X.75.3.475.CrossRefPubMedPubMedCentral

Warmerdam, E. H., Barendregt, M., & de Beurs, E. (2017). Risk adjustment of self-reported clinical outcomes in Dutch mental health care. Journal of Public Health. doi:10.1007/s10389-017-0785-4.

Warmerdam, E. H., Ten Have, P., Dekker, J., & de Beurs, E. (2016). Klachtniveau bij aanvang behandeling is belangrijkste voorspeller van behandeluitkomst bij angst en depressie. Tijdschrift voor GZ-psychologie, 8(4), 10–15. doi:10.1007/s41480-016-0026-4

Title: Treatment Outcome, Duration, and Costs: A Comparison of Performance Indicators Using Data from Eight Mental Health Care Providers in The Netherlands
Authors: E. de Beurs
E. H. Warmerdam
S. C. C. Oudejans
M. Spits
P. Dingemanse
S. D. D. de Graaf
I. W. de Groot
H. Houben
W. G. E. Kuyck
E. O. Noorthoorn
M. A. Nugter
S. C. C. Robbers
G. E. van Son
Publication date: 01-03-2018
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 2/2018
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-017-0818-x

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Treatment Outcome, Duration, and Costs: A Comparison of Performance Indicators Using Data from Eight Mental Health Care Providers in The Netherlands

Abstract

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 2/2018

The REFINEMENT Glossary of Terms: An International Terminology for Mental Health Systems Assessment

“It’s Not Like Therapy”: Patient-Inmate Perspectives on Jail Psychiatric Services

Length of Involuntary Hospitalization Related to the Referring Physician’s Psychiatric Emergency Experience

Peer-Assisted Social Learning for Diverse and Low-Income Youth: Infusing Mental Health Promotion Into Urban After-School Programs

Mobilizing Community Health Workers to Address Mental Health Disparities for Underserved Populations: A Systematic Review

Potentially Inappropriate Antidepressant Prescriptions Among Older Adults in Office-Based Outpatient Settings: National Trends from 2002 to 2012