Skip to main content
Top
Published in: Quality of Life Research 12/2017

Open Access 01-12-2017

Standardization of health outcomes assessment for depression and anxiety: recommendations from the ICHOM Depression and Anxiety Working Group

Authors: Alexander Obbarius, Lisa van Maasakkers, Lee Baer, David M. Clark, Anne G. Crocker, Edwin de Beurs, Paul M. G. Emmelkamp, Toshi A. Furukawa, Erik Hedman-Lagerlöf, Maria Kangas, Lucie Langford, Alain Lesage, Doris M. Mwesigire, Sandra Nolte, Vikram Patel, Paul A. Pilkonis, Harold A. Pincus, Roberta A. Reis, Graciela Rojas, Cathy Sherbourne, Dave Smithson, Caleb Stowell, Kelly Woolaway-Bickel, Matthias Rose

Published in: Quality of Life Research | Issue 12/2017

Login to get access

Abstract

Purpose

National initiatives, such as the UK Improving Access to Psychological Therapies program (IAPT), demonstrate the feasibility of conducting empirical mental health assessments on a large scale, and similar initiatives exist in other countries. However, there is a lack of international consensus on which outcome domains are most salient to monitor treatment progress and how they should be measured. The aim of this project was to propose (1) an essential set of outcome domains relevant across countries and cultures, (2) a set of easily accessible patient-reported instruments, and (3) a psychometric approach to make scores from different instruments comparable.

Methods

Twenty-four experts, including ten health outcomes researchers, ten clinical experts from all continents, two patient advocates, and two ICHOM coordinators worked for seven months in a consensus building exercise to develop recommendations based on existing evidence using a structured consensus-driven modified Delphi technique.

Results

The group proposes to combine an assessment of potential outcome predictors at baseline (47 items: demographics, functional, clinical status, etc.), with repeated assessments of disease-specific symptoms during the treatment process (19 items: symptoms, side effects, etc.), and a comprehensive annual assessment of broader treatment outcomes (45 items: remission, absenteeism, etc.). Further, it is suggested reporting disease-specific symptoms for depression and anxiety on a standardized metric to increase comparability with other legacy instruments. All recommended instruments are provided online (www.​ichom.​org).

Conclusion

An international standard of health outcomes assessment has the potential to improve clinical decision making, enhance health care for the benefit of patients, and facilitate scientific knowledge.
Appendix
Available only for authorised users
Literature
1.
go back to reference Vos, T., Flaxman, A. D., Naghavi, M., Lozano, R., Michaud, C., Ezzati, M., et al. (2012). Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: A systematic analysis for the Global Burden of Disease Study 2010. Lancet, 380(9859), 2163–2196. doi:10.1016/S0140-6736(12)61729-2.CrossRefPubMed Vos, T., Flaxman, A. D., Naghavi, M., Lozano, R., Michaud, C., Ezzati, M., et al. (2012). Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: A systematic analysis for the Global Burden of Disease Study 2010. Lancet, 380(9859), 2163–2196. doi:10.​1016/​S0140-6736(12)61729-2.CrossRefPubMed
3.
go back to reference Greenberg, P. E., Fournier, A. A., Sisitsky, T., Pike, C. T., & Kessler, R. C. (2015). The economic burden of adults with major depressive disorder in the United States (2005 and 2010). Journal of Clinical Psychiatry, 76(2), 155–162. doi:10.4088/JCP.14m09298.CrossRefPubMed Greenberg, P. E., Fournier, A. A., Sisitsky, T., Pike, C. T., & Kessler, R. C. (2015). The economic burden of adults with major depressive disorder in the United States (2005 and 2010). Journal of Clinical Psychiatry, 76(2), 155–162. doi:10.​4088/​JCP.​14m09298.CrossRefPubMed
4.
go back to reference Cuijpers, P., Sijbrandij, M., Koole, S. L., Andersson, G., Beekman, A. T., & Reynolds, C. F., 3rd. (2014). Adding psychotherapy to antidepressant medication in depression and anxiety disorders: A meta-analysis. World Psychiatry, 13(1), 56–67. doi:10.1002/wps.20089.CrossRefPubMedPubMedCentral Cuijpers, P., Sijbrandij, M., Koole, S. L., Andersson, G., Beekman, A. T., & Reynolds, C. F., 3rd. (2014). Adding psychotherapy to antidepressant medication in depression and anxiety disorders: A meta-analysis. World Psychiatry, 13(1), 56–67. doi:10.​1002/​wps.​20089.CrossRefPubMedPubMedCentral
7.
go back to reference Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., Cella, D., et al. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS(R)): Depression, anxiety, and anger. Assessment, 18(3), 263–283. doi:10.1177/1073191111411667.CrossRefPubMedPubMedCentral Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., Cella, D., et al. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS(R)): Depression, anxiety, and anger. Assessment, 18(3), 263–283. doi:10.​1177/​1073191111411667​.CrossRefPubMedPubMedCentral
9.
go back to reference Wahl, I., Lowe, B., Bjorner, J. B., Fischer, F., Langs, G., Voderholzer, U., et al. (2014). Standardization of depression measurement: A common metric was developed for 11 self-report depression measures. Journal of Clinical Epidemiology, 67(1), 73–86. doi:10.1016/j.jclinepi.2013.04.019.CrossRefPubMed Wahl, I., Lowe, B., Bjorner, J. B., Fischer, F., Langs, G., Voderholzer, U., et al. (2014). Standardization of depression measurement: A common metric was developed for 11 self-report depression measures. Journal of Clinical Epidemiology, 67(1), 73–86. doi:10.​1016/​j.​jclinepi.​2013.​04.​019.CrossRefPubMed
12.
14.
go back to reference Kramer, T. L., Evans, R. B., Landes, R., Mancino, M., Booth, B. M., & Smith, G. R. (2001). Comparing outcomes of routine care for depression: the dilemma of case-mix adjustment. Journal of Behavioral Health Services and Research, 28(3), 287–300.CrossRefPubMed Kramer, T. L., Evans, R. B., Landes, R., Mancino, M., Booth, B. M., & Smith, G. R. (2001). Comparing outcomes of routine care for depression: the dilemma of case-mix adjustment. Journal of Behavioral Health Services and Research, 28(3), 287–300.CrossRefPubMed
15.
go back to reference Polit-O’Hara, D., & Hungler, B. P. (1997). Essentials of nursing research: Methods, appraisal, and utilization. New York: Lippincott. Polit-O’Hara, D., & Hungler, B. P. (1997). Essentials of nursing research: Methods, appraisal, and utilization. New York: Lippincott.
16.
go back to reference Hasson, F., Keeney, S., & McKenna, H. (2000). Research guidelines for the Delphi survey technique. Journal of Advanced Nursing, 32(4), 1008–1015.PubMed Hasson, F., Keeney, S., & McKenna, H. (2000). Research guidelines for the Delphi survey technique. Journal of Advanced Nursing, 32(4), 1008–1015.PubMed
21.
go back to reference McNamara, R. L., Spatz, E. S., Kelley, T. A., Stowell, C. J., Beltrame, J., Heidenreich, P., et al. (2015). Standardized outcome measurement for patients with coronary artery disease: Consensus from the International Consortium for Health Outcomes Measurement (ICHOM). Journal of the American Heart Association. doi:10.1161/JAHA.115.001767.PubMedPubMedCentral McNamara, R. L., Spatz, E. S., Kelley, T. A., Stowell, C. J., Beltrame, J., Heidenreich, P., et al. (2015). Standardized outcome measurement for patients with coronary artery disease: Consensus from the International Consortium for Health Outcomes Measurement (ICHOM). Journal of the American Heart Association. doi:10.​1161/​JAHA.​115.​001767.PubMedPubMedCentral
22.
go back to reference Morgans, A. K., van Bommel, A. C., Stowell, C., Abrahm, J. L., Basch, E., Bekelman, J. E., et al. (2015). Development of a standardized set of patient-centered outcomes for advanced Prostate cancer: An international effort for a unified approach. European Urology, 68(5), 891–898. doi:10.1016/j.eururo.2015.06.007.CrossRefPubMed Morgans, A. K., van Bommel, A. C., Stowell, C., Abrahm, J. L., Basch, E., Bekelman, J. E., et al. (2015). Development of a standardized set of patient-centered outcomes for advanced Prostate cancer: An international effort for a unified approach. European Urology, 68(5), 891–898. doi:10.​1016/​j.​eururo.​2015.​06.​007.CrossRefPubMed
23.
go back to reference Rodrigues, I. A., Sprinkhuizen, S. M., Barthelmes, D., Blumenkranz, M., Cheung, G., Haller, J., et al. (2016). Defining a minimum set of standardized patient-centered outcome measures for macular degeneration. American Journal of Ophthalmology, 168, 1–12. doi:10.1016/j.ajo.2016.04.012.CrossRefPubMed Rodrigues, I. A., Sprinkhuizen, S. M., Barthelmes, D., Blumenkranz, M., Cheung, G., Haller, J., et al. (2016). Defining a minimum set of standardized patient-centered outcome measures for macular degeneration. American Journal of Ophthalmology, 168, 1–12. doi:10.​1016/​j.​ajo.​2016.​04.​012.CrossRefPubMed
26.
go back to reference Kickbusch, I. S. (2001). Health literacy: Addressing the health and education divide. Health Promotion International, 16(3), 289–297.CrossRefPubMed Kickbusch, I. S. (2001). Health literacy: Addressing the health and education divide. Health Promotion International, 16(3), 289–297.CrossRefPubMed
27.
go back to reference Allgaier, A. K., Pietsch, K., Fruhe, B., Sigl-Glockner, J., & Schulte-Korne, G. (2012). Screening for depression in adolescents: Validity of the patient health questionnaire in pediatric care. Depress Anxiety, 29(10), 906–913. doi:10.1002/da.21971.CrossRefPubMed Allgaier, A. K., Pietsch, K., Fruhe, B., Sigl-Glockner, J., & Schulte-Korne, G. (2012). Screening for depression in adolescents: Validity of the patient health questionnaire in pediatric care. Depress Anxiety, 29(10), 906–913. doi:10.​1002/​da.​21971.CrossRefPubMed
28.
go back to reference Porter, M. E., & Teisberg, E. O. (2006). Redefining health care: Creating value-based competition on results. Boston: Harvard Business School Press. Porter, M. E., & Teisberg, E. O. (2006). Redefining health care: Creating value-based competition on results. Boston: Harvard Business School Press.
29.
go back to reference Spitzer, R. L., Kroenke, K., & Williams, J. B. (1999). Validation and utility of a self-report version of PRIME-MD: The PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA, 282(18), 1737–1744.CrossRefPubMed Spitzer, R. L., Kroenke, K., & Williams, J. B. (1999). Validation and utility of a self-report version of PRIME-MD: The PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA, 282(18), 1737–1744.CrossRefPubMed
31.
33.
go back to reference Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., et al. (2010). The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194. doi:10.1016/j.jclinepi.2010.04.011.CrossRefPubMedPubMedCentral Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., et al. (2010). The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194. doi:10.​1016/​j.​jclinepi.​2010.​04.​011.CrossRefPubMedPubMedCentral
34.
go back to reference Wells, K. B., Stewart, A., Hays, R. D., Burnam, M. A., Rogers, W., Daniels, M., et al. (1989). The functioning and well-being of depressed patients. Results from the Medical Outcomes Study. JAMA, 262(7), 914–919.CrossRefPubMed Wells, K. B., Stewart, A., Hays, R. D., Burnam, M. A., Rogers, W., Daniels, M., et al. (1989). The functioning and well-being of depressed patients. Results from the Medical Outcomes Study. JAMA, 262(7), 914–919.CrossRefPubMed
37.
go back to reference de Beurs, E., Barendregt, M., de Heer, A., et al. (2016). Comparing methods to denote treatment outcome in clinical research and benchmarking mental health care. Clinical Psychology and Psychotherapy, 23, 308–318.CrossRefPubMed de Beurs, E., Barendregt, M., de Heer, A., et al. (2016). Comparing methods to denote treatment outcome in clinical research and benchmarking mental health care. Clinical Psychology and Psychotherapy, 23, 308–318.CrossRefPubMed
38.
go back to reference Jacobson, N. S., & Truax, P. (1991). Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12–19.CrossRefPubMed Jacobson, N. S., & Truax, P. (1991). Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12–19.CrossRefPubMed
39.
go back to reference Devilly, G. J., & Borkovec, T. D. (2000). Psychometric properties of the credibility/expectancy questionnaire. Journal of Behavior Therapy and Experimental Psychiatry, 31(2), 73–86.CrossRefPubMed Devilly, G. J., & Borkovec, T. D. (2000). Psychometric properties of the credibility/expectancy questionnaire. Journal of Behavior Therapy and Experimental Psychiatry, 31(2), 73–86.CrossRefPubMed
43.
go back to reference van der Lem, R., Stamsnieder, P. M., van der Wee, N. J., van Veen, T., & Zitman, F. G. (2013). Influence of sociodemographic and socioeconomic features on treatment outcome in RCTs versus daily psychiatric practice. Social Psychiatry and Psychiatric Epidemiology, 48(6), 975–984. doi:10.1007/s00127-012-0624-4.CrossRefPubMed van der Lem, R., Stamsnieder, P. M., van der Wee, N. J., van Veen, T., & Zitman, F. G. (2013). Influence of sociodemographic and socioeconomic features on treatment outcome in RCTs versus daily psychiatric practice. Social Psychiatry and Psychiatric Epidemiology, 48(6), 975–984. doi:10.​1007/​s00127-012-0624-4.CrossRefPubMed
44.
go back to reference Holden, L., Lee, C., Hockey, R., Ware, R. S., & Dobson, A. J. (2014). Validation of the MOS Social Support Survey 6-item (MOS-SSS-6) measure with two large population-based samples of Australian women. Quality of Life Research, 23(10), 2849–2853. doi:10.1007/s11136-014-0741-5.CrossRefPubMed Holden, L., Lee, C., Hockey, R., Ware, R. S., & Dobson, A. J. (2014). Validation of the MOS Social Support Survey 6-item (MOS-SSS-6) measure with two large population-based samples of Australian women. Quality of Life Research, 23(10), 2849–2853. doi:10.​1007/​s11136-014-0741-5.CrossRefPubMed
45.
go back to reference Guan, N. C., Sulaiman, A. R., Seng, L. H., Ann, A. Y., Wahab, S., & Pillai, S. K. (2013). Factorial validity and reliability of the Tamil version of multidimensional scale of perceived social support among a group of participants in university malaya medical centre, Malaysia. Indian Journal of Psychological Medicine, 35(4), 385–388. doi:10.4103/0253-7176.122234.CrossRefPubMedPubMedCentral Guan, N. C., Sulaiman, A. R., Seng, L. H., Ann, A. Y., Wahab, S., & Pillai, S. K. (2013). Factorial validity and reliability of the Tamil version of multidimensional scale of perceived social support among a group of participants in university malaya medical centre, Malaysia. Indian Journal of Psychological Medicine, 35(4), 385–388. doi:10.​4103/​0253-7176.​122234.CrossRefPubMedPubMedCentral
46.
47.
go back to reference Kupfer, D. J., & Frank, E. (2003). Comorbidity in depression. Acta Psychiatrica Scandinavica, 108, 57–60.CrossRef Kupfer, D. J., & Frank, E. (2003). Comorbidity in depression. Acta Psychiatrica Scandinavica, 108, 57–60.CrossRef
48.
go back to reference Sangha, O., Stucki, G., Liang, M. H., Fossel, A. H., & Katz, J. N. (2003). The Self-Administered Comorbidity Questionnaire: a new method to assess comorbidity for clinical and health services research. Arthritis and Rheumatism, 49(2), 156–163. doi:10.1002/art.10993.CrossRefPubMed Sangha, O., Stucki, G., Liang, M. H., Fossel, A. H., & Katz, J. N. (2003). The Self-Administered Comorbidity Questionnaire: a new method to assess comorbidity for clinical and health services research. Arthritis and Rheumatism, 49(2), 156–163. doi:10.​1002/​art.​10993.CrossRefPubMed
49.
go back to reference Olomu, A. B., Corser, W. D., Stommel, M., Xie, Y., & Holmes-Rovner, M. (2012). Do self-report and medical record comorbidity data predict longitudinal functional capacity and quality of life health outcomes similarly? BMC Health Services Research, 12, 398. doi:10.1186/1472-6963-12-398.CrossRefPubMedPubMedCentral Olomu, A. B., Corser, W. D., Stommel, M., Xie, Y., & Holmes-Rovner, M. (2012). Do self-report and medical record comorbidity data predict longitudinal functional capacity and quality of life health outcomes similarly? BMC Health Services Research, 12, 398. doi:10.​1186/​1472-6963-12-398.CrossRefPubMedPubMedCentral
50.
go back to reference Williams, A. D., Blackwell, S. E., Mackenzie, A., Holmes, E. A., & Andrews, G. (2013). Combining imagination and reason in the treatment of depression: a randomized controlled trial of internet-based cognitive-bias modification and internet-CBT for depression. Journal of Consulting and Clinical Psychology, 81(5), 793–799. doi:10.1037/a0033247.CrossRefPubMedPubMedCentral Williams, A. D., Blackwell, S. E., Mackenzie, A., Holmes, E. A., & Andrews, G. (2013). Combining imagination and reason in the treatment of depression: a randomized controlled trial of internet-based cognitive-bias modification and internet-CBT for depression. Journal of Consulting and Clinical Psychology, 81(5), 793–799. doi:10.​1037/​a0033247.CrossRefPubMedPubMedCentral
51.
go back to reference Crits-Christoph, P., Baranackie, K., Kurcias, J., Beck, A., Carroll, K., Perry, K., et al. (1991). Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research, 1(2), 81–91.CrossRef Crits-Christoph, P., Baranackie, K., Kurcias, J., Beck, A., Carroll, K., Perry, K., et al. (1991). Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research, 1(2), 81–91.CrossRef
54.
55.
go back to reference Kolen, M. J., & Brennan, R. L. (2014). Test equating, scaling, and linking. New York: Springer.CrossRef Kolen, M. J., & Brennan, R. L. (2014). Test equating, scaling, and linking. New York: Springer.CrossRef
56.
go back to reference Fischer, H. F., Klug, C., Roeper, K., Blozik, E., Edelmann, F., Eisele, M., et al. (2014). Screening for mental disorders in heart failure patients using computer-adaptive tests. Quality of Life Research, 23(5), 1609–1618. doi:10.1007/s11136-013-0599-y.CrossRefPubMed Fischer, H. F., Klug, C., Roeper, K., Blozik, E., Edelmann, F., Eisele, M., et al. (2014). Screening for mental disorders in heart failure patients using computer-adaptive tests. Quality of Life Research, 23(5), 1609–1618. doi:10.​1007/​s11136-013-0599-y.CrossRefPubMed
57.
go back to reference Knapp, M. (2013). Making an economic case for better mental health services. In G. Thornicroft, M. Ruggeri, & D. Goldberg (Eds.), Improving mental health care, the global challenge (pp. 193–200). Oxford: Wiley-Blackwell.CrossRef Knapp, M. (2013). Making an economic case for better mental health services. In G. Thornicroft, M. Ruggeri, & D. Goldberg (Eds.), Improving mental health care, the global challenge (pp. 193–200). Oxford: Wiley-Blackwell.CrossRef
58.
go back to reference Garcia-Campayo, J., Zamorano, E., Ruiz, M. A., Pardo, A., Perez-Paramo, M., Lopez-Gomez, V., et al. (2010). Cultural adaptation into Spanish of the generalized anxiety disorder-7 (GAD-7) scale as a screening tool. Health Qual Life Outcomes, 8, 8. doi:10.1186/1477-7525-8-8.CrossRefPubMedPubMedCentral Garcia-Campayo, J., Zamorano, E., Ruiz, M. A., Pardo, A., Perez-Paramo, M., Lopez-Gomez, V., et al. (2010). Cultural adaptation into Spanish of the generalized anxiety disorder-7 (GAD-7) scale as a screening tool. Health Qual Life Outcomes, 8, 8. doi:10.​1186/​1477-7525-8-8.CrossRefPubMedPubMedCentral
59.
61.
go back to reference Silveira, C., Parpinelli, M. A., Pacagnella, R. C., Camargo, R. S., Costa, M. L., Zanardi, D. M., et al. (2013). Cross-cultural adaptation of the World Health Organization Disability Assessment Schedule (WHODAS 2.0) into Portuguese. Revista Da Associacao Medica Brasileira, 59(3), 234–240. doi:10.1016/j.ramb.2012.11.005.CrossRefPubMed Silveira, C., Parpinelli, M. A., Pacagnella, R. C., Camargo, R. S., Costa, M. L., Zanardi, D. M., et al. (2013). Cross-cultural adaptation of the World Health Organization Disability Assessment Schedule (WHODAS 2.0) into Portuguese. Revista Da Associacao Medica Brasileira, 59(3), 234–240. doi:10.​1016/​j.​ramb.​2012.​11.​005.CrossRefPubMed
62.
go back to reference Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of general internal medicine., 16(9), 606–613.CrossRefPubMedPubMedCentral Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of general internal medicine., 16(9), 606–613.CrossRefPubMedPubMedCentral
63.
go back to reference Chwastiak, L. A., & Von Korff, M. (2003). Disability in depression and back pain: Evaluation of the World Health Organization Disability Assessment Schedule (WHO DAS II) in a primary care setting. Journal of clinical epidemiology., 56(6), 507–514.CrossRefPubMed Chwastiak, L. A., & Von Korff, M. (2003). Disability in depression and back pain: Evaluation of the World Health Organization Disability Assessment Schedule (WHO DAS II) in a primary care setting. Journal of clinical epidemiology., 56(6), 507–514.CrossRefPubMed
Metadata
Title
Standardization of health outcomes assessment for depression and anxiety: recommendations from the ICHOM Depression and Anxiety Working Group
Authors
Alexander Obbarius
Lisa van Maasakkers
Lee Baer
David M. Clark
Anne G. Crocker
Edwin de Beurs
Paul M. G. Emmelkamp
Toshi A. Furukawa
Erik Hedman-Lagerlöf
Maria Kangas
Lucie Langford
Alain Lesage
Doris M. Mwesigire
Sandra Nolte
Vikram Patel
Paul A. Pilkonis
Harold A. Pincus
Roberta A. Reis
Graciela Rojas
Cathy Sherbourne
Dave Smithson
Caleb Stowell
Kelly Woolaway-Bickel
Matthias Rose
Publication date
01-12-2017
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 12/2017
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-017-1659-5

Other articles of this Issue 12/2017

Quality of Life Research 12/2017 Go to the issue