Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
Administration and Policy in Mental Health and Mental Health Services Research
Published in: Administration and Policy in Mental Health and Mental Health Services Research 3/2015

01-05-2015 | Original Article

Evaluation Dimensions for Collaborative Mental Health Services in Primary Care Systems in Latin America: Results of a Delphi Group

Authors: Jaime C. Sapag, Brian Rush, Jan Barnsley

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 3/2015

Login to get access

Abstract

This article presents the results of a Delphi group to identify the dimensions of an evaluation framework for collaborative mental health care (CMHC) in Latin America. A three-round Delphi process was implemented with 26 experts from Latin America and Canada to identify main areas of consensus, as well as disagreements, about the importance and feasibility of potential evaluation dimensions previously identified in Mexico, Nicaragua and Chile. Participants validated 40 evaluation dimensions. They strongly endorsed a comprehensive evaluation framework for CMHC in Latin America. This study represents a solid foundation for developing an evaluation framework for CMHC.
Appendix
Available only for authorised users
Footnotes
1
For a better understanding of the different mental health systems in Latin America and the role of primary care, please, review the results by country of the World Health Organization Assessment Instrument for Mental Health Systems (WHO-AIMS) at http://​www.​who.​int/​mental_​health/​evidence/​WHO-AIMS/​en/​.
 
2
The results of the literature review and the site visits have been submitted as separate articles for their publication.
 
3
The two panelists from Canada had long experience working in Latin America.
 
4
The purpose of this Delphi was not to identify final definitions for the evaluation framework dimensions and domains. That final step of building the framework was done after the Delphi as a final step of the research study. The final evaluation framework with tighter definitions and recommendations to operationalize the dimensions has been completed and published: Sapag and Rush (2013). A framework to evaluate collaborative mental health services in primary care systems in Latin America. Toronto: Self-published.
 
Literature
Aday, A., Begley, C. H., Lairson, D. R., & Balkrishnan, R. (2004). Evaluating the healthcare system: effectiveness, efficiency and equity. Chicago: AHR.
Addington, D. E., Mckenzie, E., Wang, J., Smith, H. P., Adams, B., & Zahinoor, I. (2012). Development of a core set of performance measures for evaluating schizophrenia treatment services. Psychiatric Services, 63, 584–591.CrossRefPubMed
Ashburner, L. (2002). The concept of collaboration in primary care. In Peter Nolan & Frances Badger (Eds.), Promoting collaboration in primary mental health care. London: Nelson Thornes Ltd.
Bamberger, M., Rugh, J., & Mabry, L. (2012). Real world evaluation. Thousand Oaks, CA: Sage Publications.
Barnsley, J., Berta, W., Cockerill, R., MacPhail, J., & Vayda, E. (2005). Identifying performance indicators for family practice: Assessing levels of consensus. Canadian Family Physician, 51, 700–701.PubMed
Bergner, R. M. (2006). An open letter from Isaac Newton to the field of psychology. Advances in Descriptive Psychology (Vol. 8). Ann Arbor, MI: Descriptive Psychology Press.
Bower, P., & Gilbody, S. (2005). Managing common mental health disorders in primary care: Conceptual models and evidence base. British Medical Journal, 330, 839–842.CrossRefPubMedCentralPubMed
Broemeling, A. M., Watson, D. E., Black, C., & Reid, R. J. (2006). Measuring the performance of primary health care: Existing capacity and future information needs. University of British Columbia. Centre for Health Services and Policy Research.
Caldas de Almeida, J. M., & Horvitz-Lennon, M. (2010). Mental health care reforms in Latin America: An overview of mental health care reforms in Latin America and the Caribbean. Psychiatric Services (Washington, D. C.), 61, 218–221.CrossRef
Campbell, S. M., Cantrill, J. A., & Roberts, D. (2000). Prescribing indicators for UK general practice: Delphi consultation study. BMJ, 321, 425–428.CrossRefPubMedCentralPubMed
CPA (Canadian Psychiatric Association) & CFPC (College of Family Physicians of Canada). (2000). Shared Mental Health Care in Canada. Current status, commentary and recommendations. A Report of the Collaborative Working Group on Shared Mental Health Care. Canada.
Creswell, J.W. (1994). Research design. Qualitative and quantitative approaches. Thousand Oaks, CA: Sage Publications.
Creswell, J. W., & Plano Clark, V. L. (2011). Designing and conducting mixed methods research (2nd ed.). California: Sage Publications.
de Savigny, D., & Adam, T. (Eds.). (2009). Systems thinking for health systems strengthening. WHO: Alliance for Health Policy and Systems Research.
Dickey, B., Normand, S. L., Eisen, S., et al. (2006). Associations between adherence to guidelines for antipsychotic dose and health status, side effects, and patient care experiences. Medical Care, 44(827–834), 2006.
Donabedian, A. (2002). An introduction to quality assurance in health care. Oxford: Oxford University Press.
Donohoe, H., Stellefson, M., & Tennant, B. (2012). Advantages and limitations of the e-Delphi technique: Implications for health education researchers. American Journal of Health Education, 43(1), 38–46.CrossRef
Escorel, S., Giovanella, L., Mendonca, M. E., & Senna, M. (2007). O Programa de Saúde da Família e a construção de um novo modelo para a atenção básica no Brasil. (The Family Health Program and the construction of a new model for primary care in Brazil). Revista Panamericana de Salud Publica, 21, 164–176.CrossRefPubMed
Evans, J. M., & Baker, G. R. (2012). Shared mental models of integrated care: Aligning multiple stakeholder perspectives. Journal of Health Organization and Management, 26(6), 713–736.CrossRefPubMed
Fink, A., Kosecoff, J., Chassin, M., & Brook, R. H. (1984). Consensus methods: Characteristics and guidelines for use. American Journal of Public Health, 74(9), 979–983.CrossRefPubMedCentralPubMed
Gagné, M.A. (2005). What is collaborative mental health care? An introduction to the collaborative mental health care framework. Mississauga, ON: Canadian Collaborative Mental Health Initiative. Retrieved January 13, 2010 from www.​ccmhi.​ca.
Gask, L., Sibbald, B., & Creed, F. (1997). Evaluating models of working at the interface between mental health services and primary care. British Journal of Psychiatry, 170, 6–11.CrossRefPubMed
Haggerty, J., Burge, F., Lévesque, J. F., Gass, D., Pineault, R., Beaulieu, M. D., et al. (2007). Operational definitions of attributes of primary health care: Consensus among Canadian experts. The Annals of Family Medicine, 5(4), 336–344.CrossRef
Haggerty, J. L., Yavich, N., & Báscolo, E. P. (2009). A framework for evaluating primary health care in Latin America. Revista Panamericana de Salud Publica, 26(5), 377–384.PubMed
Hermann, R. C., Palmer, H., Leff, S., Shwartz, M., Provost, S., Chan, J., et al. (2004). Achieving consensus across diverse stakeholders on quality measures for mental healthcare. Medical Care, 42(12), 1246–1253.CrossRefPubMed
Ivbijaro, G. (Ed.). (2012). Companion to primary care mental health. World Organization of National Colleges, Academies and Academic Associations of General Practitioners/Family Physicians (WONCA). London: Radcliffe.
Kates, N., Ackerman, S., Crustolo, A.M., & Mach, M. (2006). Collaboration between mental health and primary care services: A planning and implementation toolkit for health care providers and planners. Mississauga, ON: Canadian Collaborative Mental Health Initiative. Retrieved April 30, 2013 from www.​ccmhi.​ca.
Kates, N., McPherson-Doe, C., & George, L. (2011). Integrating mental health services within primary care settings: The Hamilton Family Health Team. Journal of Ambulatory Care Management, 34(2), 174–182.CrossRefPubMed
Khenti, A., Sapag, J. C., Garcia-Andrade, C., Poblete, F., Santiago de Lima, A. R., Herrera, A., et al. (2011). Building primary health care capacity to address addiction and mental health inequities: Lessons from Latin America and the Caribbean. Ethnicity and Inequalities in Health and Social Care, 4(3), 143–154.CrossRef
Knudsen, H. C., & Thornicroft, G. (1996). Evaluation of mental health services. Cambridge: Cambridge University Press.
Murphy, M. K., Black, N., Lamping, D. L., McKee, C. M., Sanderson, C. F. B., Askham, J., et al. (1998). Consensus development methods and their use in clinical guideline development. Health Technology Assessment, 2(3), 1–88.
Myette, T. (2008). Integrated management of depression: Improving system quality and creating effective interfaces. Journal of Occupational and Environmental Medicine, 50, 482–491.CrossRefPubMed
Nelson, G., & Wilfrid, L. (2004). A comprehensive evaluation framework for mental health consumer/survivor organizations: Values, conceptualization, design and action. Canadian Journal of Program Evaluation, 19(3), 29–53.
PAHO. (2013). WHO-AIMS: Report on mental health systems in Latin America and the Caribbean. Report on the Assessment of Mental Health Systems in Latin America and the Caribbean using the World Health Organization Assessment Instrument for Mental Health Systems (WHO-AIMS). Washington DC: PAHO.
PAHO. (2009). Strategy and Plan of Action on Mental Health for the Americas. 49th Directing Council CD49/11, PAHO, Washington, DC, USA, 28 September–2 October 2009.
PAHO. (2012). Health in the Americas 2012. Washington DC: PAHO.
Patton, M. Q. (2010). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York: The Guilford Press.
Powell, C. (2003). The Delphi technique: Myths and realities. Journal of Advanced Nursing, 41(4), 376–382.CrossRefPubMed
Richie, J., & Spencer, L. (1994). Qualitative data analysis for applied policy research. In A. Bryman & R. Burgess (Eds.), Analazing qualiative data (pp. 173–194). London: Routledge.
Rodríguez, J. J. (2010). Mental health care systems in Latin America and the Caribbean. International Review of Psychiatry, 22(4), 317–324.CrossRefPubMed
Rodriguez, J. J., Kohn, R., & Aguilar-Gaxiola, S. (Eds.). (2009). Epidemiologia de los trastornos mentales en America Latina y El Caribe (Epidemiology of mental disorders in Latin America and the Caribbean). Washington, DC: PAHO.
Rush, B. (2003). The Evaluation of treatment services and systems for substance use disorders. Rev Psiquiatr Rio Gd Sul, 25(3), 393–411.CrossRef
Sapag, J.C., & Rush, B. (2012). Evaluation of primary care mental health. In G. Ivbijaro (Ed.), Companion to primary care mental health (pp. 138–152). World Organization of National Colleges, Academies and Academic Associations of General Practitioners/Family Physicians (WONCA). London: Radcliffe.
Sapag, J., & Rush, B. (2013). A framework to evaluate collaborative mental health services in primary care systems in Latin America. Toronto: Self-publication.
Shield, T., Campbell, S., Rogers, A., Worrall, A., Chew-Graham, C., & Gask, L. (2003). Quality indicators for primary care mental health services. Quality and Safety in Health Care, 12, 100–106.CrossRefPubMedCentralPubMed
Siskind, D., Araya, R., & Kim, J. (2010). Cost-effectiveness of improved primary care treatment of depression in women in Chile. British Journal of Psychiatry, 197(4), 291–296.CrossRefPubMed
Sridharan, S., & Nakaima, A. (2011). Ten steps to making evaluation matter. Evaluation and Program Planning, 34(2), 135–146.CrossRefPubMed
Starfield, B. (1998). Primary care: Balancing health needs, services and technology. New York: Oxford University Press.
Sullivan, T. J. (1998). Collaboration: A health care imperative. New York: McGraw-Hill.
Turoff, M., & Linstone, H. (2002). The Delphi method: Techniques and applications. Newark, NJ: New Jersey Institute of Technology.
Turton, P., Wright, C., White, S., Killaspy, H., & DEMoBinc Group. (2010). Promoting recovery in long-term institutional mental health care: An international Delphi study. Psychiatric Services (Washington, D. C.), 61(3), 293–299.CrossRef
WHO. (2013). Mental health action plan 2013–2020. Geneva: WHO.
WHO and WONCA. (2008). Integrating mental health into primary care: a global perspective. Geneva: WHO.
Yarbrough, D. B., Shulha, L. M., Hopson, R. K., & Caruthers, F. A. (2011). The program evaluation standards: A guide for evaluators and evaluation users (3rd ed.). Thousand Oaks, CA: Sage Publications.
Metadata
Title
Evaluation Dimensions for Collaborative Mental Health Services in Primary Care Systems in Latin America: Results of a Delphi Group
Authors
Jaime C. Sapag
Brian Rush
Jan Barnsley
Publication date
01-05-2015
Publisher
Springer US
Published in
Administration and Policy in Mental Health and Mental Health Services Research / Issue 3/2015
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-014-0567-z

Other articles of this Issue 3/2015

Administration and Policy in Mental Health and Mental Health Services Research 3/2015 Go to the issue

Original Article

Methodological Considerations in Service Use Assessment for Children and Youth with Mental Health Conditions; Issues for Economic Evaluation

Point of View

Barriers to Supported Education Implementation: Implications for Administrators and Policy Makers

Original Article

Validation of the Symptoms and Functioning Severity Scale in Residential Group Care

Original Article

Assessment of Adolescent Mental Health and Behavioral Problems in Institutional Care: Discrepancies Between Staff-Reported CBCL Scores and Adolescent-Reported YSR Scores

Original Article

The Effects of State Psychiatric Hospital Waitlist Policies on Length of Stay and Time to Readmission

Original Article

Measuring the Quality of Mental Health Care: Consensus Perspectives from Selected Industrialized Countries