Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

Developing a measure of mental health service satisfaction for use in low income countries: a mixed methods study

Authors: Rosie Mayston, Kassahun Habtamu, Girmay Medhin, Atalay Alem, Abebaw Fekadu, Alehegn Habtamu, Martin Prince, Charlotte Hanlon

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

Service satisfaction is integral to quality of care and measures are therefore considered important indicators of quality. Patient’s responses to their experiences of using services are under-researched in the context of mental healthcare in low income countries. Our aim was to use mixed methods to develop a new measure of satisfaction for use among consumers of the new models of mental healthcare which are currently being scaled-up.

Methods

We used qualitative methods to explore the concept of service satisfaction. On the basis of these findings, we developed a new ‘Mental health service satisfaction scale’ (MHSSS v0.0) by adapting existing measures of service satisfaction. We evaluated psychometric properties of the new measure, among a sample of service users with severe mental disorder (SMD) (n = 200) and caregivers (n = 200). Following expert review, a modified version of the measure was developed (MHSSS v1.0) and psychometric properties were examined with data from a second independent sample (n = 150 service users with SMD and n = 150 caregivers).

Results

Factors identified in analysis of the first quantitative sample coincide with core concepts of service satisfaction as reported in the literature and were reflected in the key themes which emerged from our qualitative study: interpersonal factors, efficacy, communication, technical competency and adequacy of facilities. There was generally consensus among caregivers and service users regarding dimensions of satisfaction. However there was evidence of some differences in prioritization. Revisions made to version 0.0 of the Mental Health Service Satisfaction Scale (MHSSS) led to an improved instrument, with excellent internal consistency, convergent validity and factor loadings indicative of a uni-dimensional construct.

Conclusions

Our findings suggest that conceptions of service satisfaction among people accessing a service for SMD are broadly similar with those established in the literature. Our findings indicate that the MHSSS might be a useful candidate for inclusion in the new toolkit of measures needed to facilitate monitoring of service satisfaction which will be crucial to quality improvement.
Appendix
Available only for authorised users
Literature
1.
Cleary PD, McNeil BJ. Patient satisfaction as an indicator of quality care. Inquiry. 1988;25:25–36.PubMed
2.
3.
Hawthorne G, Sansoni J, Hayes L, Marosszeky N, Sansoni E. Measuring patient satisfaction with health care treatment using the short assessment of patient satisfaction measure delivered superior and robust satisfaction estimates. J Clin Epidemiol. 2014;67:527–37.CrossRefPubMed
4.
Noble LM, Douglas BC, Newman SP. What do patients expect of psychiatric services? a systematic and critical review of empirical studies. Soc Sci Med. 2001;52:985–98.CrossRefPubMed
5.
Uhlmann RF, Inui TS, Carter WB. Patient requests and expectations. Definitions and clinical applications. Med Care. 1984;22:681–5.CrossRefPubMed
6.
Uys LR, Thanjekwayo L, Volkywan L. The measurement of quality of care in public sector psychiatric services based on consumer expectations. Curationis. 1997;20:25–32.CrossRefPubMed
7.
Ware Jr JE, Snyder MK, Wright WR, Davies AR. Defining and measuring patient satisfaction with medical care. Eval Program Plann. 1983;6:247–63.CrossRefPubMed
8.
Ruggeri M, Lasalvia A, Bisoffi G, Thornicroft G, Vazquez-Barquero JL, et al. Satisfaction with mental health services among people with schizophrenia in five European sites: results from the EPSILON study. Schizophr Bull. 2003;29:229–45.CrossRefPubMed
9.
Lanfredi M, Candini V, Buizza C, Ferrari C, Boero ME, et al. The effect of service satisfaction and spiritual well-being on the quality of life of patients with schizophrenia. Psychiatry Res. 2014;216:185–91.CrossRefPubMed
10.
Morisky DE, Green LW, Levine DM. Concurrent and predictive-validity of a self-reported measure of medication adherence. Med Care. 1986;24:67–74.CrossRefPubMed
11.
Sweeney A, Fahmy S, Nolan F, Morant N, Fox Z, et al. The relationship between therapeutic alliance and service user satisfaction in mental health inpatient wards and crisis house alternatives: a cross-sectional study. PLoS One. 2014;9:e100153.CrossRefPubMedPubMedCentral
12.
MacInnes D, Courtney H, Flanagan T, Bressington D, Beer D. A cross sectional survey examining the association between therapeutic relationships and service user satisfaction in forensic mental health settings. BMC Res Notes. 2014;7:657.CrossRefPubMedPubMedCentral
13.
Rose D, Evans J, Sweeney A, Wykes T. A model for developing outcome measures from the perspectives of mental health service users. Int Rev Psychiatry. 2011;23:41–6.CrossRefPubMed
14.
Lund C, Alem A, Schneider M, Hanlon C, Ahrens J, et al. Generating evidence to narrow the treatment gap for mental disorders in sub-Saharan Africa: rationale, overview and methods of AFFIRM. Epidemiol Psychiatr Sci. 2015;24:233–40.CrossRefPubMedPubMedCentral
15.
Lund C, Tomlinson M, De Silva M, Fekadu A, Shidhaye R, et al. PRIME: a programme to reduce the treatment gap for mental disorders in five low- and middle-income countries. PLoS Med. 2012;9:e1001359.CrossRefPubMedPubMedCentral
16.
Prince M, Patel V, Saxena S, Maj M, Maselko J, et al. No health without mental health. Lancet. 2007;370:859–77.CrossRefPubMed
17.
WHO. mhGAP mental health Gap action programme: scaling up care for mental, neurological and substance use disorders. 2008.
18.
WHO. Task shifting: global recommendations and guidelines. 2008.
19.
Abera M, Tesfaye M, Belachew T, Hanlon C. Perceived challenges and opportunities arising from integration of mental health into primary care: a cross-sectional survey of primary health care workers in south-west Ethiopia. BMC Health Serv Res. 2014;14:113.CrossRefPubMedPubMedCentral
20.
Mendenhall E, De Silva MJ, Hanlon C, Petersen I, Shidhaye R, et al. Acceptability and feasibility of using non-specialist health workers to deliver mental health care: stakeholder perceptions from the PRIME district sites in Ethiopia, India, Nepal, south Africa, and Uganda. Soc Sci Med. 2014;118:33–42.CrossRefPubMedPubMedCentral
21.
Akachi Y, Tarp F, Kelley E, Addisona T, Kruk ME. Measuring quality-of-care in the context of sustainable development goal 3: a call for papers. Bull World Health Organ. 2016;94:160–160A.CrossRefPubMedPubMedCentral
22.
Baltussen RM, Ye Y, Haddad S, Sauerborn RS. Perceived quality of care of primary health care services in Burkina Faso. Health Policy Plan. 2002;17:42–8.CrossRefPubMed
23.
Haddad S, Fournier P, Potvin L. Measuring lay people’s perceptions of the quality of primary health care services in developing countries. Validation of a 20-item scale. Int J Qual Health Care. 1998;10:93–104.CrossRefPubMed
24.
Webster TR, Mantopoulos J, Jackson E, Cole-Lewis H, Kidane L, et al. A brief questionnaire for assessing patient healthcare experiences in low-income settings. Int J Qual Health Care. 2011;23:258–68.CrossRefPubMed
25.
Ruggeri M, Dall’Agnola R. The development and use of the Verona expectations for care scale (VECS) and the Verona service satisfaction scale (VSSS) for measuring expectations and satisfaction with community-based psychiatric services in patients, relatives and professionals. Psychol Med. 1993;23:511–23.CrossRefPubMed
26.
Henderson C, Hales H, Ruggeri M. Cross-cultural differences in the conceptualisation of patients’ satisfaction with psychiatric services—content validity of the English version of the Verona service satisfaction scale. Soc Psychiatry Psychiatr Epidemiol. 2003;38:142–8.CrossRefPubMed
27.
Hanlon C, Alem A, Medhin G, Shibre T, Ejigu DA, et al. Task sharing for the care of severe mental disorders in a low-income country (TaSCS): study protocol for a randomised, controlled, non-inferiority trial. Trials. 2016;17:76.CrossRefPubMedPubMedCentral
28.
University of Umeå S. OpenCode 4.0. Sweden: ICT Services and System Development and Division of Epidemiology and Global Health; 2013.
29.
30.
Habtamu K, Alem A, Medhin G, Fekadu A, Prince M, Hanlon C. Development and validation of a contextual measure of functioning for people living with severe mental disorders in rural Africa. BMC Psychiatry. 2016;16.
31.
Luborsky L, Barber JP, Siqueland L, Johnson S, Najavits LM, et al. The revised helping alliance questionnaire (HAq-II): psychometric properties. J Psychother Pract Res. 1996;5:260–71.PubMedPubMedCentral
32.
Priebe S, Gruyters T. The role of the helping alliance in psychiatric community care. A prospective study. J Nerv Ment Dis. 1993;181:552–7.CrossRefPubMed
33.
Lund C, Alem A, Schneider M, Hanlon C, Ahrens J, et al. Generating evidence to narrow the treatment gap for mental disorders in sub-Saharan Africa: rationale, overview and methods of AFFIRM. Epidemiol Psychiatr Sci. 2015;24(3):233-40.
34.
Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.CrossRef
35.
Landis JR, Koch GG. Measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRefPubMed
36.
Mayston R, Alem A, Habtamu A, Shibre T, Fekadu A, et al. Participatory planning of a primary care service for people with severe mental disorders in rural Ethiopia. Health Policy Plan. 2016;31:367–76.CrossRefPubMed
37.
Andaleeb SS. Service quality perceptions and patient satisfaction: a study of hospitals in a developing country. Soc Sci Med. 2001;52:1359–70.CrossRefPubMed
38.
Rydon SE. The attitudes, knowledge and skills needed in mental health nurses: the perspective of users of mental health services. Int J Ment Health Nurs. 2005;14:78–87.CrossRefPubMed
39.
Moyle W. Nurse-patient relationship: a dichotomy of expectations. Int J Ment Health Nurs. 2003;12:103–9.CrossRefPubMed
40.
Leamy M, Bird V, Le Boutillier C, Williams J, Slade M. Conceptual framework for personal recovery in mental health: systematic review and narrative synthesis. Br J Psychiatry. 2011;199:445–52.CrossRefPubMed
41.
Laugharne R, Priebe S. Trust, choice and power in mental health: a literature review. Soc Psychiatry Psychiatr Epidemiol. 2006;41:843–52.CrossRefPubMed
42.
Barbato A, Bajoni A, Rapisarda F, D’Anza V, De Luca LF, et al. Quality assessment of mental health care by people with severe mental disorders: a participatory research project. Community Ment Health J. 2014;50:402–8.CrossRefPubMed
43.
Jorm AF, Oh E. Desire for social distance from people with mental disorders. Aust N Z J Psychiatry. 2009;43:183–200.CrossRefPubMed
44.
Edgman-Levitan S, Cleary PD. What information do consumers want and need? Health Aff (Millwood). 1996;15:42–56.CrossRef
45.
Sim J, Wright CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005;85:257–68.PubMed
46.
WHO. Mental health information systems. Geneva: World Health Organization; 2005.
Metadata
Title
Developing a measure of mental health service satisfaction for use in low income countries: a mixed methods study
Authors
Rosie Mayston
Kassahun Habtamu
Girmay Medhin
Atalay Alem
Abebaw Fekadu
Alehegn Habtamu
Martin Prince
Charlotte Hanlon
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-017-2126-2

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue

Research article

Explaining culturally and linguistically diverse (CALD) parents’ access of healthcare services for developmental surveillance and anticipatory guidance: qualitative findings from the ‘Watch Me Grow’ study

Research article

The safety attitudes questionnaire – ambulatory version: psychometric properties of the Slovenian version for the out-of-hours primary care setting

Research article

The effect of increasing the coinsurance rate on outpatient utilization of healthcare services in South Korea

Research article

Safe medication management in specialized home healthcare - an observational study

Research article

Patient navigation to improve diabetes outpatient care at a safety-net hospital: a retrospective cohort study

Research article

Leveraging the private sector for child health: a qualitative examination of caregiver and provider perspectives on private sector care for childhood pneumonia in Uttar Pradesh, India